2020-11-20T11:18:44.565 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:18:44.568 DEBUG:teuthology.run:Teuthology command: teuthology --block --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265 --verbose --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi --description fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} --lock --owner scheduled_pdonnell@teuthology -- /tmp/teuthology-worker.5okna46p.tmp 2020-11-20T11:18:44.613 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:18:44.682 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265 branch: wip-pdonnell-testing-20201120.053228 description: fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} email: pdonnell@redhat.com first_in_suite: false job_id: '5640265' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds inject traceless reply probability: 0.5 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.21167 2020-11-20T11:18:44.682 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:18:44.684 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:18:44.684 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:18:44.686 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:18:44.706 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:18:44.706 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:18:44.706 INFO:teuthology.packaging:ref: None 2020-11-20T11:18:44.707 INFO:teuthology.packaging:tag: None 2020-11-20T11:18:44.707 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:18:44.707 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:18:44.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:18:44.874 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:18:44.875 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:18:44.890 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:18:44.890 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:18:44.937 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:18:44.938 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:18:44.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:18:55.010 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:05.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:15.050 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:25.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:35.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:45.150 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:19:55.168 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:20:05.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:20:15.219 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:20:26.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:20:36.812 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:20:46.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:20:56.847 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:21:06.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:21:16.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:21:26.902 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:21:36.918 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:21:46.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:21:56.959 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:22:06.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:22:16.990 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:22:27.005 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:22:37.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:22:47.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:22:57.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:23:07.066 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:23:17.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:23:27.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:23:37.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:23:47.139 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-20T11:23:57.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:24:07.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:24:17.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-20T11:24:27.215 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265'} 2020-11-20T11:24:27.234 DEBUG:teuthology.lock.ops:locked ubuntu@smithi161.front.sepia.ceph.com, ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:24:27.284 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4ee59f9d8>, signals=[15]) 2020-11-20T11:24:27.506 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 18.04 2020-11-20T11:24:27.509 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of ubuntu 18.04 2020-11-20T11:24:27.903 INFO:teuthology.orchestra.console:Power off smithi186 2020-11-20T11:24:27.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:24:27.941 INFO:teuthology.orchestra.console:Power off smithi161 2020-11-20T11:24:27.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:24:27.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:27.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:31.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:31.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:36.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:36.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:36.306 INFO:teuthology.orchestra.console:Power off for smithi186 completed 2020-11-20T11:24:36.407 INFO:teuthology.orchestra.console:Power on smithi186 2020-11-20T11:24:36.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:24:36.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:40.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:40.458 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2020-11-20T11:24:40.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:40.561 INFO:teuthology.orchestra.console:Power on smithi161 2020-11-20T11:24:40.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:24:40.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:44.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:44.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:44.790 INFO:teuthology.orchestra.console:Power on for smithi186 completed 2020-11-20T11:24:44.892 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2020-11-20T11:24:48.831 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:24:49.041 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2020-11-20T11:24:49.142 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2020-11-20T11:27:46.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:27:50.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:27:55.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:27:59.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:04.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:08.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:13.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:17.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:22.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:26.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:31.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:35.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:41.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:28:44.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:47.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:47.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:29:47.173 INFO:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:29:47.538 INFO:teuthology.provision.fog.smithi186:Node is ready 2020-11-20T11:29:47.538 INFO:teuthology.orchestra.run.smithi186:> hostname 2020-11-20T11:29:47.587 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2020-11-20T11:29:47.588 INFO:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2020-11-20T11:29:47.636 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2020-11-20T11:29:47.636 INFO:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2020-11-20T11:29:47.759 INFO:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2020-11-20T11:29:47.775 INFO:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2020-11-20T11:29:47.835 INFO:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2020-11-20T11:29:47.891 INFO:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2020-11-20T11:29:47.948 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2020-11-20T11:29:47.948 DEBUG:teuthology.parallel:result is None 2020-11-20T11:29:50.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:50.831 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T11:29:50.831 INFO:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T11:29:51.202 INFO:teuthology.provision.fog.smithi161:Node is ready 2020-11-20T11:29:51.202 INFO:teuthology.orchestra.run.smithi161:> hostname 2020-11-20T11:29:51.250 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2020-11-20T11:29:51.251 INFO:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2020-11-20T11:29:51.299 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2020-11-20T11:29:51.299 INFO:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2020-11-20T11:29:51.436 INFO:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2020-11-20T11:29:51.452 INFO:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2020-11-20T11:29:51.508 INFO:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2020-11-20T11:29:51.562 INFO:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2020-11-20T11:29:51.619 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2020-11-20T11:29:51.620 DEBUG:teuthology.parallel:result is None 2020-11-20T11:29:51.748 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2020-11-20T11:29:51.748 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:29:51.765 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2020-11-20T11:29:51.766 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T11:29:51.781 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:29:51.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:29:51.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:51.855 INFO:teuthology.orchestra.run.smithi161:> true 2020-11-20T11:29:52.045 INFO:teuthology.orchestra.run.smithi161:> uname -m 2020-11-20T11:29:52.100 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2020-11-20T11:29:52.101 INFO:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2020-11-20T11:29:52.159 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2020-11-20T11:29:52.159 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-20T11:29:52.159 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2020-11-20T11:29:52.160 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2020-11-20T11:29:52.160 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-20T11:29:52.160 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="18.04" 2020-11-20T11:29:52.161 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-20T11:29:52.161 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-20T11:29:52.161 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-20T11:29:52.162 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-20T11:29:52.162 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=bionic 2020-11-20T11:29:52.162 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=bionic 2020-11-20T11:29:52.163 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2020-11-20T11:29:52.191 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2020-11-20T11:29:52.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:29:52.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:52.284 INFO:teuthology.orchestra.run.smithi186:> true 2020-11-20T11:29:52.534 INFO:teuthology.orchestra.run.smithi186:> uname -m 2020-11-20T11:29:52.583 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2020-11-20T11:29:52.583 INFO:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2020-11-20T11:29:52.634 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2020-11-20T11:29:52.634 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-20T11:29:52.635 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2020-11-20T11:29:52.635 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2020-11-20T11:29:52.635 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-20T11:29:52.635 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="18.04" 2020-11-20T11:29:52.635 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-20T11:29:52.636 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-20T11:29:52.636 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-20T11:29:52.636 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-20T11:29:52.636 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=bionic 2020-11-20T11:29:52.636 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=bionic 2020-11-20T11:29:52.637 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2020-11-20T11:29:52.658 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-11-20T11:29:52.705 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS1Kmf7hjzfvWtlKhUj9M4a33C9L7/+qPGBe9TPhahGYYPhwdiTvVVLWxSWVe0mNIVIJTqd1Xy8McKJoCWPBJDpEk05v2vYj3R/tg/keESUOY4paA+0Ex/QIIaQ9bFWLJYIXKL4PNGhNnbMAeDblWPdO4TH32LchbPl5uQXCITkqAFiQUlFQRgEaAzsd3mmkbBpYP0s0r99TKDVCYhzmTgOD4+u53kTYchp2b4g8zPpk6QGPIQjv4s6aSLhV0gPVyO2p6RzCbb4945j5QbCiVcL4/tICpcfegBqki48rmGlffBUmB/6m8pnRCtPnJV15IKJJfL/Ayn9ef5UKdXw0bJ smithi186.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD78tJzxz9SbzfIoMd9DF2Ij5TEAq2agXdWYp+K87vMXW0BEiL63goPkI8JvTrySdpcKGJVkoDTMqT+TyeSn2gtH2dX3+3mF+OHHh83ETXHDgu69zNiyf7UXghsQ0TkP7SUNxGzRKoMTKFrhi4eNKYtsUKoliMLannqsi88p7hZYy/kmxSiFxVtRrtv3awcWiXJg9sDr15PwVE1z2XogSzYkjplh3hoH5fsZIXX1jbACXC92hvqEUo8W1uNWg+/L4a93xdIFoVo1ug9Zl/tFqzDkqp4CTeU2p0wcc6VhGEX+2B5FwJVp6H9ZieqEGO0anQrgViEZC3jeh9rReweQYt1 2020-11-20T11:29:52.706 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:29:52.763 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T11:29:52.769 INFO:teuthology.task.internal:Saving configuration 2020-11-20T11:29:52.792 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T11:29:52.872 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T11:29:52.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:24:27.220556', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICTE1N/3LyD8+5liNGVJDwqWMDJclNoV7kGhf2nt3mu3', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi161.front.sepia.ceph.com'} 2020-11-20T11:29:52.903 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:24:27.220576', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJUApU3VBur+lUr2fLlkY+vzUfpadWgq1HAVlmTyZGCS', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi186.front.sepia.ceph.com'} 2020-11-20T11:29:52.904 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T11:29:52.918 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-11-20T11:29:52.918 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-11-20T11:29:52.919 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T11:29:53.033 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4ee57c950>, signals=[15]) 2020-11-20T11:29:53.034 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T11:29:53.046 INFO:teuthology.task.internal:Opening connections... 2020-11-20T11:29:53.046 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:29:53.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:53.125 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:29:53.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:29:53.203 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T11:29:53.211 INFO:teuthology.orchestra.run.smithi161:> uname -m 2020-11-20T11:29:53.314 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2020-11-20T11:29:53.315 INFO:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2020-11-20T11:29:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2020-11-20T11:29:53.362 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-20T11:29:53.363 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2020-11-20T11:29:53.363 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2020-11-20T11:29:53.363 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-20T11:29:53.363 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="18.04" 2020-11-20T11:29:53.364 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-20T11:29:53.364 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-20T11:29:53.364 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-20T11:29:53.364 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-20T11:29:53.365 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=bionic 2020-11-20T11:29:53.365 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=bionic 2020-11-20T11:29:53.365 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2020-11-20T11:29:53.383 INFO:teuthology.orchestra.run.smithi186:> uname -m 2020-11-20T11:29:53.411 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2020-11-20T11:29:53.411 INFO:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2020-11-20T11:29:53.459 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Ubuntu" 2020-11-20T11:29:53.460 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-11-20T11:29:53.460 INFO:teuthology.orchestra.run.smithi186.stdout:ID=ubuntu 2020-11-20T11:29:53.460 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE=debian 2020-11-20T11:29:53.461 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-11-20T11:29:53.461 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="18.04" 2020-11-20T11:29:53.461 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.ubuntu.com/" 2020-11-20T11:29:53.461 INFO:teuthology.orchestra.run.smithi186.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-11-20T11:29:53.461 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-11-20T11:29:53.462 INFO:teuthology.orchestra.run.smithi186.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-11-20T11:29:53.462 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_CODENAME=bionic 2020-11-20T11:29:53.462 INFO:teuthology.orchestra.run.smithi186.stdout:UBUNTU_CODENAME=bionic 2020-11-20T11:29:53.462 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2020-11-20T11:29:53.477 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T11:29:53.519 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T11:29:53.528 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T11:29:53.528 INFO:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:29:53.531 INFO:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2020-11-20T11:29:53.537 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T11:29:53.544 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T11:29:53.544 INFO:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:29:53.578 INFO:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2020-11-20T11:29:53.587 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T11:29:53.627 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T11:29:53.642 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}} 2020-11-20T11:29:53.643 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-11-20T11:29:53.643 INFO:teuthology.orchestra.run.smithi161:> uname -r 2020-11-20T11:29:53.649 INFO:teuthology.orchestra.run.smithi161.stdout:4.15.0-123-generic 2020-11-20T11:29:53.650 INFO:teuthology.task.kernel:Running kernel on smithi161: 4.15.0-123-generic 2020-11-20T11:29:53.650 INFO:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2020-11-20T11:29:53.763 INFO:teuthology.orchestra.run.smithi161:> sudo apt-get update 2020-11-20T11:29:54.035 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-20T11:29:54.055 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:29:54.117 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-20T11:29:54.407 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-20T11:29:54.431 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [861 kB] 2020-11-20T11:29:54.566 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,162 kB] 2020-11-20T11:29:54.790 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,426 kB] 2020-11-20T11:29:54.886 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,089 kB] 2020-11-20T11:29:54.938 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,761 kB] 2020-11-20T11:29:54.939 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [967 kB] 2020-11-20T11:29:54.973 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [243 kB] 2020-11-20T11:29:55.039 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [373 kB] 2020-11-20T11:29:55.057 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [17.3 kB] 2020-11-20T11:29:55.057 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [196 kB] 2020-11-20T11:29:55.066 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [26.3 kB] 2020-11-20T11:29:55.067 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,547 kB] 2020-11-20T11:29:55.114 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-20T11:29:55.167 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [356 kB] 2020-11-20T11:29:55.176 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.4 kB] 2020-11-20T11:29:55.177 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [36.1 kB] 2020-11-20T11:29:55.178 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,308 B] 2020-11-20T11:29:56.345 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 12.0 MB in 2s (5,043 kB/s) 2020-11-20T11:29:57.745 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:29:57.792 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-20T11:29:57.875 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:29:58.120 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:29:58.120 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:29:58.199 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2020-11-20T11:29:58.200 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-20T11:29:58.201 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-20T11:29:58.279 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:29:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:29:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:29:58.713 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2020-11-20T11:29:58.713 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-20T11:29:58.713 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-generic linux-image-4.15.0-124-generic 2020-11-20T11:29:58.714 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-4.15.0-124-generic linux-modules-extra-4.15.0-124-generic 2020-11-20T11:29:58.715 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2020-11-20T11:29:58.715 INFO:teuthology.orchestra.run.smithi161.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-20T11:29:58.716 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2020-11-20T11:29:58.716 INFO:teuthology.orchestra.run.smithi161.stdout: thermald 2020-11-20T11:29:58.744 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2020-11-20T11:29:58.744 INFO:teuthology.orchestra.run.smithi161.stdout: linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-20T11:29:58.744 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-4.15.0-124-generic linux-modules-4.15.0-124-generic 2020-11-20T11:29:58.745 INFO:teuthology.orchestra.run.smithi161.stdout: linux-modules-extra-4.15.0-124-generic 2020-11-20T11:29:58.746 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2020-11-20T11:29:58.747 INFO:teuthology.orchestra.run.smithi161.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-20T11:29:58.928 INFO:teuthology.orchestra.run.smithi161.stdout:3 upgraded, 5 newly installed, 0 to remove and 22 not upgraded. 2020-11-20T11:29:58.929 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 65.9 MB of archives. 2020-11-20T11:29:58.929 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-20T11:29:58.929 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-124-generic amd64 4.15.0-124.127 [13.1 MB] 2020-11-20T11:29:59.926 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-124-generic amd64 4.15.0-124.127 [8,012 kB] 2020-11-20T11:30:00.131 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-124-generic amd64 4.15.0-124.127 [32.8 MB] 2020-11-20T11:30:01.175 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.124.111 [1,868 B] 2020-11-20T11:30:01.190 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.124.111 [2,624 B] 2020-11-20T11:30:01.191 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124 all 4.15.0-124.127 [10.9 MB] 2020-11-20T11:30:01.471 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124-generic amd64 4.15.0-124.127 [1,084 kB] 2020-11-20T11:30:01.517 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.124.111 [2,520 B] 2020-11-20T11:30:01.972 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 65.9 MB in 3s (23.9 MB/s) 2020-11-20T11:30:02.141 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-4.15.0-124-generic. 2020-11-20T11:30:02.180 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102077 files and directories currently installed.) 2020-11-20T11:30:02.183 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../0-linux-modules-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:02.226 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:03.809 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-4.15.0-124-generic. 2020-11-20T11:30:03.820 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../1-linux-image-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:03.916 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:04.462 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-124-generic. 2020-11-20T11:30:04.474 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:04.513 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:08.141 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../3-linux-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:30:08.237 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:30:08.578 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:30:08.707 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:30:09.051 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-4.15.0-124. 2020-11-20T11:30:09.065 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../5-linux-headers-4.15.0-124_4.15.0-124.127_all.deb ... 2020-11-20T11:30:09.109 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-20T11:30:14.242 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-headers-4.15.0-124-generic. 2020-11-20T11:30:14.264 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../6-linux-headers-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:14.309 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:16.543 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:30:16.698 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-headers-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:30:17.032 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:17.586 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:18.022 INFO:teuthology.orchestra.run.smithi161.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:30:18.023 INFO:teuthology.orchestra.run.smithi161.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-124-generic 2020-11-20T11:30:18.137 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:18.630 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-20T11:30:18.757 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-generic (4.15.0.124.111) ... 2020-11-20T11:30:18.882 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:19.008 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-headers-generic (4.15.0.124.111) ... 2020-11-20T11:30:19.134 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-generic (4.15.0.124.111) ... 2020-11-20T11:30:19.260 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:19.472 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-20T11:30:19.472 INFO:teuthology.orchestra.run.smithi161.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:30:35.188 INFO:teuthology.orchestra.run.smithi161.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-20T11:30:35.188 INFO:teuthology.orchestra.run.smithi161.stdout:Sourcing file `/etc/default/grub' 2020-11-20T11:30:35.218 INFO:teuthology.orchestra.run.smithi161.stdout:Generating grub configuration file ... 2020-11-20T11:30:35.569 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:30:35.602 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:30:35.946 INFO:teuthology.orchestra.run.smithi161.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-20T11:30:35.978 INFO:teuthology.orchestra.run.smithi161.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-20T11:30:37.596 INFO:teuthology.orchestra.run.smithi161.stdout:done 2020-11-20T11:30:37.967 INFO:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2020-11-20T11:30:37.991 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2020-11-20T11:30:37.991 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2020-11-20T11:30:37.993 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2020-11-20T11:30:37.994 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2020-11-20T11:30:37.994 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 16 2020-11-20T11:30:37.994 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2020-11-20T11:30:37.995 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2020-11-20T11:30:37.995 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2020-11-20T11:30:37.995 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 4.15.0.124.111 2020-11-20T11:30:37.996 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-20T11:30:37.996 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-20T11:30:37.997 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2020-11-20T11:30:37.997 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2020-11-20T11:30:37.997 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2020-11-20T11:30:37.998 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2020-11-20T11:30:37.998 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-123-generic Expected: 4.15.0-124-generic 2020-11-20T11:30:37.999 INFO:teuthology.orchestra.run.smithi186:> uname -r 2020-11-20T11:30:38.006 INFO:teuthology.orchestra.run.smithi186.stdout:4.15.0-123-generic 2020-11-20T11:30:38.007 INFO:teuthology.task.kernel:Running kernel on smithi186: 4.15.0-123-generic 2020-11-20T11:30:38.007 INFO:teuthology.orchestra.run.smithi186:> sudo apt-get clean 2020-11-20T11:30:38.127 INFO:teuthology.orchestra.run.smithi186:> sudo apt-get update 2020-11-20T11:30:38.279 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-11-20T11:30:38.404 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:30:38.484 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-11-20T11:30:38.523 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,426 kB] 2020-11-20T11:30:38.635 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [861 kB] 2020-11-20T11:30:38.649 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [967 kB] 2020-11-20T11:30:38.659 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,089 kB] 2020-11-20T11:30:38.669 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [243 kB] 2020-11-20T11:30:38.752 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-11-20T11:30:38.865 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,162 kB] 2020-11-20T11:30:39.208 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,761 kB] 2020-11-20T11:30:39.308 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [373 kB] 2020-11-20T11:30:39.325 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [196 kB] 2020-11-20T11:30:39.333 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [17.3 kB] 2020-11-20T11:30:39.334 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [26.3 kB] 2020-11-20T11:30:39.335 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,692 kB] 2020-11-20T11:30:39.380 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,547 kB] 2020-11-20T11:30:39.421 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [356 kB] 2020-11-20T11:30:39.438 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.4 kB] 2020-11-20T11:30:39.438 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [36.1 kB] 2020-11-20T11:30:39.439 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,308 B] 2020-11-20T11:30:40.269 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 12.0 MB in 2s (6,346 kB/s) 2020-11-20T11:30:41.678 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:30:41.724 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-20T11:30:41.800 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:30:42.033 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:30:42.034 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:30:42.112 INFO:teuthology.orchestra.run.smithi186.stderr:E: Unable to locate package linux-image-current-generic 2020-11-20T11:30:42.116 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-20T11:30:42.117 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-20T11:30:42.211 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:30:42.440 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:30:42.442 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:30:42.613 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2020-11-20T11:30:42.613 INFO:teuthology.orchestra.run.smithi186.stdout: linux-generic linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-20T11:30:42.614 INFO:teuthology.orchestra.run.smithi186.stdout: linux-headers-generic linux-image-4.15.0-124-generic 2020-11-20T11:30:42.614 INFO:teuthology.orchestra.run.smithi186.stdout: linux-modules-4.15.0-124-generic linux-modules-extra-4.15.0-124-generic 2020-11-20T11:30:42.615 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2020-11-20T11:30:42.617 INFO:teuthology.orchestra.run.smithi186.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2020-11-20T11:30:42.624 INFO:teuthology.orchestra.run.smithi186.stdout:Recommended packages: 2020-11-20T11:30:42.625 INFO:teuthology.orchestra.run.smithi186.stdout: thermald 2020-11-20T11:30:42.643 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2020-11-20T11:30:42.643 INFO:teuthology.orchestra.run.smithi186.stdout: linux-headers-4.15.0-124 linux-headers-4.15.0-124-generic 2020-11-20T11:30:42.644 INFO:teuthology.orchestra.run.smithi186.stdout: linux-image-4.15.0-124-generic linux-modules-4.15.0-124-generic 2020-11-20T11:30:42.645 INFO:teuthology.orchestra.run.smithi186.stdout: linux-modules-extra-4.15.0-124-generic 2020-11-20T11:30:42.645 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages will be upgraded: 2020-11-20T11:30:42.645 INFO:teuthology.orchestra.run.smithi186.stdout: linux-generic linux-headers-generic linux-image-generic 2020-11-20T11:30:42.824 INFO:teuthology.orchestra.run.smithi186.stdout:3 upgraded, 5 newly installed, 0 to remove and 22 not upgraded. 2020-11-20T11:30:42.824 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 65.9 MB of archives. 2020-11-20T11:30:42.825 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 333 MB of additional disk space will be used. 2020-11-20T11:30:42.825 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-124-generic amd64 4.15.0-124.127 [13.1 MB] 2020-11-20T11:30:43.834 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-124-generic amd64 4.15.0-124.127 [8,012 kB] 2020-11-20T11:30:44.080 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-124-generic amd64 4.15.0-124.127 [32.8 MB] 2020-11-20T11:30:45.031 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.124.111 [1,868 B] 2020-11-20T11:30:45.031 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.124.111 [2,624 B] 2020-11-20T11:30:45.031 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124 all 4.15.0-124.127 [10.9 MB] 2020-11-20T11:30:45.333 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-124-generic amd64 4.15.0-124.127 [1,084 kB] 2020-11-20T11:30:45.355 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.124.111 [2,520 B] 2020-11-20T11:30:45.880 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 65.9 MB in 3s (24.5 MB/s) 2020-11-20T11:30:46.037 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-modules-4.15.0-124-generic. 2020-11-20T11:30:46.077 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102077 files and directories currently installed.) 2020-11-20T11:30:46.080 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../0-linux-modules-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:46.121 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:47.713 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-image-4.15.0-124-generic. 2020-11-20T11:30:47.725 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../1-linux-image-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:47.814 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:48.341 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-124-generic. 2020-11-20T11:30:48.352 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:48.391 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:30:52.149 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../3-linux-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:30:52.287 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:30:52.610 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:30:52.739 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-image-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:30:53.081 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-headers-4.15.0-124. 2020-11-20T11:30:53.094 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../5-linux-headers-4.15.0-124_4.15.0-124.127_all.deb ... 2020-11-20T11:30:53.125 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-20T11:30:57.729 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package linux-headers-4.15.0-124-generic. 2020-11-20T11:30:58.163 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../6-linux-headers-4.15.0-124-generic_4.15.0-124.127_amd64.deb ... 2020-11-20T11:30:58.163 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:00.118 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.124.111_amd64.deb ... 2020-11-20T11:31:00.240 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking linux-headers-generic (4.15.0.124.111) over (4.15.0.123.110) ... 2020-11-20T11:31:00.584 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-modules-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:01.120 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:01.566 INFO:teuthology.orchestra.run.smithi186.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:31:01.566 INFO:teuthology.orchestra.run.smithi186.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-124-generic 2020-11-20T11:31:01.705 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-modules-extra-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:02.198 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-4.15.0-124 (4.15.0-124.127) ... 2020-11-20T11:31:02.341 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-image-generic (4.15.0.124.111) ... 2020-11-20T11:31:02.467 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:02.577 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-headers-generic (4.15.0.124.111) ... 2020-11-20T11:31:02.678 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up linux-generic (4.15.0.124.111) ... 2020-11-20T11:31:02.804 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for linux-image-4.15.0-124-generic (4.15.0-124.127) ... 2020-11-20T11:31:03.008 INFO:teuthology.orchestra.run.smithi186.stdout:/etc/kernel/postinst.d/initramfs-tools: 2020-11-20T11:31:03.008 INFO:teuthology.orchestra.run.smithi186.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:31:17.647 INFO:teuthology.orchestra.run.smithi186.stdout:/etc/kernel/postinst.d/zz-update-grub: 2020-11-20T11:31:17.647 INFO:teuthology.orchestra.run.smithi186.stdout:Sourcing file `/etc/default/grub' 2020-11-20T11:31:17.677 INFO:teuthology.orchestra.run.smithi186.stdout:Generating grub configuration file ... 2020-11-20T11:31:18.029 INFO:teuthology.orchestra.run.smithi186.stdout:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:31:18.068 INFO:teuthology.orchestra.run.smithi186.stdout:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:31:18.425 INFO:teuthology.orchestra.run.smithi186.stdout:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-20T11:31:18.460 INFO:teuthology.orchestra.run.smithi186.stdout:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-20T11:31:20.132 INFO:teuthology.orchestra.run.smithi186.stdout:done 2020-11-20T11:31:20.567 INFO:teuthology.orchestra.run.smithi186:> dpkg -s linux-image-generic 2020-11-20T11:31:20.590 INFO:teuthology.orchestra.run.smithi186.stdout:Package: linux-image-generic 2020-11-20T11:31:20.590 INFO:teuthology.orchestra.run.smithi186.stdout:Status: install ok installed 2020-11-20T11:31:20.590 INFO:teuthology.orchestra.run.smithi186.stdout:Priority: optional 2020-11-20T11:31:20.591 INFO:teuthology.orchestra.run.smithi186.stdout:Section: kernel 2020-11-20T11:31:20.591 INFO:teuthology.orchestra.run.smithi186.stdout:Installed-Size: 16 2020-11-20T11:31:20.591 INFO:teuthology.orchestra.run.smithi186.stdout:Maintainer: Ubuntu Kernel Team 2020-11-20T11:31:20.591 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: amd64 2020-11-20T11:31:20.591 INFO:teuthology.orchestra.run.smithi186.stdout:Source: linux-meta 2020-11-20T11:31:20.592 INFO:teuthology.orchestra.run.smithi186.stdout:Version: 4.15.0.124.111 2020-11-20T11:31:20.592 INFO:teuthology.orchestra.run.smithi186.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-20T11:31:20.592 INFO:teuthology.orchestra.run.smithi186.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-20T11:31:20.592 INFO:teuthology.orchestra.run.smithi186.stdout:Recommends: thermald 2020-11-20T11:31:20.593 INFO:teuthology.orchestra.run.smithi186.stdout:Description: Generic Linux kernel image 2020-11-20T11:31:20.593 INFO:teuthology.orchestra.run.smithi186.stdout: This package will always depend on the latest generic kernel image 2020-11-20T11:31:20.593 INFO:teuthology.orchestra.run.smithi186.stdout: available. 2020-11-20T11:31:20.593 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-123-generic Expected: 4.15.0-124-generic 2020-11-20T11:31:20.594 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-11-20T11:31:20.594 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-20T11:31:20.594 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-11-20T11:31:20.594 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-11-20T11:31:20.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2020-11-20T11:31:20.595 INFO:teuthology.orchestra.run.smithi161:> sudo apt-get clean 2020-11-20T11:31:20.674 INFO:teuthology.orchestra.run.smithi161:> sudo apt-get update 2020-11-20T11:31:20.924 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:31:20.925 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-20T11:31:20.992 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-20T11:31:21.072 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-20T11:31:22.765 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:31:22.818 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-20T11:31:22.945 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:31:23.178 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:31:23.178 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:31:23.258 INFO:teuthology.orchestra.run.smithi161.stderr:E: Unable to locate package linux-image-current-generic 2020-11-20T11:31:23.259 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-20T11:31:23.260 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-20T11:31:23.337 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:31:23.565 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:31:23.566 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:31:23.762 INFO:teuthology.orchestra.run.smithi161.stdout:linux-image-generic is already the newest version (4.15.0.124.111). 2020-11-20T11:31:23.762 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 0 newly installed, 0 to remove and 22 not upgraded. 2020-11-20T11:31:23.764 INFO:teuthology.orchestra.run.smithi161:> dpkg -s linux-image-generic 2020-11-20T11:31:23.780 INFO:teuthology.orchestra.run.smithi161.stdout:Package: linux-image-generic 2020-11-20T11:31:23.780 INFO:teuthology.orchestra.run.smithi161.stdout:Status: install ok installed 2020-11-20T11:31:23.780 INFO:teuthology.orchestra.run.smithi161.stdout:Priority: optional 2020-11-20T11:31:23.781 INFO:teuthology.orchestra.run.smithi161.stdout:Section: kernel 2020-11-20T11:31:23.781 INFO:teuthology.orchestra.run.smithi161.stdout:Installed-Size: 16 2020-11-20T11:31:23.781 INFO:teuthology.orchestra.run.smithi161.stdout:Maintainer: Ubuntu Kernel Team 2020-11-20T11:31:23.781 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: amd64 2020-11-20T11:31:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:Source: linux-meta 2020-11-20T11:31:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:Version: 4.15.0.124.111 2020-11-20T11:31:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-20T11:31:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-20T11:31:23.782 INFO:teuthology.orchestra.run.smithi161.stdout:Recommends: thermald 2020-11-20T11:31:23.783 INFO:teuthology.orchestra.run.smithi161.stdout:Description: Generic Linux kernel image 2020-11-20T11:31:23.783 INFO:teuthology.orchestra.run.smithi161.stdout: This package will always depend on the latest generic kernel image 2020-11-20T11:31:23.783 INFO:teuthology.orchestra.run.smithi161.stdout: available. 2020-11-20T11:31:23.783 INFO:teuthology.orchestra.run.smithi161:> mktemp 2020-11-20T11:31:23.828 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.SABzXQajcA 2020-11-20T11:31:23.829 INFO:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SABzXQajcA 2020-11-20T11:31:23.885 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.SABzXQajcA 2020-11-20T11:31:24.003 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.SABzXQajcA is 8KB 2020-11-20T11:31:24.055 INFO:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.SABzXQajcA 2020-11-20T11:31:24.062 INFO:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:24.119 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:31:24.119 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-20T11:31:24.119 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:24.163 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-20T11:31:24.179 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:31:24.180 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:31:24.180 INFO:teuthology.orchestra.run.smithi161.stderr:93 bytes copied, 3.2445e-05 s, 2.9 MB/s 2020-11-20T11:31:24.181 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:24.190 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-124-generic 2020-11-20T11:31:24.190 INFO:teuthology.orchestra.run.smithi161:> sudo update-grub 2020-11-20T11:31:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2020-11-20T11:31:25.433 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2020-11-20T11:31:25.669 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:31:25.683 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:31:25.977 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-20T11:31:25.990 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-20T11:31:27.201 INFO:teuthology.orchestra.run.smithi161.stderr:done 2020-11-20T11:31:27.201 INFO:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2020-11-20T11:31:27.205 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2020-11-20T11:31:27.205 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2020-11-20T11:31:27.206 INFO:teuthology.orchestra.run.smithi186:> sudo apt-get clean 2020-11-20T11:31:27.259 INFO:teuthology.orchestra.run.smithi186:> sudo apt-get update 2020-11-20T11:31:27.507 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-20T11:31:27.508 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:31:27.581 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-20T11:31:27.662 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-20T11:31:29.338 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:31:29.383 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-11-20T11:31:29.505 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:31:29.746 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:31:29.747 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:31:29.825 INFO:teuthology.orchestra.run.smithi186.stderr:E: Unable to locate package linux-image-current-generic 2020-11-20T11:31:29.827 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-11-20T11:31:29.827 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-11-20T11:31:29.911 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:31:30.168 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:31:30.169 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:31:30.372 INFO:teuthology.orchestra.run.smithi186.stdout:linux-image-generic is already the newest version (4.15.0.124.111). 2020-11-20T11:31:30.372 INFO:teuthology.orchestra.run.smithi186.stdout:0 upgraded, 0 newly installed, 0 to remove and 22 not upgraded. 2020-11-20T11:31:30.374 INFO:teuthology.orchestra.run.smithi186:> dpkg -s linux-image-generic 2020-11-20T11:31:30.396 INFO:teuthology.orchestra.run.smithi186.stdout:Package: linux-image-generic 2020-11-20T11:31:30.397 INFO:teuthology.orchestra.run.smithi186.stdout:Status: install ok installed 2020-11-20T11:31:30.397 INFO:teuthology.orchestra.run.smithi186.stdout:Priority: optional 2020-11-20T11:31:30.397 INFO:teuthology.orchestra.run.smithi186.stdout:Section: kernel 2020-11-20T11:31:30.397 INFO:teuthology.orchestra.run.smithi186.stdout:Installed-Size: 16 2020-11-20T11:31:30.398 INFO:teuthology.orchestra.run.smithi186.stdout:Maintainer: Ubuntu Kernel Team 2020-11-20T11:31:30.398 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: amd64 2020-11-20T11:31:30.398 INFO:teuthology.orchestra.run.smithi186.stdout:Source: linux-meta 2020-11-20T11:31:30.398 INFO:teuthology.orchestra.run.smithi186.stdout:Version: 4.15.0.124.111 2020-11-20T11:31:30.398 INFO:teuthology.orchestra.run.smithi186.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-11-20T11:31:30.399 INFO:teuthology.orchestra.run.smithi186.stdout:Depends: linux-image-4.15.0-124-generic, linux-modules-extra-4.15.0-124-generic, linux-firmware, intel-microcode, amd64-microcode 2020-11-20T11:31:30.399 INFO:teuthology.orchestra.run.smithi186.stdout:Recommends: thermald 2020-11-20T11:31:30.399 INFO:teuthology.orchestra.run.smithi186.stdout:Description: Generic Linux kernel image 2020-11-20T11:31:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: This package will always depend on the latest generic kernel image 2020-11-20T11:31:30.399 INFO:teuthology.orchestra.run.smithi186.stdout: available. 2020-11-20T11:31:30.400 INFO:teuthology.orchestra.run.smithi186:> mktemp 2020-11-20T11:31:30.463 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.TEJIgp0GjI 2020-11-20T11:31:30.464 INFO:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TEJIgp0GjI 2020-11-20T11:31:30.540 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.TEJIgp0GjI 2020-11-20T11:31:30.699 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.TEJIgp0GjI is 8KB 2020-11-20T11:31:30.740 INFO:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.TEJIgp0GjI 2020-11-20T11:31:30.753 INFO:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:30.815 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:31:30.815 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-20T11:31:30.816 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:30.868 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/etc/grub.d/01_ceph_kernel 2020-11-20T11:31:30.891 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:31:30.892 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:31:30.892 INFO:teuthology.orchestra.run.smithi186.stderr:93 bytes copied, 3.3034e-05 s, 2.8 MB/s 2020-11-20T11:31:30.893 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo chmod 755 /etc/grub.d/01_ceph_kernel 2020-11-20T11:31:30.902 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-124-generic 2020-11-20T11:31:30.903 INFO:teuthology.orchestra.run.smithi186:> sudo update-grub 2020-11-20T11:31:32.279 INFO:teuthology.orchestra.run.smithi186.stderr:Sourcing file `/etc/default/grub' 2020-11-20T11:31:32.299 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2020-11-20T11:31:32.522 INFO:teuthology.orchestra.run.smithi186.stderr:Found linux image: /boot/vmlinuz-4.15.0-124-generic 2020-11-20T11:31:32.534 INFO:teuthology.orchestra.run.smithi186.stderr:Found initrd image: /boot/initrd.img-4.15.0-124-generic 2020-11-20T11:31:32.850 INFO:teuthology.orchestra.run.smithi186.stderr:Found linux image: /boot/vmlinuz-4.15.0-123-generic 2020-11-20T11:31:33.128 INFO:teuthology.orchestra.run.smithi186.stderr:Found initrd image: /boot/initrd.img-4.15.0-123-generic 2020-11-20T11:31:34.013 INFO:teuthology.orchestra.run.smithi186.stderr:done 2020-11-20T11:31:34.015 INFO:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2020-11-20T11:32:04.049 INFO:teuthology.misc:Re-opening connections... 2020-11-20T11:32:04.050 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:32:04.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:32:04.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:32:22.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2020-11-20T11:32:22.390 INFO:teuthology.misc:trying to connect to ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:32:22.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:32:22.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:32:40.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2020-11-20T11:32:40.822 DEBUG:teuthology.misc:waited 36.77194118499756 2020-11-20T11:32:41.822 INFO:teuthology.misc:trying to connect to ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:32:41.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:32:41.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:33:13.417 INFO:teuthology.orchestra.run.smithi161:> true 2020-11-20T11:33:13.748 DEBUG:teuthology.misc:waited 69.69831347465515 2020-11-20T11:33:14.749 INFO:teuthology.misc:trying to connect to ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:33:14.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:33:14.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:33:30.306 INFO:teuthology.orchestra.run.smithi186:> true 2020-11-20T11:33:30.662 DEBUG:teuthology.misc:waited 86.61214709281921 2020-11-20T11:33:31.663 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-11-20T11:33:31.664 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.15.0-124-generic"... 2020-11-20T11:33:31.664 INFO:teuthology.orchestra.run.smithi161:> uname -r 2020-11-20T11:33:31.671 INFO:teuthology.orchestra.run.smithi161.stdout:4.15.0-124-generic 2020-11-20T11:33:31.671 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-124-generic vs 4.15.0-124-generic 2020-11-20T11:33:31.672 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-20T11:33:31.672 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-20T11:33:31.672 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2020-11-20T11:33:31.673 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.15.0-124-generic"... 2020-11-20T11:33:31.673 INFO:teuthology.orchestra.run.smithi186:> uname -r 2020-11-20T11:33:31.679 INFO:teuthology.orchestra.run.smithi186.stdout:4.15.0-124-generic 2020-11-20T11:33:31.679 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-124-generic vs 4.15.0-124-generic 2020-11-20T11:33:31.680 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-20T11:33:31.680 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2020-11-20T11:33:32.681 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-11-20T11:33:32.681 INFO:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:33:32.885 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2020-11-20T11:33:32.900 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-11-20T11:33:32.900 INFO:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-11-20T11:33:32.945 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2020-11-20T11:33:32.967 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T11:33:32.981 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T11:33:32.981 INFO:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:33:32.985 INFO:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T11:33:33.026 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T11:33:33.036 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T11:33:33.125 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T11:33:33.126 INFO:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:33:33.128 INFO:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T11:33:33.145 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T11:33:33.154 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T11:33:33.154 INFO:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:33:33.187 INFO:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T11:33:33.204 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:33:33.211 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:33:33.214 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:33:33.221 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T11:33:33.223 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T11:33:33.230 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T11:33:33.231 INFO:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:33:33.256 INFO:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T11:33:33.280 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T11:33:33.290 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T11:33:33.290 INFO:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:33:33.311 INFO:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T11:33:33.326 INFO:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:33:33.364 INFO:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:33:33.412 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:33:33.412 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:33:33.458 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:33:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:33:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:33:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:152 bytes copied, 3.1648e-05 s, 4.8 MB/s 2020-11-20T11:33:33.494 INFO:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T11:33:33.501 INFO:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T11:33:33.551 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:33:33.551 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:33:33.597 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T11:33:33.614 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:33:33.615 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:33:33.615 INFO:teuthology.orchestra.run.smithi186.stderr:152 bytes copied, 3.6122e-05 s, 4.2 MB/s 2020-11-20T11:33:33.616 INFO:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2020-11-20T11:33:33.618 INFO:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2020-11-20T11:33:33.704 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T11:33:33.714 INFO:teuthology.task.internal:Starting timer... 2020-11-20T11:33:33.715 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T11:33:33.785 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T11:33:33.799 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2020-11-20T11:33:33.799 DEBUG:teuthology.task.selinux:Excluding smithi186: OS 'ubuntu' does not support SELinux 2020-11-20T11:33:33.800 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T11:33:33.800 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-11-20T11:33:33.800 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T11:33:33.801 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T11:33:33.813 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T11:33:33.814 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T11:33:33.830 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T11:33:33.831 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi161.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T11:33:34.153 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T11:33:35.089 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T11:33:37.601 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T11:33:37.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:37 +0000 (0:00:00.068) 0:00:00.068 ******* 2020-11-20T11:33:37.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:37 +0000 (0:00:00.013) 0:00:00.082 ******* 2020-11-20T11:33:39.222 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi161.front.sepia.ceph.com] 2020-11-20T11:33:39.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:39 +0000 (0:00:01.661) 0:00:01.743 ******* 2020-11-20T11:33:39.314 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] 2020-11-20T11:33:39.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:39 +0000 (0:00:00.092) 0:00:01.836 ******* 2020-11-20T11:33:39.528 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T11:33:39.530 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:33:39.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:39 +0000 (0:00:00.176) 0:00:02.013 ******* 2020-11-20T11:33:39.596 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:39 +0000 (0:00:00.032) 0:00:02.045 ******* 2020-11-20T11:33:39.975 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T11:33:39.976 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:33:40.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.416) 0:00:02.461 ******* 2020-11-20T11:33:40.040 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T11:33:40.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.063) 0:00:02.525 ******* 2020-11-20T11:33:40.350 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.078329", "end": "2020-11-20 11:33:40.345896", "rc": 0, "start": "2020-11-20 11:33:40.267567", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-20T11:33:40.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.309) 0:00:02.834 ******* 2020-11-20T11:33:40.392 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.092819", "end": "2020-11-20 11:33:40.646630", "rc": 0, "start": "2020-11-20 11:33:40.553811", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-11-20T11:33:40.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.044) 0:00:02.879 ******* 2020-11-20T11:33:40.613 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T11:33:40.614 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:33:40.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.216) 0:00:03.096 ******* 2020-11-20T11:33:40.654 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:33:40.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:40 +0000 (0:00:00.044) 0:00:03.141 ******* 2020-11-20T11:33:41.278 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872020.660437-196104231163246/source", "state": "file", "uid": 0} 2020-11-20T11:33:41.279 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872020.7071562-232258334089579/source", "state": "file", "uid": 0} 2020-11-20T11:33:41.320 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:41 +0000 (0:00:00.628) 0:00:03.769 ******* 2020-11-20T11:33:41.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:41 +0000 (0:00:00.034) 0:00:03.804 ******* 2020-11-20T11:33:41.622 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T11:33:41.624 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T11:33:41.625 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-11-20T11:33:41.627 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-11-20T11:33:41.629 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T11:33:41.764 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T11:33:41.771 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T11:33:41.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:41 +0000 (0:00:00.567) 0:00:04.371 ******* 2020-11-20T11:33:41.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:41 +0000 (0:00:00.033) 0:00:04.404 ******* 2020-11-20T11:33:42.588 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi161.front.sepia.ceph.com] 2020-11-20T11:33:42.669 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T11:33:42.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:42 +0000 (0:00:00.713) 0:00:05.118 ******* 2020-11-20T11:33:42.680 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] 2020-11-20T11:33:42.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:42 +0000 (0:00:00.092) 0:00:05.210 ******* 2020-11-20T11:33:43.034 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T11:33:43.036 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.182533", "end": "2020-11-20 11:33:43.011204", "rc": 0, "start": "2020-11-20 11:33:42.828671", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:33:43.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.307) 0:00:05.517 ******* 2020-11-20T11:33:43.096 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.148956", "end": "2020-11-20 11:33:43.072250", "rc": 0, "start": "2020-11-20 11:33:42.923294", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:33:43.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.064) 0:00:05.582 ******* 2020-11-20T11:33:43.212 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T11:33:43.213 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015394", "end": "2020-11-20 11:33:43.490505", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:33:43.475111", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:33:43.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.116) 0:00:05.698 ******* 2020-11-20T11:33:43.278 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.018959", "end": "2020-11-20 11:33:43.271443", "failed_when_result": false, "rc": 0, "start": "2020-11-20 11:33:43.252484", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T11:33:43.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.064) 0:00:05.763 ******* 2020-11-20T11:33:43.320 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T11:33:43.321 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:33:43.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:05.805 ******* 2020-11-20T11:33:43.364 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T11:33:43.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:05.848 ******* 2020-11-20T11:33:43.406 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T11:33:43.408 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.443 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.043) 0:00:05.892 ******* 2020-11-20T11:33:43.450 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.487 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.043) 0:00:05.935 ******* 2020-11-20T11:33:43.493 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T11:33:43.494 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.043) 0:00:05.978 ******* 2020-11-20T11:33:43.537 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:06.021 ******* 2020-11-20T11:33:43.579 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T11:33:43.580 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.041) 0:00:06.063 ******* 2020-11-20T11:33:43.621 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.045) 0:00:06.109 ******* 2020-11-20T11:33:43.666 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-20T11:33:43.668 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.702 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:06.151 ******* 2020-11-20T11:33:43.710 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.745 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:06.194 ******* 2020-11-20T11:33:43.751 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-20T11:33:43.752 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.041) 0:00:06.235 ******* 2020-11-20T11:33:43.793 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:43 +0000 (0:00:00.042) 0:00:06.278 ******* 2020-11-20T11:33:43.836 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T11:33:43.838 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.848 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.850 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.861 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.863 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.872 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.874 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.885 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.886 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n 2020-11-20T11:33:43.888 INFO:teuthology.task.ansible.out:dmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.899 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L 2020-11-20T11:33:43.900 INFO:teuthology.task.ansible.out:6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn 2020-11-20T11:33:43.902 INFO:teuthology.task.ansible.out:": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.911 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.912 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.923 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.925 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubun 2020-11-20T11:33:43.926 INFO:teuthology.task.ansible.out:tu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.935 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.937 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'al 2020-11-20T11:33:43.939 INFO:teuthology.task.ansible.out:i@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.948 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.950 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f23 2020-11-20T11:33:43.951 INFO:teuthology.task.ansible.out:7baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.960 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.962 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin 2020-11-20T11:33:43.964 INFO:teuthology.task.ansible.out:@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.973 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.975 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.975 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", 2020-11-20T11:33:43.977 INFO:teuthology.task.ansible.out:"changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.986 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.988 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:43.998 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.000 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.010 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.011 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.012 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.013 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db9799 2020-11-20T11:33:44.014 INFO:teuthology.task.ansible.out:7a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.024 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.025 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.036 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.038 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.049 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.052 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c 2020-11-20T11:33:44.057 INFO:teuthology.task.ansible.out:94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Condition 2020-11-20T11:33:44.060 INFO:teuthology.task.ansible.out:al result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.069 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.071 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.082 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.084 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.095 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.097 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.099 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.110 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.159 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smoh 2020-11-20T11:33:44.161 INFO:teuthology.task.ansible.out:an", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7E 2020-11-20T11:33:44.163 INFO:teuthology.task.ansible.out:PBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be 2020-11-20T11:33:44.165 INFO:teuthology.task.ansible.out:1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional r 2020-11-20T11:33:44.168 INFO:teuthology.task.ansible.out:esult was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.173 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.174 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.186 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.187 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.198 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.199 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.211 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.212 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.212 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.212 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.223 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.235 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.237 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.247 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.249 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.260 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.262 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.273 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.274 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.285 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.287 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.298 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.300 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.301 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.312 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.314 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.324 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.326 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.338 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.339 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.340 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.352 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.353 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.355 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.356 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.367 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.369 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.380 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.381 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.382 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.394 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.395 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.396 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.407 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.409 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.409 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.420 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.422 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.433 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.434 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.436 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.447 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.449 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.449 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.450 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.451 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVy 2020-11-20T11:33:44.453 INFO:teuthology.task.ansible.out:h6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.462 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.464 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.465 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.479 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.481 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.481 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.493 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.495 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.496 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.497 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.498 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.510 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.511 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.513 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.513 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.529 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.531 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.532 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.533 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.534 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.535 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.537 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.547 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.548 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.550 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.551 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.561 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.563 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.573 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.575 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.585 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.587 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.598 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.600 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.600 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.601 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansib 2020-11-20T11:33:44.602 INFO:teuthology.task.ansible.out:le_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.611 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.613 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.623 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.625 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.625 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_ 2020-11-20T11:33:44.627 INFO:teuthology.task.ansible.out:var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.637 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.638 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.656 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.657 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.877) 0:00:07.156 ******* 2020-11-20T11:33:44.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.033) 0:00:07.189 ******* 2020-11-20T11:33:44.747 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T11:33:44.783 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.042) 0:00:07.232 ******* 2020-11-20T11:33:44.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.042) 0:00:07.274 ******* 2020-11-20T11:33:44.831 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-11-20T11:33:44.833 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.045) 0:00:07.320 ******* 2020-11-20T11:33:44.878 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.920 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.049) 0:00:07.369 ******* 2020-11-20T11:33:44.926 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T11:33:44.928 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:44.962 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:44 +0000 (0:00:00.041) 0:00:07.411 ******* 2020-11-20T11:33:44.970 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.044) 0:00:07.455 ******* 2020-11-20T11:33:45.012 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T11:33:45.015 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.042) 0:00:07.497 ******* 2020-11-20T11:33:45.055 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.091 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.042) 0:00:07.539 ******* 2020-11-20T11:33:45.097 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T11:33:45.098 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.041) 0:00:07.581 ******* 2020-11-20T11:33:45.139 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.041) 0:00:07.622 ******* 2020-11-20T11:33:45.179 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T11:33:45.181 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.041) 0:00:07.664 ******* 2020-11-20T11:33:45.222 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.259 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.043) 0:00:07.707 ******* 2020-11-20T11:33:45.266 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T11:33:45.268 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.268 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.279 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.281 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.291 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.292 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.302 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.304 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.315 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.326 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.328 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.338 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.340 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.350 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.351 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.361 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.363 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.374 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.375 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.387 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.388 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.398 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.400 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.410 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.413 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.413 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.414 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.414 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.425 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.427 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.437 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.439 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.449 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.451 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.462 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.463 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.474 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.475 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.479 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.516 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.256) 0:00:07.964 ******* 2020-11-20T11:33:45.522 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.524 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.525 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.525 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.527 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.537 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.538 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:45.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:45 +0000 (0:00:00.061) 0:00:08.026 ******* 2020-11-20T11:33:46.099 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T11:33:46.101 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:33:46.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.557) 0:00:08.583 ******* 2020-11-20T11:33:46.142 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2020-11-20T11:33:46.177 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:08.625 ******* 2020-11-20T11:33:46.183 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T11:33:46.185 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => { "msg": "Host smithi161.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-20T11:33:46.220 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:08.668 ******* 2020-11-20T11:33:46.226 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => { "msg": "Host smithi186.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-11-20T11:33:46.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.041) 0:00:08.710 ******* 2020-11-20T11:33:46.267 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T11:33:46.269 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-20T11:33:46.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:08.753 ******* 2020-11-20T11:33:46.310 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-11-20T11:33:46.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.041) 0:00:08.794 ******* 2020-11-20T11:33:46.351 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T11:33:46.353 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.041) 0:00:08.835 ******* 2020-11-20T11:33:46.393 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.040) 0:00:08.876 ******* 2020-11-20T11:33:46.434 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T11:33:46.436 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.469 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.040) 0:00:08.917 ******* 2020-11-20T11:33:46.474 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.040) 0:00:08.957 ******* 2020-11-20T11:33:46.515 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T11:33:46.517 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.041) 0:00:08.999 ******* 2020-11-20T11:33:46.557 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.591 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.039) 0:00:09.039 ******* 2020-11-20T11:33:46.596 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T11:33:46.598 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.630 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.039) 0:00:09.078 ******* 2020-11-20T11:33:46.641 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.043) 0:00:09.122 ******* 2020-11-20T11:33:46.680 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T11:33:46.682 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:09.165 ******* 2020-11-20T11:33:46.723 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.043) 0:00:09.208 ******* 2020-11-20T11:33:46.766 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T11:33:46.768 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:09.250 ******* 2020-11-20T11:33:46.809 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:09.293 ******* 2020-11-20T11:33:46.851 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T11:33:46.852 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.887 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.042) 0:00:09.335 ******* 2020-11-20T11:33:46.893 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.928 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.040) 0:00:09.376 ******* 2020-11-20T11:33:46.934 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T11:33:46.936 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:46.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:46 +0000 (0:00:00.040) 0:00:09.417 ******* 2020-11-20T11:33:46.975 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.012 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.044) 0:00:09.461 ******* 2020-11-20T11:33:47.018 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T11:33:47.020 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.042) 0:00:09.504 ******* 2020-11-20T11:33:47.062 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.064 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.042) 0:00:09.546 ******* 2020-11-20T11:33:47.104 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T11:33:47.106 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.141 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.043) 0:00:09.590 ******* 2020-11-20T11:33:47.148 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:09.631 ******* 2020-11-20T11:33:47.188 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T11:33:47.190 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.044) 0:00:09.675 ******* 2020-11-20T11:33:47.233 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.268 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:09.716 ******* 2020-11-20T11:33:47.274 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T11:33:47.276 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.311 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.043) 0:00:09.760 ******* 2020-11-20T11:33:47.318 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.043) 0:00:09.803 ******* 2020-11-20T11:33:47.361 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T11:33:47.362 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.397 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.042) 0:00:09.845 ******* 2020-11-20T11:33:47.403 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:09.887 ******* 2020-11-20T11:33:47.444 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T11:33:47.446 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:09.928 ******* 2020-11-20T11:33:47.486 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:09.970 ******* 2020-11-20T11:33:47.527 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T11:33:47.529 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.011 ******* 2020-11-20T11:33:47.569 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.042) 0:00:10.053 ******* 2020-11-20T11:33:47.610 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T11:33:47.612 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.646 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.095 ******* 2020-11-20T11:33:47.653 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.689 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.042) 0:00:10.137 ******* 2020-11-20T11:33:47.695 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T11:33:47.696 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.179 ******* 2020-11-20T11:33:47.736 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.220 ******* 2020-11-20T11:33:47.777 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T11:33:47.779 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.813 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.261 ******* 2020-11-20T11:33:47.826 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.861 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.047) 0:00:10.309 ******* 2020-11-20T11:33:47.867 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T11:33:47.869 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.043) 0:00:10.353 ******* 2020-11-20T11:33:47.911 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:47.946 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.394 ******* 2020-11-20T11:33:47.951 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:33:47.953 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:47.988 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:47 +0000 (0:00:00.041) 0:00:10.436 ******* 2020-11-20T11:33:47.994 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.042) 0:00:10.478 ******* 2020-11-20T11:33:48.036 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T11:33:48.038 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.041) 0:00:10.520 ******* 2020-11-20T11:33:48.079 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.043) 0:00:10.564 ******* 2020-11-20T11:33:48.123 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T11:33:48.124 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.158 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.043) 0:00:10.607 ******* 2020-11-20T11:33:48.287 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:33:48 +0000 (0:00:00.043) 0:00:10.650 ******* TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:33:48 +0000 (0:00:00.041) 0:00:10.692 ******* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:33:48 +0000 (0:00:00.042) 0:00:10.734 ******* 2020-11-20T11:33:48.292 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T11:33:48.294 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.329 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.042) 0:00:10.777 ******* 2020-11-20T11:33:48.335 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.046) 0:00:10.824 ******* 2020-11-20T11:33:48.382 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.052) 0:00:10.876 ******* 2020-11-20T11:33:48.444 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.057) 0:00:10.934 ******* 2020-11-20T11:33:48.493 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T11:33:48.495 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:48.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.044) 0:00:10.979 ******* 2020-11-20T11:33:48.537 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:48.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.054) 0:00:11.033 ******* 2020-11-20T11:33:48.591 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T11:33:48.595 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.645 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.059) 0:00:11.092 ******* 2020-11-20T11:33:48.654 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.700 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.056) 0:00:11.149 ******* 2020-11-20T11:33:48.706 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T11:33:48.709 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.046) 0:00:11.196 ******* 2020-11-20T11:33:48.754 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.046) 0:00:11.242 ******* 2020-11-20T11:33:48.801 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T11:33:48.803 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.042) 0:00:11.285 ******* 2020-11-20T11:33:48.843 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.044) 0:00:11.330 ******* 2020-11-20T11:33:48.887 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T11:33:48.889 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.045) 0:00:11.375 ******* 2020-11-20T11:33:48.934 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.935 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:48.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:48 +0000 (0:00:00.045) 0:00:11.420 ******* 2020-11-20T11:33:48.978 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T11:33:48.980 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.017 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.045) 0:00:11.465 ******* 2020-11-20T11:33:49.023 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.025 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.043) 0:00:11.509 ******* 2020-11-20T11:33:49.066 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T11:33:49.068 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.103 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:11.551 ******* 2020-11-20T11:33:49.116 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.048) 0:00:11.599 ******* 2020-11-20T11:33:49.262 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:33:49.264 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010612", "end": "2020-11-20 11:33:49.526556", "rc": 0, "start": "2020-11-20 11:33:49.515944", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:33:49.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.148) 0:00:11.748 ******* 2020-11-20T11:33:49.316 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.008673", "end": "2020-11-20 11:33:49.298660", "rc": 0, "start": "2020-11-20 11:33:49.289987", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T11:33:49.352 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.052) 0:00:11.800 ******* 2020-11-20T11:33:49.358 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T11:33:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.063) 0:00:11.864 ******* 2020-11-20T11:33:49.423 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.046) 0:00:11.911 ******* 2020-11-20T11:33:49.471 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T11:33:49.473 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.047) 0:00:11.958 ******* 2020-11-20T11:33:49.517 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:12.001 ******* 2020-11-20T11:33:49.559 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T11:33:49.560 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:12.044 ******* 2020-11-20T11:33:49.602 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:12.086 ******* 2020-11-20T11:33:49.643 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T11:33:49.645 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.041) 0:00:12.127 ******* 2020-11-20T11:33:49.686 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.722 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:12.170 ******* 2020-11-20T11:33:49.728 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T11:33:49.729 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.041) 0:00:12.212 ******* 2020-11-20T11:33:49.770 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.046) 0:00:12.259 ******* 2020-11-20T11:33:49.816 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T11:33:49.818 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.853 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.043) 0:00:12.302 ******* 2020-11-20T11:33:49.860 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.895 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.042) 0:00:12.344 ******* 2020-11-20T11:33:49.901 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T11:33:49.903 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.041) 0:00:12.385 ******* 2020-11-20T11:33:49.944 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:49.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:49 +0000 (0:00:00.044) 0:00:12.430 ******* 2020-11-20T11:33:50.232 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:33:50.234 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.163484", "end": "2020-11-20 11:33:50.500425", "rc": 0, "start": "2020-11-20 11:33:50.336941", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:33:50.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.290) 0:00:12.720 ******* 2020-11-20T11:33:50.299 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:50.335 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.063) 0:00:12.783 ******* 2020-11-20T11:33:50.489 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T11:33:50.491 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.027374", "end": "2020-11-20 11:33:50.758329", "rc": 0, "start": "2020-11-20 11:33:50.730955", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:33:50.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.193) 0:00:12.976 ******* 2020-11-20T11:33:50.535 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T11:33:50.536 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.395281", "end": "2020-11-20 11:33:50.500340", "rc": 0, "start": "2020-11-20 11:33:50.105059", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:33:50.575 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.047) 0:00:13.024 ******* 2020-11-20T11:33:50.603 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T11:33:50.605 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:50.642 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.065) 0:00:13.090 ******* 2020-11-20T11:33:50.798 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.022159", "end": "2020-11-20 11:33:50.786986", "rc": 0, "start": "2020-11-20 11:33:50.764827", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:33:50.834 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:50 +0000 (0:00:00.192) 0:00:13.282 ******* 2020-11-20T11:33:54.166 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi186.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:33:54.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:54 +0000 (0:00:03.367) 0:00:16.650 ******* 2020-11-20T11:33:54.294 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:33:54.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:54 +0000 (0:00:00.144) 0:00:16.794 ******* 2020-11-20T11:33:55.136 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T11:33:55.139 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:33:55.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.829) 0:00:17.623 ******* 2020-11-20T11:33:55.193 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:33:55.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.052) 0:00:17.676 ******* 2020-11-20T11:33:55.234 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T11:33:55.236 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:55.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.043) 0:00:17.719 ******* 2020-11-20T11:33:55.278 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:55.316 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.045) 0:00:17.764 ******* 2020-11-20T11:33:55.689 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T11:33:55.691 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:33:55.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.410) 0:00:18.175 ******* 2020-11-20T11:33:55.745 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-11-20T11:33:55.782 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:55 +0000 (0:00:00.055) 0:00:18.230 ******* 2020-11-20T11:33:56.586 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T11:33:56.588 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:33:56.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:56 +0000 (0:00:00.841) 0:00:19.072 ******* 2020-11-20T11:33:56.671 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:33:56.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:56 +0000 (0:00:00.083) 0:00:19.155 ******* 2020-11-20T11:33:56.964 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T11:33:56.966 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:33:57.029 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T11:33:57.254 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:33:57.318 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T11:33:57.529 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:33:57.568 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:57 +0000 (0:00:00.860) 0:00:20.016 ******* 2020-11-20T11:33:57.606 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-11-20T11:33:57.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:57 +0000 (0:00:00.079) 0:00:20.096 ******* 2020-11-20T11:33:57.686 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T11:33:57.688 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:33:57.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:57 +0000 (0:00:00.078) 0:00:20.174 ******* 2020-11-20T11:33:57.765 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:33:57.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:57 +0000 (0:00:00.084) 0:00:20.258 ******* 2020-11-20T11:33:58.104 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T11:33:58.106 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:33:58.178 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-11-20T11:33:58.369 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:33:58.434 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-11-20T11:33:58.646 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:33:58.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.882) 0:00:21.141 ******* 2020-11-20T11:33:58.702 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-11-20T11:33:58.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.056) 0:00:21.197 ******* 2020-11-20T11:33:58.757 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T11:33:58.759 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-11-20T11:33:58.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.048) 0:00:21.246 ******* 2020-11-20T11:33:58.804 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-11-20T11:33:58.842 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.044) 0:00:21.290 ******* 2020-11-20T11:33:58.849 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T11:33:58.850 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:58.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.049) 0:00:21.340 ******* 2020-11-20T11:33:58.897 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:58.936 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.045) 0:00:21.385 ******* 2020-11-20T11:33:58.942 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T11:33:58.950 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:58.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:58 +0000 (0:00:00.042) 0:00:21.428 ******* 2020-11-20T11:33:58.986 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:33:59.022 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:59 +0000 (0:00:00.042) 0:00:21.471 ******* 2020-11-20T11:33:59.030 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T11:33:59.032 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.043 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:59 +0000 (0:00:00.058) 0:00:21.529 ******* 2020-11-20T11:33:59.087 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.087 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.089 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:59 +0000 (0:00:00.044) 0:00:21.573 ******* 2020-11-20T11:33:59.133 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T11:33:59.134 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:59 +0000 (0:00:00.043) 0:00:21.617 ******* 2020-11-20T11:33:59.174 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:33:59.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:33:59 +0000 (0:00:00.046) 0:00:21.663 ******* 2020-11-20T11:34:00.103 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T11:34:00.105 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:00.140 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:00 +0000 (0:00:00.925) 0:00:22.588 ******* 2020-11-20T11:34:00.167 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:34:00.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:00 +0000 (0:00:00.077) 0:00:22.666 ******* 2020-11-20T11:34:00.492 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T11:34:00.494 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-20T11:34:00.545 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:00 +0000 (0:00:00.326) 0:00:22.992 ******* 2020-11-20T11:34:00.579 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-11-20T11:34:00.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:00 +0000 (0:00:00.091) 0:00:23.083 ******* 2020-11-20T11:34:00.890 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T11:34:00.891 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:34:00.931 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:00 +0000 (0:00:00.296) 0:00:23.380 ******* 2020-11-20T11:34:01.032 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-11-20T11:34:01.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.141) 0:00:23.521 ******* 2020-11-20T11:34:01.090 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:34:01.092 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-20T11:34:01.206 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-20T11:34:01.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.184) 0:00:23.706 ******* 2020-11-20T11:34:01.267 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-11-20T11:34:01.289 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:34:01.292 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:01.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.067) 0:00:23.773 ******* 2020-11-20T11:34:01.343 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T11:34:01.351 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-11-20T11:34:01.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.054) 0:00:23.828 ******* 2020-11-20T11:34:01.386 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:34:01.388 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:34:01.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.042) 0:00:23.871 ******* 2020-11-20T11:34:01.429 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T11:34:01.431 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:01.469 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.046) 0:00:23.918 ******* 2020-11-20T11:34:01.476 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:34:01.478 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:01.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.044) 0:00:23.962 ******* 2020-11-20T11:34:01.520 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T11:34:01.521 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:34:01.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.048) 0:00:24.011 ******* 2020-11-20T11:34:01.600 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T11:34:01.602 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:01.643 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.080) 0:00:24.091 ******* 2020-11-20T11:34:01.828 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T11:34:01.830 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-20T11:34:01.868 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:01 +0000 (0:00:00.225) 0:00:24.317 ******* 2020-11-20T11:34:01.979 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-11-20T11:34:02.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.150) 0:00:24.467 ******* 2020-11-20T11:34:02.487 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:34:02.488 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ActiveEnterTimestampMonotonic": "20380375", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target nss-lookup.target remote-fs.target basic.target system.slice local-fs.target systemd-tmpfiles-setup.service var-run.mount systemd-journald.socket -.mount sysinit.target network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:12 UTC", "AssertTimestampMonotonic": "20379599", "Before": "getty@tty1.service xdm.service plymouth-quit.service multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ConditionTimestampMonotonic": "20379599", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-20T11:34:02.490 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1208", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ExecMainStartTimestampMonotonic": "20380343", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:33:12 UTC] ; stop_time=[n/a] ; pid=1208 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:12 UTC", "InactiveExitTimestampMonotonic": "20380375", "InvocationID": "8dcb7fd87f3b454ea608da35c52e7335", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-20T11:34:02.492 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1208", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-20T11:34:02.494 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:12 UTC", "StateChangeTimestampMonotonic": "20380375", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:12 UTC", "WatchdogTimestampMonotonic": "20380374", "WatchdogUSec": "0"}} 2020-11-20T11:34:02.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.505) 0:00:24.973 ******* 2020-11-20T11:34:02.551 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:34:02.553 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.061) 0:00:25.034 ******* 2020-11-20T11:34:02.612 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:34:02.614 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.061) 0:00:25.096 ******* 2020-11-20T11:34:02.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:34:02.676 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.061) 0:00:25.157 ******* 2020-11-20T11:34:02.736 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.061) 0:00:25.219 ******* 2020-11-20T11:34:02.797 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:34:02.799 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.831 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.060) 0:00:25.280 ******* 2020-11-20T11:34:02.858 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:34:02.859 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.894 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.062) 0:00:25.342 ******* 2020-11-20T11:34:02.920 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:34:02.922 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:02.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:02 +0000 (0:00:00.061) 0:00:25.403 ******* 2020-11-20T11:34:02.982 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.060) 0:00:25.464 ******* 2020-11-20T11:34:03.043 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T11:34:03.045 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.065) 0:00:25.530 ******* 2020-11-20T11:34:03.108 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:34:03.109 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.061) 0:00:25.591 ******* 2020-11-20T11:34:03.295 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:34:03.297 INFO:teuthology.task.ansible.out:fatal: [smithi161.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": "podman --version", "msg": "[Errno 2] No such file or directory", "rc": 2} ...ignoring 2020-11-20T11:34:03.331 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.187) 0:00:25.779 ******* 2020-11-20T11:34:03.357 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:34:03.359 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.061) 0:00:25.841 ******* 2020-11-20T11:34:03.483 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T11:34:03.484 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:23 UTC", "ActiveEnterTimestampMonotonic": "26179830", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service remote-fs.target time-sync.target var-run.mount basic.target network.target system.slice -.mount local-fs.target systemd-journald.socket sysinit.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:23 UTC", "AssertTimestampMonotonic": "26178849", "Before": "multi-user.target getty@tty1.service xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:23 UTC", "ConditionTimestampMonotonic": "26178849", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-11-20T11:34:03.485 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1168", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:23 UTC", "ExecMainStartTimestampMonotonic": "26179794", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Fri 2020-11-20 11:33:23 UTC] ; stop_time=[n/a] ; pid=1168 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:23 UTC", "InactiveExitTimestampMonotonic": "26179830", "InvocationID": "a3e8cd5bccdb4174acc1e1bc3ee2996c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "i 2020-11-20T11:34:03.487 INFO:teuthology.task.ansible.out:nfinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1168", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2020-11-20T11:34:03.489 INFO:teuthology.task.ansible.out: "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:23 UTC", "StateChangeTimestampMonotonic": "26179830", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:23 UTC", "WatchdogTimestampMonotonic": "26179829", "WatchdogUSec": "0"}} 2020-11-20T11:34:03.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.129) 0:00:25.970 ******* 2020-11-20T11:34:03.549 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T11:34:03.551 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.061) 0:00:26.032 ******* 2020-11-20T11:34:03.613 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T11:34:03.614 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.062) 0:00:26.095 ******* 2020-11-20T11:34:03.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T11:34:03.676 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.062) 0:00:26.157 ******* 2020-11-20T11:34:03.736 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.062) 0:00:26.220 ******* 2020-11-20T11:34:03.798 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T11:34:03.800 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.834 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.062) 0:00:26.282 ******* 2020-11-20T11:34:03.861 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T11:34:03.863 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.896 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.061) 0:00:26.344 ******* 2020-11-20T11:34:03.923 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T11:34:03.925 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:03.958 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:03 +0000 (0:00:00.061) 0:00:26.406 ******* 2020-11-20T11:34:03.988 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T11:34:03.990 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:04.023 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:04 +0000 (0:00:00.065) 0:00:26.471 ******* 2020-11-20T11:34:04.050 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:04.085 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:04 +0000 (0:00:00.061) 0:00:26.533 ******* 2020-11-20T11:34:04.112 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T11:34:04.113 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:04.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:04 +0000 (0:00:00.061) 0:00:26.595 ******* 2020-11-20T11:34:04.289 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T11:34:04.291 INFO:teuthology.task.ansible.out:fatal: [smithi186.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": "podman --version", "msg": "[Errno 2] No such file or directory", "rc": 2} ...ignoring 2020-11-20T11:34:04.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:04 +0000 (0:00:00.177) 0:00:26.773 ******* 2020-11-20T11:34:04.351 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:04.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:04 +0000 (0:00:00.061) 0:00:26.835 ******* 2020-11-20T11:34:08.132 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:34:08.134 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["docker", "--version"], "delta": "0:00:04.589819", "end": "2020-11-20 11:34:08.393506", "rc": 0, "start": "2020-11-20 11:34:03.803687", "stderr": "", "stderr_lines": [], "stdout": "Docker version 19.03.6, build 369ce74a3c", "stdout_lines": ["Docker version 19.03.6, build 369ce74a3c"]} 2020-11-20T11:34:08.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:03.783) 0:00:30.618 ******* 2020-11-20T11:34:08.208 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:34:08.210 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:34:08.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.075) 0:00:30.694 ******* 2020-11-20T11:34:08.294 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:34:08.296 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi161.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:34:08.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.087) 0:00:30.781 ******* 2020-11-20T11:34:08.464 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:34:08.501 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.168) 0:00:30.949 ******* 2020-11-20T11:34:08.825 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:34:08.827 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872048.5277371-232136301943839/source", "state": "file", "uid": 0} 2020-11-20T11:34:08.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.363) 0:00:31.313 ******* 2020-11-20T11:34:08.893 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:34:08.894 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-20T11:34:08.930 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.065) 0:00:31.378 ******* 2020-11-20T11:34:08.937 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T11:34:08.939 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["docker", "--version"], "delta": "0:00:04.412941", "end": "2020-11-20 11:34:08.913490", "rc": 0, "start": "2020-11-20 11:34:04.500549", "stderr": "", "stderr_lines": [], "stdout": "Docker version 19.03.6, build 369ce74a3c", "stdout_lines": ["Docker version 19.03.6, build 369ce74a3c"]} 2020-11-20T11:34:08.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:08 +0000 (0:00:00.050) 0:00:31.429 ******* 2020-11-20T11:34:08.988 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:34:08.990 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-20T11:34:09.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.048) 0:00:31.477 ******* 2020-11-20T11:34:09.035 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T11:34:09.037 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T11:34:09.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.046) 0:00:31.524 ******* 2020-11-20T11:34:09.085 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:34:09.087 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-20T11:34:09.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.052) 0:00:31.577 ******* 2020-11-20T11:34:09.135 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T11:34:09.136 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi186.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T11:34:09.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.046) 0:00:31.624 ******* 2020-11-20T11:34:09.182 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:34:09.184 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:34:09.220 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.044) 0:00:31.668 ******* 2020-11-20T11:34:09.322 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T11:34:09.324 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:34:09.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.140) 0:00:31.809 ******* 2020-11-20T11:34:09.367 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:34:09.369 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:34:09.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.043) 0:00:31.853 ******* 2020-11-20T11:34:09.547 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:34:09.549 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:34:09.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.178) 0:00:32.032 ******* 2020-11-20T11:34:09.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:09.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.066) 0:00:32.098 ******* 2020-11-20T11:34:09.677 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T11:34:09.678 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:09.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.063) 0:00:32.162 ******* 2020-11-20T11:34:09.720 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T11:34:09.722 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605872049.3999658-114878018330248/source", "state": "file", "uid": 0} 2020-11-20T11:34:09.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.045) 0:00:32.207 ******* 2020-11-20T11:34:09.786 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T11:34:09.787 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-11-20T11:34:09.822 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.063) 0:00:32.270 ******* 2020-11-20T11:34:09.854 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T11:34:09.856 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-20T11:34:09.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.069) 0:00:32.339 ******* 2020-11-20T11:34:09.898 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T11:34:09.900 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-11-20T11:34:09.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:09 +0000 (0:00:00.045) 0:00:32.385 ******* 2020-11-20T11:34:09.975 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T11:34:09.977 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-11-20T11:34:10.012 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.075) 0:00:32.460 ******* 2020-11-20T11:34:10.063 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T11:34:10.066 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T11:34:10.099 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.087) 0:00:32.547 ******* 2020-11-20T11:34:10.219 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T11:34:10.221 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-11-20T11:34:10.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.156) 0:00:32.704 ******* 2020-11-20T11:34:10.273 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:34:10.275 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:34:10.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.055) 0:00:32.760 ******* 2020-11-20T11:34:10.339 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:34:10.341 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi161"}, "changed": false} 2020-11-20T11:34:10.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.065) 0:00:32.826 ******* 2020-11-20T11:34:10.397 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T11:34:10.399 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T11:34:10.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.066) 0:00:32.892 ******* 2020-11-20T11:34:10.472 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:10.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.064) 0:00:32.956 ******* 2020-11-20T11:34:10.536 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:10.572 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.063) 0:00:33.020 ******* 2020-11-20T11:34:10.736 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi186.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-11-20T11:34:10.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:10 +0000 (0:00:00.198) 0:00:33.219 ******* 2020-11-20T11:34:11.261 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T11:34:11.262 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-11-20T11:34:11.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:11 +0000 (0:00:00.525) 0:00:33.745 ******* 2020-11-20T11:34:11.313 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T11:34:11.314 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi161.front.sepia.ceph.com", "ansible_hostname": "smithi161", "ansible_nodename": "smithi161"}, "changed": true, "name": "smithi161"} 2020-11-20T11:34:11.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:11 +0000 (0:00:00.051) 0:00:33.797 ******* 2020-11-20T11:34:11.355 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T11:34:11.356 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi186"}, "changed": false} 2020-11-20T11:34:11.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:11 +0000 (0:00:00.043) 0:00:33.840 ******* 2020-11-20T11:34:11.673 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T11:34:12.767 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} Friday 20 November 2020 11:34:11 +0000 (0:00:00.317) 0:00:34.158 ******* TASK [testnode : Set the system's hostname] ************************************ changed: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi186.front.sepia.ceph.com", "ansible_hostname": "smithi186", "ansible_nodename": "smithi186"}, "changed": true, "name": "smithi186"} Friday 20 November 2020 11:34:12 +0000 (0:00:00.306) 0:00:34.464 ******* TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} Friday 20 November 2020 11:34:12 +0000 (0:00:00.077) 0:00:34.542 ******* TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} Friday 20 November 2020 11:34:12 +0000 (0:00:00.307) 0:00:34.850 ******* TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "key 2020-11-20T11:34:12.769 INFO:teuthology.task.ansible.out:file": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} Friday 20 November 2020 11:34:12 +0000 (0:00:00.251) 0:00:35.102 ******* TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:12 +0000 (0:00:00.063) 0:00:35.166 ******* TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:12.799 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:12 +0000 (0:00:00.081) 0:00:35.248 ******* 2020-11-20T11:34:12.838 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T11:34:12.839 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-11-20T11:34:12.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:12 +0000 (0:00:00.177) 0:00:35.425 ******* 2020-11-20T11:34:12.983 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:34:12.984 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.053) 0:00:35.478 ******* 2020-11-20T11:34:13.060 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:34:13.061 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.065) 0:00:35.543 ******* 2020-11-20T11:34:13.122 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:34:13.124 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.062) 0:00:35.606 ******* 2020-11-20T11:34:13.185 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.062) 0:00:35.668 ******* 2020-11-20T11:34:13.247 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.062) 0:00:35.731 ******* 2020-11-20T11:34:13.310 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.063) 0:00:35.795 ******* 2020-11-20T11:34:13.374 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:34:13.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.065) 0:00:35.860 ******* 2020-11-20T11:34:13.438 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:34:13.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.062) 0:00:35.922 ******* 2020-11-20T11:34:13.501 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:34:13.502 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi186.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T11:34:13.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.062) 0:00:35.985 ******* 2020-11-20T11:34:13.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.032) 0:00:36.018 ******* 2020-11-20T11:34:13.576 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:34:13.578 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.042) 0:00:36.060 ******* 2020-11-20T11:34:13.619 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T11:34:13.621 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.048) 0:00:36.109 ******* 2020-11-20T11:34:13.667 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:34:13.669 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.043) 0:00:36.152 ******* 2020-11-20T11:34:13.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:34:13.713 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.043) 0:00:36.196 ******* 2020-11-20T11:34:13.754 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:34:13.756 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.043) 0:00:36.239 ******* 2020-11-20T11:34:13.797 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:34:13.799 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.041) 0:00:36.281 ******* 2020-11-20T11:34:13.838 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:34:13.840 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.041) 0:00:36.323 ******* 2020-11-20T11:34:13.880 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:34:13.882 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.041) 0:00:36.364 ******* 2020-11-20T11:34:13.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:34:13.923 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:13.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:13 +0000 (0:00:00.042) 0:00:36.407 ******* 2020-11-20T11:34:13.965 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:34:13.967 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.450 ******* 2020-11-20T11:34:14.008 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:34:14.010 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.045 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.043) 0:00:36.493 ******* 2020-11-20T11:34:14.051 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:34:14.053 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.088 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.043) 0:00:36.536 ******* 2020-11-20T11:34:14.094 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:34:14.096 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.579 ******* 2020-11-20T11:34:14.137 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:34:14.139 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.173 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.621 ******* 2020-11-20T11:34:14.179 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:34:14.180 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:36.663 ******* 2020-11-20T11:34:14.221 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T11:34:14.223 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.261 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.045) 0:00:36.709 ******* 2020-11-20T11:34:14.267 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:34:14.268 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.302 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:36.751 ******* 2020-11-20T11:34:14.310 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T11:34:14.345 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.793 ******* 2020-11-20T11:34:14.351 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:34:14.353 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.836 ******* 2020-11-20T11:34:14.394 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T11:34:14.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:36.879 ******* 2020-11-20T11:34:14.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:34:14.438 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:36.921 ******* 2020-11-20T11:34:14.479 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T11:34:14.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:36.963 ******* 2020-11-20T11:34:14.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:34:14.522 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:37.005 ******* 2020-11-20T11:34:14.563 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T11:34:14.564 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.598 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:37.047 ******* 2020-11-20T11:34:14.605 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:34:14.607 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.643 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.044) 0:00:37.091 ******* 2020-11-20T11:34:14.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T11:34:14.651 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.687 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.044) 0:00:37.136 ******* 2020-11-20T11:34:14.695 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:14.697 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:37.178 ******* 2020-11-20T11:34:14.736 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T11:34:14.737 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.043) 0:00:37.221 ******* 2020-11-20T11:34:14.781 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.043) 0:00:37.265 ******* 2020-11-20T11:34:14.830 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.047) 0:00:37.313 ******* 2020-11-20T11:34:14.871 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:34:14.873 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.907 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:37.355 ******* 2020-11-20T11:34:14.913 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T11:34:14.915 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.950 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.042) 0:00:37.398 ******* 2020-11-20T11:34:14.955 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T11:34:14.957 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:14.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:14 +0000 (0:00:00.041) 0:00:37.440 ******* 2020-11-20T11:34:14.998 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T11:34:14.999 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.042) 0:00:37.483 ******* 2020-11-20T11:34:15.041 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T11:34:15.042 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.078 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.043) 0:00:37.526 ******* 2020-11-20T11:34:15.084 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T11:34:15.086 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.042) 0:00:37.569 ******* 2020-11-20T11:34:15.128 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T11:34:15.129 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.163 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.042) 0:00:37.612 ******* 2020-11-20T11:34:15.170 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T11:34:15.172 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.208 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.044) 0:00:37.657 ******* 2020-11-20T11:34:15.214 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T11:34:15.216 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.044) 0:00:37.701 ******* 2020-11-20T11:34:15.260 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:34:15.262 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.044) 0:00:37.745 ******* 2020-11-20T11:34:15.303 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T11:34:15.305 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.340 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.043) 0:00:37.788 ******* 2020-11-20T11:34:15.346 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:34:15.348 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.383 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.042) 0:00:37.831 ******* 2020-11-20T11:34:15.389 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:34:15.390 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.426 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.043) 0:00:37.874 ******* 2020-11-20T11:34:15.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:34:15.441 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.049) 0:00:37.924 ******* 2020-11-20T11:34:15.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T11:34:15.504 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.063) 0:00:37.987 ******* 2020-11-20T11:34:15.556 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003183", "end": "2020-11-20 11:34:15.820364", "rc": 0, "start": "2020-11-20 11:34:15.817181", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:15.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.053) 0:00:38.040 ******* 2020-11-20T11:34:15.598 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:34:15.600 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.043) 0:00:38.084 ******* 2020-11-20T11:34:15.642 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:34:15.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.042) 0:00:38.127 ******* 2020-11-20T11:34:15.686 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:15.687 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.044) 0:00:38.171 ******* 2020-11-20T11:34:15.743 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T11:34:15.745 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:15.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:15 +0000 (0:00:00.063) 0:00:38.235 ******* 2020-11-20T11:34:15.817 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T11:34:16.247 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:15 +0000 (0:00:00.078) 0:00:38.313 ******* TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:15 +0000 (0:00:00.075) 0:00:38.389 ******* TASK [testnode : Install abrt] ************************************************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:16 +0000 (0:00:00.066) 0:00:38.455 ******* TASK [testnode : Set apt preferences] ****************************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} Friday 20 November 2020 11:34:16 +0000 (0:00:00.046) 0:00:38.502 ******* TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:16 +0000 (0:00:00.044) 0:00:38.546 ******* TASK [testnode : Add sources list] ********************************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:16 +0000 (0:00:00.048) 0:00:38.595 ******* TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 2020-11-20T11:34:16.249 INFO:teuthology.task.ansible.out: 11:34:16 +0000 (0:00:00.047) 0:00:38.642 ******* TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:16.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.072) 0:00:38.715 ******* 2020-11-20T11:34:16.295 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T11:34:16.297 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:16.350 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.083) 0:00:38.799 ******* 2020-11-20T11:34:16.475 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T11:34:16.477 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003157", "end": "2020-11-20 11:34:16.454723", "rc": 0, "start": "2020-11-20 11:34:16.451566", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:16.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.161) 0:00:38.961 ******* 2020-11-20T11:34:16.539 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T11:34:16.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.064) 0:00:39.026 ******* 2020-11-20T11:34:16.884 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-11-20T11:34:16.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.344) 0:00:39.370 ******* 2020-11-20T11:34:16.949 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T11:34:16.951 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:16.985 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:16 +0000 (0:00:00.062) 0:00:39.433 ******* 2020-11-20T11:34:17.604 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T11:34:17.606 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-20T11:34:18.078 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-11-20T11:34:18.606 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-20T11:34:18.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:18 +0000 (0:00:01.671) 0:00:41.105 ******* 2020-11-20T11:34:19.151 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-11-20T11:34:19.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:19 +0000 (0:00:00.532) 0:00:41.638 ******* 2020-11-20T11:34:19.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:34:19.576 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:34:19.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:19 +0000 (0:00:00.421) 0:00:42.060 ******* 2020-11-20T11:34:19.640 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:34:19.674 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:19 +0000 (0:00:00.062) 0:00:42.122 ******* 2020-11-20T11:34:19.835 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:34:19.837 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030301", "end": "2020-11-20 11:34:20.097490", "rc": 0, "start": "2020-11-20 11:34:20.067189", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:19.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:19 +0000 (0:00:00.197) 0:00:42.319 ******* 2020-11-20T11:34:20.116 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T11:34:20.118 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:20.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:20 +0000 (0:00:00.281) 0:00:42.601 ******* 2020-11-20T11:34:20.180 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T11:34:20.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:20 +0000 (0:00:00.061) 0:00:42.663 ******* 2020-11-20T11:34:20.380 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T11:34:20.382 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031732", "end": "2020-11-20 11:34:20.345168", "rc": 0, "start": "2020-11-20 11:34:20.313436", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:20.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:20 +0000 (0:00:00.220) 0:00:42.884 ******* 2020-11-20T11:34:22.824 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T11:34:22.826 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:34:22.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:22 +0000 (0:00:02.424) 0:00:45.308 ******* 2020-11-20T11:34:23.203 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:23.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:23 +0000 (0:00:00.379) 0:00:45.688 ******* 2020-11-20T11:34:31.328 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 20 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database .. 2020-11-20T11:34:31.330 INFO:teuthology.task.ansible.out:. 95%\r(Reading database ... 100%\r(Reading database ... 137606 files and directories currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 20 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading 2020-11-20T11:34:31.332 INFO:teuthology.task.ansible.out: database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137606 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-20T11:34:31.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:31 +0000 (0:00:08.162) 0:00:53.850 ******* 2020-11-20T11:34:32.080 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 20 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137606 files and directorie 2020-11-20T11:34:32.082 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 20 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-11-20T11:34:32.083 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137606 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-20T11:34:32.117 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:32 +0000 (0:00:00.714) 0:00:54.565 ******* 2020-11-20T11:34:32.290 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:32.292 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:34:32.330 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:32 +0000 (0:00:00.213) 0:00:54.778 ******* 2020-11-20T11:34:32.358 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:34:32.360 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:32.394 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:32 +0000 (0:00:00.063) 0:00:54.842 ******* 2020-11-20T11:34:33.012 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:33.014 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:33.050 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:33 +0000 (0:00:00.655) 0:00:55.498 ******* 2020-11-20T11:34:33.076 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T11:34:33.078 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:33.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:33 +0000 (0:00:00.062) 0:00:55.560 ******* 2020-11-20T11:34:41.072 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:34:41.074 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 20 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 1s (9732 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-11-20T11:34:41.076 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-11-20T11:34:41.078 INFO:teuthology.task.ansible.out:u1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 20 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 1s (9732 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-11-20T11:34:41.080 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-20T11:34:41.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:41 +0000 (0:00:07.998) 0:01:03.559 ******* 2020-11-20T11:34:41.957 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 20 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]\nFetched 10.4 MB in 1s (9918 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-11-20T11:34:41.959 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137464 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-11-20T11:34:41.961 INFO:teuthology.task.ansible.out:u1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 20 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.33 [40.1 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.33 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.33 [5193 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.33 [873 kB]", "Fetched 10.4 MB in 1s (9918 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-11-20T11:34:41.963 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137464 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.33_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2020-11-20T11:34:41.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:41 +0000 (0:00:00.884) 0:01:04.444 ******* 2020-11-20T11:34:42.023 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:34:42.062 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.065) 0:01:04.509 ******* 2020-11-20T11:34:42.182 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T11:34:42.184 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-11-20T11:34:42.225 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.164) 0:01:04.674 ******* 2020-11-20T11:34:42.264 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:42.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.073) 0:01:04.747 ******* 2020-11-20T11:34:42.437 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-11-20T11:34:42.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.176) 0:01:04.923 ******* 2020-11-20T11:34:42.811 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T11:34:42.813 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-20T11:34:42.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.374) 0:01:05.298 ******* 2020-11-20T11:34:42.867 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T11:34:42.869 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:42.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:42 +0000 (0:00:00.056) 0:01:05.354 ******* 2020-11-20T11:34:43.011 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi161.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:34:43.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.141) 0:01:05.496 ******* 2020-11-20T11:34:43.547 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} Friday 20 November 2020 11:34:43 +0000 (0:00:00.044) 0:01:05.540 ******* TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 11:34:43 +0000 (0:00:00.063) 0:01:05.603 ******* TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Friday 20 November 2020 11:34:43 +0000 (0:00:00.065) 0:01:05.669 ******* TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} Friday 20 November 2020 11:34:43 +0000 (0:00:00.116) 0:01:05.786 ******* TASK [testnode : Stop apache2] ************************************************* changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ActiveEnterTimestampMonotonic": "20808097", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice nss-lookup.target sysinit.target network.target basic.target systemd-journald.socket -.mount systemd-tmpfiles-setup.service remote-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:12 UTC", "AssertTimes 2020-11-20T11:34:43.549 INFO:teuthology.task.ansible.out:tampMonotonic": "20381362", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ConditionTimestampMonotonic": "20381362", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1304", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:12 UTC", "ExecMainStartTimestampMonotonic": "20808085", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; a 2020-11-20T11:34:43.552 INFO:teuthology.task.ansible.out:rgv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:12 UTC", "InactiveExitTimestampMonotonic": "20382207", "InvocationID": "65e8ba5b30314081b21ab192336090b7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", " 2020-11-20T11:34:43.553 INFO:teuthology.task.ansible.out:LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1304", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:12 UTC", "StateChangeTimestampMonotonic": "20808097", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": " 2020-11-20T11:34:43.555 INFO:teuthology.task.ansible.out:running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:12 UTC", "WatchdogTimestampMonotonic": "20808095", "WatchdogUSec": "0"}} Friday 20 November 2020 11:34:43 +0000 (0:00:00.192) 0:01:05.979 ******* 2020-11-20T11:34:43.558 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.061) 0:01:06.040 ******* 2020-11-20T11:34:43.619 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:34:43.621 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.061) 0:01:06.102 ******* 2020-11-20T11:34:43.684 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T11:34:43.685 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.686 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-11-20T11:34:43.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.087) 0:01:06.190 ******* 2020-11-20T11:34:43.774 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.032) 0:01:06.222 ******* 2020-11-20T11:34:43.781 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:34:43.783 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.044) 0:01:06.266 ******* 2020-11-20T11:34:43.856 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.073) 0:01:06.340 ******* 2020-11-20T11:34:43.919 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:34:43.920 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:43.965 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:43 +0000 (0:00:00.071) 0:01:06.412 ******* 2020-11-20T11:34:43.971 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T11:34:43.973 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T11:34:44.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.057) 0:01:06.469 ******* 2020-11-20T11:34:44.028 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:34:44.030 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.075 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.053) 0:01:06.523 ******* 2020-11-20T11:34:44.103 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:34:44.106 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.146 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.071) 0:01:06.595 ******* 2020-11-20T11:34:44.168 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.065) 0:01:06.660 ******* 2020-11-20T11:34:44.254 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.042) 0:01:06.703 ******* 2020-11-20T11:34:44.262 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:34:44.263 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.309 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.054) 0:01:06.758 ******* 2020-11-20T11:34:44.339 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:34:44.341 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.071) 0:01:06.829 ******* 2020-11-20T11:34:44.410 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:44.412 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.454 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.073) 0:01:06.902 ******* 2020-11-20T11:34:44.483 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:34:44.485 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.072) 0:01:06.975 ******* 2020-11-20T11:34:44.562 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.603 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.076) 0:01:07.051 ******* 2020-11-20T11:34:44.611 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T11:34:44.613 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:24 UTC", "ActiveEnterTimestampMonotonic": "26637837", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice nss-lookup.target basic.target systemd-journald.socket sysinit.target network.target remote-fs.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:23 UTC", "AssertTimestampMonotonic": "26180788", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:23 UTC", "ConditionTimestampMonotonic": "26180788", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-11-20T11:34:44.615 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1233", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:24 UTC", "ExecMainStartTimestampMonotonic": "26637819", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:23 UTC", "InactiveExitTimestampMonotonic": "26181717", "InvocationID": "49870ce23f62432a9e4d7447606e52f8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-11-20T11:34:44.616 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1233", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-11-20T11:34:44.618 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:24 UTC", "StateChangeTimestampMonotonic": "26637837", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:24 UTC", "WatchdogTimestampMonotonic": "26637836", "WatchdogUSec": "0"}} 2020-11-20T11:34:44.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.056) 0:01:07.107 ******* 2020-11-20T11:34:44.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:44.668 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.046) 0:01:07.154 ******* 2020-11-20T11:34:44.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T11:34:44.715 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.750 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.044) 0:01:07.198 ******* 2020-11-20T11:34:44.758 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:44.760 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.044) 0:01:07.243 ******* 2020-11-20T11:34:44.796 INFO:teuthology.task.ansible.out: 2020-11-20T11:34:44.802 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T11:34:44.804 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.045) 0:01:07.288 ******* 2020-11-20T11:34:44.841 INFO:teuthology.task.ansible.out: 2020-11-20T11:34:44.846 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:34:44.848 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.043) 0:01:07.331 ******* 2020-11-20T11:34:44.890 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.043) 0:01:07.374 ******* 2020-11-20T11:34:44.932 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:34:44.934 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:44.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:44 +0000 (0:00:00.043) 0:01:07.418 ******* 2020-11-20T11:34:44.977 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T11:34:44.979 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.462 ******* 2020-11-20T11:34:45.019 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:34:45.022 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.042) 0:01:07.505 ******* 2020-11-20T11:34:45.064 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T11:34:45.065 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.548 ******* 2020-11-20T11:34:45.106 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:34:45.108 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.592 ******* 2020-11-20T11:34:45.150 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T11:34:45.152 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.635 ******* 2020-11-20T11:34:45.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:45.194 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.232 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.045) 0:01:07.680 ******* 2020-11-20T11:34:45.238 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T11:34:45.240 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.275 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.724 ******* 2020-11-20T11:34:45.282 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:45.284 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.318 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.767 ******* 2020-11-20T11:34:45.325 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T11:34:45.327 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.362 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.810 ******* 2020-11-20T11:34:45.368 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:34:45.369 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.853 ******* 2020-11-20T11:34:45.411 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:34:45.413 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:07.897 ******* 2020-11-20T11:34:45.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:45.456 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.491 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.042) 0:01:07.939 ******* 2020-11-20T11:34:45.497 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T11:34:45.499 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.535 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.044) 0:01:07.984 ******* 2020-11-20T11:34:45.541 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:45.545 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:08.027 ******* 2020-11-20T11:34:45.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T11:34:45.589 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:08.071 ******* 2020-11-20T11:34:45.629 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:34:45.631 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.042) 0:01:08.114 ******* 2020-11-20T11:34:45.672 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T11:34:45.674 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.710 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.043) 0:01:08.158 ******* 2020-11-20T11:34:45.736 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:34:45.739 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.062) 0:01:08.220 ******* 2020-11-20T11:34:45.789 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:34:45.790 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-20T11:34:45.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.052) 0:01:08.273 ******* 2020-11-20T11:34:45.831 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:34:45.833 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.049) 0:01:08.322 ******* 2020-11-20T11:34:45.901 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:45.903 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:45.938 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:45 +0000 (0:00:00.063) 0:01:08.386 ******* 2020-11-20T11:34:45.967 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:45.969 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.068) 0:01:08.455 ******* 2020-11-20T11:34:46.033 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:34:46.035 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.062) 0:01:08.518 ******* 2020-11-20T11:34:46.097 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.064) 0:01:08.582 ******* 2020-11-20T11:34:46.151 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:34:46.152 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-20T11:34:46.188 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.053) 0:01:08.636 ******* 2020-11-20T11:34:46.195 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T11:34:46.197 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.233 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.045) 0:01:08.681 ******* 2020-11-20T11:34:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:34:46.242 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.043) 0:01:08.725 ******* 2020-11-20T11:34:46.283 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:34:46.285 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.044) 0:01:08.769 ******* 2020-11-20T11:34:46.348 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:46.350 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.384 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.062) 0:01:08.832 ******* 2020-11-20T11:34:46.411 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:46.413 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.446 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.062) 0:01:08.895 ******* 2020-11-20T11:34:46.473 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T11:34:46.475 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.065) 0:01:08.960 ******* 2020-11-20T11:34:46.538 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T11:34:46.540 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.062) 0:01:09.022 ******* 2020-11-20T11:34:46.601 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T11:34:46.603 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-20T11:34:46.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.065) 0:01:09.087 ******* 2020-11-20T11:34:46.672 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.033) 0:01:09.120 ******* 2020-11-20T11:34:46.699 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T11:34:46.701 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:46.735 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.062) 0:01:09.183 ******* 2020-11-20T11:34:46.888 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T11:34:46.890 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-11-20T11:34:46.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:46 +0000 (0:00:00.189) 0:01:09.373 ******* 2020-11-20T11:34:46.994 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:34:46.996 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-11-20T11:34:47.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.106) 0:01:09.479 ******* 2020-11-20T11:34:47.259 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T11:34:47.261 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-11-20T11:34:47.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.272) 0:01:09.752 ******* 2020-11-20T11:34:47.331 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T11:34:47.333 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.065) 0:01:09.817 ******* 2020-11-20T11:34:47.401 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:34:47.402 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-20T11:34:47.441 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.070) 0:01:09.887 ******* 2020-11-20T11:34:47.582 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:34:47.584 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:34:47.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.180) 0:01:10.068 ******* 2020-11-20T11:34:47.647 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:34:47.649 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.683 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.063) 0:01:10.132 ******* 2020-11-20T11:34:47.690 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T11:34:47.692 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-11-20T11:34:47.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.044) 0:01:10.176 ******* 2020-11-20T11:34:47.736 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T11:34:47.737 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.045) 0:01:10.221 ******* 2020-11-20T11:34:47.801 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:34:47.803 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.077) 0:01:10.299 ******* 2020-11-20T11:34:47.878 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:34:47.880 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.070) 0:01:10.370 ******* 2020-11-20T11:34:47.951 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T11:34:47.953 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:47.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:47 +0000 (0:00:00.069) 0:01:10.439 ******* 2020-11-20T11:34:48.017 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:34:48.019 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:34:48.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.063) 0:01:10.502 ******* 2020-11-20T11:34:48.115 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T11:34:48.117 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.131 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.143 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-11-20T11:34:48.145 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi161.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.145 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.145 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.142) 0:01:10.645 ******* 2020-11-20T11:34:48.204 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi161.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T11:34:48.206 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.206 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.206 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.208 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.219 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.230 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.232 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.088) 0:01:10.733 ******* 2020-11-20T11:34:48.484 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:34:48.486 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003272", "end": "2020-11-20 11:34:48.461300", "rc": 0, "start": "2020-11-20 11:34:48.458028", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:34:48.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.240) 0:01:10.973 ******* 2020-11-20T11:34:48.530 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T11:34:48.532 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-11-20T11:34:48.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.048) 0:01:11.021 ******* 2020-11-20T11:34:48.579 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T11:34:48.582 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.051) 0:01:11.072 ******* 2020-11-20T11:34:48.651 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:34:48.653 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.069) 0:01:11.142 ******* 2020-11-20T11:34:48.710 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T11:34:48.712 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:34:48.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.053) 0:01:11.195 ******* 2020-11-20T11:34:48.753 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T11:34:48.755 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.047) 0:01:11.243 ******* 2020-11-20T11:34:48.801 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T11:34:48.802 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.051) 0:01:11.294 ******* 2020-11-20T11:34:48.874 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.075) 0:01:11.370 ******* 2020-11-20T11:34:48.952 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T11:34:48.954 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:48.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:48 +0000 (0:00:00.070) 0:01:11.441 ******* 2020-11-20T11:34:49.020 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T11:34:49.022 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.055 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.062) 0:01:11.503 ******* 2020-11-20T11:34:49.084 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.099) 0:01:11.603 ******* 2020-11-20T11:34:49.184 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T11:34:49.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.063) 0:01:11.667 ******* 2020-11-20T11:34:49.267 INFO:teuthology.task.ansible.out: 2020-11-20T11:34:49.269 INFO:teuthology.task.ansible.out:TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi186.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.279 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.290 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.292 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.302 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.324 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi186.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.335 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.346 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.358 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.362 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.371 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.382 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.394 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.216) 0:01:11.883 ******* 2020-11-20T11:34:49.645 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T11:34:49.647 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005190", "end": "2020-11-20 11:34:49.611189", "rc": 0, "start": "2020-11-20 11:34:49.605999", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T11:34:49.699 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.264) 0:01:12.148 ******* 2020-11-20T11:34:49.728 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:34:49.730 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.083) 0:01:12.232 ******* 2020-11-20T11:34:49.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.037) 0:01:12.270 ******* 2020-11-20T11:34:49.827 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:34:49.829 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.050) 0:01:12.320 ******* 2020-11-20T11:34:49.878 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T11:34:49.880 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:49.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.063) 0:01:12.384 ******* 2020-11-20T11:34:49.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:34:49.946 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753485, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341623, 'size_available': 927095287808, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341623, "block_size": 4096, "block_total": 240095108, "block_used": 13753485, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095287808, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}} 2020-11-20T11:34:49.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:49 +0000 (0:00:00.055) 0:01:12.439 ******* 2020-11-20T11:34:49.999 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:50.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:50 +0000 (0:00:00.044) 0:01:12.483 ******* 2020-11-20T11:34:50.141 INFO:teuthology.task.ansible.out: 2020-11-20T11:34:50.144 INFO:teuthology.task.ansible.out:TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009960", "end": "2020-11-20 11:34:50.387225", "rc": 0, "start": "2020-11-20 11:34:50.377265", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:50.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:50 +0000 (0:00:00.158) 0:01:12.642 ******* 2020-11-20T11:34:50.233 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753485, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341623, 'size_available': 927095287808, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341623, "block_size": 4096, "block_total": 240095108, "block_used": 13753485, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095287808, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:50.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:50 +0000 (0:00:00.088) 0:01:12.731 ******* 2020-11-20T11:34:50.310 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:34:50.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:50 +0000 (0:00:00.083) 0:01:12.814 ******* 2020-11-20T11:34:50.417 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:34:50.419 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:50.958 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T11:34:50.960 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:34:50.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:50 +0000 (0:00:00.628) 0:01:13.443 ******* 2020-11-20T11:34:51.023 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T11:34:51.025 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:51.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:51 +0000 (0:00:00.065) 0:01:13.509 ******* 2020-11-20T11:34:51.098 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:34:51.099 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item={'block_used': 13753487, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341621, 'size_available': 927095279616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341621, "block_size": 4096, "block_total": 240095108, "block_used": 13753487, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095279616, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}} 2020-11-20T11:34:51.136 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:51 +0000 (0:00:00.074) 0:01:13.584 ******* 2020-11-20T11:34:51.280 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T11:34:51.282 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010895", "end": "2020-11-20 11:34:51.247097", "rc": 0, "start": "2020-11-20 11:34:51.236202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:51.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:51 +0000 (0:00:00.181) 0:01:13.766 ******* 2020-11-20T11:34:51.377 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T11:34:51.378 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'block_used': 13753487, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341621, 'size_available': 927095279616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341621, "block_size": 4096, "block_total": 240095108, "block_used": 13753487, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095279616, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:51.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:51 +0000 (0:00:00.115) 0:01:13.881 ******* 2020-11-20T11:34:51.460 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T11:34:51.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:51 +0000 (0:00:00.063) 0:01:13.945 ******* 2020-11-20T11:34:51.556 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:34:51.557 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:52.645 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXocFLkJvQ1IGBEgZRo1LetPRn43FFwFfA'], 'uuids': ['7934aaec-29a8-4e34-8776-6b15fbdb61fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.084425", "end": "2020-11-20 11:34:52.881586", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXocFLkJvQ1IGBEgZRo1LetPRn43FFwFfA"], "labels": [], "masters": [], "uuids": ["7934aaec-29a8-4e34-8776-6b15fbdb61fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:50.797161", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:52.657 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:52.669 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:53.808 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoRm05vlomEqsjf8WAzKcJUq6j9rZiF3bC'], 'uuids': ['4db58531-3331-4ecc-b4e2-324f9e1eafaa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.132754", "end": "2020-11-20 11:34:53.766675", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoRm05vlomEqsjf8WAzKcJUq6j9rZiF3bC"], "labels": [], "masters": [], "uuids": ["4db58531-3331-4ecc-b4e2-324f9e1eafaa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:51.633921", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:53.821 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:53.832 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:53.897 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXiykaZNvQtfVVaFgVTzNRv6xctstoSwNj'], 'uuids': ['9e26094b-3f86-48c4-9d6e-79d8217d47d5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.126114", "end": "2020-11-20 11:34:54.137793", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXiykaZNvQtfVVaFgVTzNRv6xctstoSwNj"], "labels": [], "masters": [], "uuids": ["9e26094b-3f86-48c4-9d6e-79d8217d47d5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:53.011679", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:53.898 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, "skip_reason": 2020-11-20T11:34:53.900 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-20T11:34:55.064 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Go4WvPdVWjPbihQ2NDFYu8saMsXjIEKcFe'], 'uuids': ['8ecc3a27-27f3-416e-818b-654a655ffa90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.118517", "end": "2020-11-20 11:34:55.031584", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Go4WvPdVWjPbihQ2NDFYu8saMsXjIEKcFe"], "labels": [], "masters": [], "uuids": ["8ecc3a27-27f3-416e-818b-654a655ffa90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:53.913067", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:55.068 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTX2', 'wwn-0x5000c5009293ee14'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTX2-part1', 'wwn-0x5000c5009293ee14-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293ee14', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTX2', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTX2", "wwn-0x5000c5009293ee14"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTX2-part1", "wwn-0x5000c5009293ee14-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTX2", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293ee14"}}, "skip_reason": 2020-11-20T11:34:55.070 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-20T11:34:55.166 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-wdWqpw-5il7-QXB8-hxIE-56RX-ind4-QHMBNT', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.146913", "end": "2020-11-20 11:34:55.401141", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wdWqpw-5il7-QXB8-hxIE-56RX-ind4-QHMBNT", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:54.254228", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:34:55.167 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:55.189 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:55.201 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:56.405 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LCL9Zq-zgxF-sIUg-h2Bo-6vkq-CQHv-zsb0aM', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300CB400BGN', 'nvme-nvme.8086-43564654363233333030434234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.188003", "end": "2020-11-20 11:34:56.360731", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LCL9Zq-zgxF-sIUg-h2Bo-6vkq-CQHv-zsb0aM", "nvme-INTEL_SSDPEDMD400G4_CVFT623300CB400BGN", "nvme-nvme.8086-43564654363233333030434234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:55.172728", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T11:34:56.406 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:56.417 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:56.460 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXM38fS6nRZl8XM2CAt95pJIRxrj0VDkNZ'], 'uuids': ['598934b6-1b09-4074-87b0-8761a38ecef6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.131027", "end": "2020-11-20 11:34:56.696578", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXM38fS6nRZl8XM2CAt95pJIRxrj0VDkNZ"], "labels": [], "masters": [], "uuids": ["598934b6-1b09-4074-87b0-8761a38ecef6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:55.565551", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:56.472 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:56.487 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:57.689 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GovmNCF2x9mSfkjep2X5GbSybdgeryn8dT'], 'uuids': ['3436443a-0f4e-4986-8406-e96326545bf3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.144653", "end": "2020-11-20 11:34:57.647902", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GovmNCF2x9mSfkjep2X5GbSybdgeryn8dT"], "labels": [], "masters": [], "uuids": ["3436443a-0f4e-4986-8406-e96326545bf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:56.503249", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:57.943 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'maste 2020-11-20T11:34:57.945 INFO:teuthology.task.ansible.out:rs': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xX2UxRa7ViMHoHNh844zHNVcC16WIoFhr5'], 'uuids': ['ac1222bc-6a3f-4e32-b9e0-050862647af4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.121351", "end": "2020-11-20 11:34:57.961564", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xX2UxRa7ViMHoHNh844zHNVcC16WIoFhr5"], "labels": [], "masters": [], "uuids": ["ac1222bc-6a3f-4e32-b9e0-050862647af4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:56.840213", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 2020-11-20T11:34:57.947 INFO:teuthology.task.ansible.out:'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:58.956 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Gov2WMrfa9DFeKkwHWLv2MKtAdDsmBgUV5'], 'uuids': ['a029d2eb-0b58-42ac-ade9-014b7da50d94']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.122430", "end": "2020-11-20 11:34:58.923874", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Gov2WMrfa9DFeKkwHWLv2MKtAdDsmBgUV5"], "labels": [], "masters": [], "uuids": ["a029d2eb-0b58-42ac-ade9-014b7da50d94"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:57.801444", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:58.968 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:58.981 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXlYJr10xyG2FksU5CUhcXuuEFXr52fHEY'], 'uuids': ['c8468ef5-026d-4bd0-99f1-49d5c48051ac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.123600", "end": "2020-11-20 11:34:59.204679", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXlYJr10xyG2FksU5CUhcXuuEFXr52fHEY"], "labels": [], "masters": [], "uuids": ["c8468ef5-026d-4bd0-99f1-49d5c48051ac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:58.081079", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:34:59.043 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:34:59 +0000 (0:00:07.546) 0:01:21.491 ******* 2020-11-20T11:34:59.093 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:34:59.096 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:59.377 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXocFLkJvQ1IGBEgZRo1LetPRn43FFwFfA'], 'uuids': ['7934aaec-29a8-4e34-8776-6b15fbdb61fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155989", "end": "2020-11-20 11:34:59.611641", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXocFLkJvQ1IGBEgZRo1LetPRn43FFwFfA"], "labels": [], "masters": [], "uuids": ["7934aaec-29a8-4e34-8776-6b15fbdb61fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:59.455652", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153142 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153142 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:59.389 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:59.402 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:59.675 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXiykaZNvQtfVVaFgVTzNRv6xctstoSwNj'], 'uuids': ['9e26094b-3f86-48c4-9d6e-79d8217d47d5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157834", "end": "2020-11-20 11:34:59.906533", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXiykaZNvQtfVVaFgVTzNRv6xctstoSwNj"], "labels": [], "masters": [], "uuids": ["9e26094b-3f86-48c4-9d6e-79d8217d47d5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:59.748699", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154825 s, 745 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154825 s, 745 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:59.687 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E', 'wwn-0x5000c50092938c4f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1', 'wwn-0x5000c50092938c4f-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092938c4f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XV0E', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E", "wwn-0x5000c50092938c4f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XV0E-part1", "wwn-0x5000c50092938c4f-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XV0E", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092938c4f"}}, "skip_reason": 2020-11-20T11:34:59.689 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-20T11:34:59.868 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-wdWqpw-5il7-QXB8-hxIE-56RX-ind4-QHMBNT', 'nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN', 'nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.047579", "end": "2020-11-20 11:35:00.099489", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-wdWqpw-5il7-QXB8-hxIE-56RX-ind4-QHMBNT", "nvme-INTEL_SSDPEDMD400G4_CVFT6233001X400BGN", "nvme-nvme.8086-43564654363233333030315834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.051910", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.042906 s, 2.7 GB/s", "stde 2020-11-20T11:34:59.869 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.042906 s, 2.7 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:34:59.879 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:34:59.891 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.152 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXM38fS6nRZl8XM2CAt95pJIRxrj0VDkNZ'], 'uuids': ['598934b6-1b09-4074-87b0-8761a38ecef6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.151172", "end": "2020-11-20 11:35:00.388295", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXM38fS6nRZl8XM2CAt95pJIRxrj0VDkNZ"], "labels": [], "masters": [], "uuids": ["598934b6-1b09-4074-87b0-8761a38ecef6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.237123", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148276 s, 778 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148276 s, 778 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:00.164 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.176 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.199 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T11:35:00.200 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoTamcvlpSby6AcKXkiP2CnfhXWKh58POo'], 'uuids': ['6c5dc331-9cae-406b-9f6e-dcdcfd1d7cec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.110249", "end": "2020-11-20 11:35:00.166274", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoTamcvlpSby6AcKXkiP2CnfhXWKh58POo"], "labels": [], "masters": [], "uuids": ["6c5dc331-9cae-406b-9f6e-dcdcfd1d7cec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:34:59.056025", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T11:35:00.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:00 +0000 (0:00:01.223) 0:01:22.715 ******* 2020-11-20T11:35:00.308 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:35:00.311 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.490 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xX2UxRa7ViMHoHNh844zHNVcC16WIoFhr5'], 'uuids': ['ac1222bc-6a3f-4e32-b9e0-050862647af4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.152482", "end": "2020-11-20 11:35:00.717102", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xX2UxRa7ViMHoHNh844zHNVcC16WIoFhr5"], "labels": [], "masters": [], "uuids": ["ac1222bc-6a3f-4e32-b9e0-050862647af4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.564620", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149602 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149602 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:00.502 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.652 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoRm05vlomEqsjf8WAzKcJUq6j9rZiF3bC'], 'uuids': ['4db58531-3331-4ecc-b4e2-324f9e1eafaa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.154914", "end": "2020-11-20 11:35:00.617430", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoRm05vlomEqsjf8WAzKcJUq6j9rZiF3bC"], "labels": [], "masters": [], "uuids": ["4db58531-3331-4ecc-b4e2-324f9e1eafaa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.462516", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150105 s, 768 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150105 s, 768 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:00.666 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.678 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:00.837 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXlYJr10xyG2FksU5CUhcXuuEFXr52fHEY'], 'uuids': ['c8468ef5-026d-4bd0-99f1-49d5c48051ac']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157694", "end": "2020-11-20 11:35:01.068978", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-fA7RjYyQUqTfEs7O0SyEDRfVTd4sQ6xXlYJr10xyG2FksU5CUhcXuuEFXr52fHEY"], "labels": [], "masters": [], "uuids": ["c8468ef5-026d-4bd0-99f1-49d5c48051ac"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.911284", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154555 s, 746 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154555 s, 746 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:00.883 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:00 +0000 (0:00:00.616) 0:01:23.332 ******* 2020-11-20T11:35:01.005 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Go4WvPdVWjPbihQ2NDFYu8saMsXjIEKcFe'], 'uuids': ['8ecc3a27-27f3-416e-818b-654a655ffa90']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161004", "end": "2020-11-20 11:35:00.968819", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Go4WvPdVWjPbihQ2NDFYu8saMsXjIEKcFe"], "labels": [], "masters": [], "uuids": ["8ecc3a27-27f3-416e-818b-654a655ffa90"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:00.807815", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157476 s, 732 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157476 s, 732 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:01.017 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTX2', 'wwn-0x5000c5009293ee14'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTX2-part1', 'wwn-0x5000c5009293ee14-part1'], 'uuids': ['5b37dc69-d2db-44bf-9122-6cf42a1bab47']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293ee14', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTX2', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTX2", "wwn-0x5000c5009293ee14"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTX2-part1", "wwn-0x5000c5009293ee14-part1"], "labels": [], "masters": [], "uuids": ["5b37dc69-d2db-44bf-9122-6cf42a1bab47"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTX2", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293ee14"}}, "skip_reason": 2020-11-20T11:35:01.018 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-11-20T11:35:01.165 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:35:01.167 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.142927", "end": "2020-11-20 11:35:01.404830", "rc": 0, "start": "2020-11-20 11:35:01.261903", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:01.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.317) 0:01:23.649 ******* 2020-11-20T11:35:01.217 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:35:01.219 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LCL9Zq-zgxF-sIUg-h2Bo-6vkq-CQHv-zsb0aM', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300CB400BGN', 'nvme-nvme.8086-43564654363233333030434234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052619", "end": "2020-11-20 11:35:01.161021", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LCL9Zq-zgxF-sIUg-h2Bo-6vkq-CQHv-zsb0aM", "nvme-INTEL_SSDPEDMD400G4_CVFT623300CB400BGN", "nvme-nvme.8086-43564654363233333030434234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:01.108402", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0491804 s, 2.3 GB/s", "std 2020-11-20T11:35:01.221 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0491804 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.231 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.396 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:35:01.399 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041219", "end": "2020-11-20 11:35:01.630815", "rc": 0, "start": "2020-11-20 11:35:01.589596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:01.440 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.239) 0:01:23.888 ******* 2020-11-20T11:35:01.467 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:35:01.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.065) 0:01:23.954 ******* 2020-11-20T11:35:01.513 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:35:01.514 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GovmNCF2x9mSfkjep2X5GbSybdgeryn8dT'], 'uuids': ['3436443a-0f4e-4986-8406-e96326545bf3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148950", "end": "2020-11-20 11:35:01.467550", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GovmNCF2x9mSfkjep2X5GbSybdgeryn8dT"], "labels": [], "masters": [], "uuids": ["3436443a-0f4e-4986-8406-e96326545bf3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:01.318600", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146372 s, 788 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146372 s, 788 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:01.516 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.527 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.538 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.575 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.069) 0:01:24.024 ******* 2020-11-20T11:35:01.602 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.638 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.062) 0:01:24.086 ******* 2020-11-20T11:35:01.640 INFO:teuthology.task.ansible.out: 2020-11-20T11:35:01.665 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:35:01.667 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.064) 0:01:24.151 ******* 2020-11-20T11:35:01.729 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:35:01.731 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.063) 0:01:24.214 ******* 2020-11-20T11:35:01.815 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Gov2WMrfa9DFeKkwHWLv2MKtAdDsmBgUV5'], 'uuids': ['a029d2eb-0b58-42ac-ade9-014b7da50d94']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.159957", "end": "2020-11-20 11:35:01.777851", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4Gov2WMrfa9DFeKkwHWLv2MKtAdDsmBgUV5"], "labels": [], "masters": [], "uuids": ["a029d2eb-0b58-42ac-ade9-014b7da50d94"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:01.617894", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155185 s, 743 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155185 s, 743 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:01.827 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:01.890 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:35:01.892 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:35:01.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:01 +0000 (0:00:00.161) 0:01:24.375 ******* 2020-11-20T11:35:01.975 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:35:01.976 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'block_used': 13753485, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341623, 'size_available': 927095287808, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341623, "block_size": 4096, "block_total": 240095108, "block_used": 13753485, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095287808, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.012 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.084) 0:01:24.460 ******* 2020-11-20T11:35:02.038 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.061) 0:01:24.521 ******* 2020-11-20T11:35:02.102 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T11:35:02.104 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoTamcvlpSby6AcKXkiP2CnfhXWKh58POo'], 'uuids': ['6c5dc331-9cae-406b-9f6e-dcdcfd1d7cec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.153721", "end": "2020-11-20 11:35:02.062111", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-kVSfHFjoZ5s9BFUIFzzDP7c2l7qsL4GoTamcvlpSby6AcKXkiP2CnfhXWKh58POo"], "labels": [], "masters": [], "uuids": ["6c5dc331-9cae-406b-9f6e-dcdcfd1d7cec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 11:35:01.908390", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1492 s, 773 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1492 s, 773 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:02.115 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:02.118 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.083) 0:01:24.605 ******* 2020-11-20T11:35:02.195 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.038) 0:01:24.643 ******* 2020-11-20T11:35:02.209 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:02.211 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.051) 0:01:24.695 ******* 2020-11-20T11:35:02.273 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:35:02.275 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.064) 0:01:24.759 ******* 2020-11-20T11:35:02.337 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:35:02.339 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.373 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.062) 0:01:24.821 ******* 2020-11-20T11:35:02.399 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:35:02.401 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.435 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.061) 0:01:24.883 ******* 2020-11-20T11:35:02.493 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T11:35:02.495 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.152080", "end": "2020-11-20 11:35:02.452538", "rc": 0, "start": "2020-11-20 11:35:02.300458", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:02.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.095) 0:01:24.979 ******* 2020-11-20T11:35:02.726 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T11:35:02.728 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.056129", "end": "2020-11-20 11:35:02.687680", "rc": 0, "start": "2020-11-20 11:35:02.631551", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:02.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.233) 0:01:25.213 ******* 2020-11-20T11:35:02.792 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T11:35:02.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.067) 0:01:25.280 ******* 2020-11-20T11:35:02.859 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T11:35:02.861 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.066) 0:01:25.346 ******* 2020-11-20T11:35:02.924 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:02.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:02 +0000 (0:00:00.062) 0:01:25.409 ******* 2020-11-20T11:35:03.009 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.066) 0:01:25.476 ******* 2020-11-20T11:35:03.044 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:35:03.046 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:35:03.081 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.053) 0:01:25.529 ******* 2020-11-20T11:35:03.087 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T11:35:03.090 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.127 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.047) 0:01:25.576 ******* 2020-11-20T11:35:03.254 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T11:35:03.256 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T11:35:03.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.162) 0:01:25.739 ******* 2020-11-20T11:35:03.328 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T11:35:03.329 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'block_used': 13753487, 'uuid': '5b37dc69-d2db-44bf-9122-6cf42a1bab47', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226341621, 'size_available': 927095279616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149530, 'block_size': 4096, 'inode_available': 60905446}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226341621, "block_size": 4096, "block_total": 240095108, "block_used": 13753487, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905446, "inode_total": 61054976, "inode_used": 149530, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927095279616, "size_total": 983429562368, "uuid": "5b37dc69-d2db-44bf-9122-6cf42a1bab47"}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.365 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.074) 0:01:25.813 ******* 2020-11-20T11:35:03.391 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T11:35:03.393 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.439 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.074) 0:01:25.888 ******* 2020-11-20T11:35:03.468 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:03.470 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.070) 0:01:25.958 ******* 2020-11-20T11:35:03.538 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.063) 0:01:26.022 ******* 2020-11-20T11:35:03.601 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T11:35:03.603 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.642 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.067) 0:01:26.090 ******* 2020-11-20T11:35:03.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:03.651 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:03.671 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T11:35:03.673 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.064) 0:01:26.155 ******* 2020-11-20T11:35:03.733 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T11:35:03.735 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:03.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:03 +0000 (0:00:00.061) 0:01:26.217 ******* 2020-11-20T11:35:03.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.084 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T11:35:04.161 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T11:35:04.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:04 +0000 (0:00:00.429) 0:01:26.647 ******* 2020-11-20T11:35:04.319 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:04.321 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.509 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.531 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:04 +0000 (0:00:00.372) 0:01:27.019 ******* 2020-11-20T11:35:04.703 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T11:35:04.705 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:35:04.741 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:04 +0000 (0:00:00.169) 0:01:27.189 ******* 2020-11-20T11:35:04.747 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:04.748 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:04.916 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:35:04.918 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:04.982 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:04.983 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:05.047 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:35:05.049 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:05.175 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:05.272 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:05.274 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:05.296 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:35:05.297 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:05.308 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:05.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:05 +0000 (0:00:00.617) 0:01:27.806 ******* 2020-11-20T11:35:05.501 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:35:05.502 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:35:05.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:05 +0000 (0:00:00.178) 0:01:27.985 ******* 2020-11-20T11:35:05.543 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T11:35:05.545 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T11:35:05.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:05 +0000 (0:00:00.046) 0:01:28.032 ******* 2020-11-20T11:35:05.589 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:35:05.591 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T11:35:05.629 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:05 +0000 (0:00:00.045) 0:01:28.077 ******* 2020-11-20T11:35:05.710 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T11:35:05.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:05 +0000 (0:00:00.116) 0:01:28.194 ******* 2020-11-20T11:35:05.889 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:35:05.891 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:06.006 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:06.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:35:06.117 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:35:06.183 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.436) 0:01:28.631 ******* 2020-11-20T11:35:06.194 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T11:35:06.196 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:06.299 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T11:35:06.311 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:06.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.184) 0:01:28.816 ******* 2020-11-20T11:35:06.522 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T11:35:06.524 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:35:06.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.190) 0:01:29.007 ******* 2020-11-20T11:35:06.595 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T11:35:06.597 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T11:35:06.633 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.075) 0:01:29.082 ******* 2020-11-20T11:35:06.735 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T11:35:06.737 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:35:06.784 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.150) 0:01:29.233 ******* 2020-11-20T11:35:06.876 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T11:35:06.878 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true} 2020-11-20T11:35:06.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.128) 0:01:29.361 ******* 2020-11-20T11:35:06.930 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:35:06.932 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:35:06.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:06 +0000 (0:00:00.065) 0:01:29.426 ******* 2020-11-20T11:35:07.103 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:35:07.104 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:35:07.138 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.159) 0:01:29.586 ******* 2020-11-20T11:35:07.146 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T11:35:07.183 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.044) 0:01:29.631 ******* 2020-11-20T11:35:07.335 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T11:35:07.337 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:35:07.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.196) 0:01:29.827 ******* 2020-11-20T11:35:07.502 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:35:07.504 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-20T11:35:07.539 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.160) 0:01:29.988 ******* 2020-11-20T11:35:07.546 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T11:35:07.548 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T11:35:07.588 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.048) 0:01:30.036 ******* 2020-11-20T11:35:07.867 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:35:07.869 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-20T11:35:07.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.318) 0:01:30.355 ******* 2020-11-20T11:35:07.933 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T11:35:07.935 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1236, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-11-20T11:35:07.971 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:07 +0000 (0:00:00.065) 0:01:30.420 ******* 2020-11-20T11:35:08.302 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T11:35:08.304 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-11-20T11:35:08.339 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:08 +0000 (0:00:00.367) 0:01:30.787 ******* 2020-11-20T11:35:08.815 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:35:08.817 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:35:08.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:08 +0000 (0:00:00.512) 0:01:31.300 ******* 2020-11-20T11:35:09.036 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:35:09.037 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.044741", "end": "2020-11-20 11:35:09.268231", "rc": 0, "start": "2020-11-20 11:35:09.223490", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-20T11:35:09.072 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.220) 0:01:31.520 ******* 2020-11-20T11:35:09.099 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:35:09.101 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:09.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.062) 0:01:31.583 ******* 2020-11-20T11:35:09.161 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:35:09.163 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:09.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.076) 0:01:31.659 ******* 2020-11-20T11:35:09.248 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T11:35:09.251 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:35:09.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.076) 0:01:31.736 ******* 2020-11-20T11:35:09.460 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T11:35:09.462 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.042344", "end": "2020-11-20 11:35:09.431013", "rc": 0, "start": "2020-11-20 11:35:09.388669", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-11-20T11:35:09.505 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.217) 0:01:31.953 ******* 2020-11-20T11:35:09.542 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T11:35:09.544 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:09.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.076) 0:01:32.030 ******* 2020-11-20T11:35:09.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T11:35:09.616 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:09.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:09 +0000 (0:00:00.068) 0:01:32.098 ******* 2020-11-20T11:35:10.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:35:10.094 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:35:10.140 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.489) 0:01:32.588 ******* 2020-11-20T11:35:10.170 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:10.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.065) 0:01:32.654 ******* 2020-11-20T11:35:10.486 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T11:35:10.488 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:35:10.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.317) 0:01:32.972 ******* 2020-11-20T11:35:10.540 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T11:35:10.541 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-20T11:35:10.576 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.052) 0:01:33.024 ******* 2020-11-20T11:35:10.582 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T11:35:10.584 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:10.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.042) 0:01:33.067 ******* 2020-11-20T11:35:10.625 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:35:10.627 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:10.662 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.043) 0:01:33.111 ******* 2020-11-20T11:35:10.852 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:35:10.853 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:18 UTC", "ActiveEnterTimestampMonotonic": "26727386", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target systemd-journald.socket -.mount system.slice systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:11 UTC", "AssertTimestampMonotonic": "20068033", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:11 UTC", "ConditionTimestampMonotonic": "20068032", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-20T11:35:10.855 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1762", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:18 UTC", "ExecMainStartTimestampMonotonic": "26727374", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:11 UTC", "InactiveExitTimestampMonotonic": "20068763", "InvocationID": "bd0d34cf139a41eeb0129ef80b03f26b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-20T11:35:10.857 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1762", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:18 UTC", "S 2020-11-20T11:35:10.858 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "26727386", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:18 UTC", "WatchdogTimestampMonotonic": "26727385", "WatchdogUSec": "0"}} 2020-11-20T11:35:10.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.228) 0:01:33.339 ******* 2020-11-20T11:35:10.917 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:35:10.920 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-11-20T11:35:10.954 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.063) 0:01:33.402 ******* 2020-11-20T11:35:10.991 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:10 +0000 (0:00:00.037) 0:01:33.439 ******* 2020-11-20T11:35:10.996 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:10.998 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:11.037 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.046) 0:01:33.486 ******* 2020-11-20T11:35:11.048 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T11:35:11.049 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:11.084 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.047) 0:01:33.533 ******* 2020-11-20T11:35:11.091 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:11.129 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.044) 0:01:33.577 ******* 2020-11-20T11:35:11.322 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T11:35:11.323 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 11:33:30 UTC", "ActiveEnterTimestampMonotonic": "32517529", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target -.mount systemd-tmpfiles-setup.service network.target basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 11:33:23 UTC", "AssertTimestampMonotonic": "25988041", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 11:33:23 UTC", "ConditionTimestampMonotonic": "25988041", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-11-20T11:35:11.325 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1651", "ExecMainStartTimestamp": "Fri 2020-11-20 11:33:30 UTC", "ExecMainStartTimestampMonotonic": "32517517", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 11:33:23 UTC", "InactiveExitTimestampMonotonic": "25988772", "InvocationID": "3677af12f8074360a33a14e08adbaed6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-11-20T11:35:11.326 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1651", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 11:33:30 UTC", "S 2020-11-20T11:35:11.328 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "32517529", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 11:33:30 UTC", "WatchdogTimestampMonotonic": "32517527", "WatchdogUSec": "0"}} 2020-11-20T11:35:11.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.232) 0:01:33.809 ******* 2020-11-20T11:35:11.389 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T11:35:11.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.063) 0:01:33.873 ******* 2020-11-20T11:35:11.455 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:11.457 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:11.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.073) 0:01:33.946 ******* 2020-11-20T11:35:11.525 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T11:35:11.527 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:11.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:11 +0000 (0:00:00.065) 0:01:34.012 ******* 2020-11-20T11:35:11.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:35:11.985 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"cache_update_time": 1605871796, "cache_updated": false, "changed": false} 2020-11-20T11:35:12.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.472) 0:01:34.484 ******* 2020-11-20T11:35:12.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T11:35:12.064 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:12.106 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.071) 0:01:34.555 ******* 2020-11-20T11:35:12.231 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:35:12.232 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:35:12.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.177) 0:01:34.733 ******* 2020-11-20T11:35:12.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T11:35:12.471 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"cache_update_time": 1605871840, "cache_updated": false, "changed": false} 2020-11-20T11:35:12.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.224) 0:01:34.957 ******* 2020-11-20T11:35:12.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:12.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.070) 0:01:35.028 ******* 2020-11-20T11:35:12.692 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:35:12.694 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:35:12.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.150) 0:01:35.178 ******* 2020-11-20T11:35:12.737 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T11:35:12.739 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T11:35:12.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:12 +0000 (0:00:00.054) 0:01:35.233 ******* 2020-11-20T11:35:13.144 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T11:35:13.146 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-11-20T11:35:13.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:13 +0000 (0:00:00.395) 0:01:35.628 ******* 2020-11-20T11:35:13.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T11:35:13.723 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:35:13.758 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:13 +0000 (0:00:00.578) 0:01:36.207 ******* 2020-11-20T11:35:13.944 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T11:35:13.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:13 +0000 (0:00:00.222) 0:01:36.429 ******* 2020-11-20T11:35:14.261 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:35:14.263 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false} 2020-11-20T11:35:14.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.323) 0:01:36.753 ******* 2020-11-20T11:35:14.332 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:35:14.334 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:35:14.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.065) 0:01:36.818 ******* 2020-11-20T11:35:14.500 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T11:35:14.502 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false} 2020-11-20T11:35:14.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.166) 0:01:36.985 ******* 2020-11-20T11:35:14.544 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:35:14.546 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605871778.0837371, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605871778.079737, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 2817, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605871778.079737, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "2282523401", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-20T11:35:14.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.046) 0:01:37.031 ******* 2020-11-20T11:35:14.591 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T11:35:14.593 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T11:35:14.630 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.047) 0:01:37.078 ******* 2020-11-20T11:35:14.770 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T11:35:14.772 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1605871773.1602561, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1605871773.1562562, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 2817, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1605871773.1562562, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "2282523401", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-11-20T11:35:14.808 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.177) 0:01:37.256 ******* 2020-11-20T11:35:14.951 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T11:35:14.953 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-20T11:35:14.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:14 +0000 (0:00:00.180) 0:01:37.436 ******* 2020-11-20T11:35:14.995 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-11-20T11:35:15.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.042) 0:01:37.479 ******* 2020-11-20T11:35:15.038 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T11:35:15.039 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:35:15.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.043) 0:01:37.522 ******* 2020-11-20T11:35:15.080 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T11:35:15.117 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.043) 0:01:37.565 ******* 2020-11-20T11:35:15.123 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T11:35:15.125 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.159 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.042) 0:01:37.607 ******* 2020-11-20T11:35:15.165 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.042) 0:01:37.650 ******* 2020-11-20T11:35:15.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T11:35:15.284 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:35:15.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.119) 0:01:37.770 ******* 2020-11-20T11:35:15.328 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T11:35:15.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.045) 0:01:37.816 ******* 2020-11-20T11:35:15.447 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T11:35:15.449 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:35:15.492 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.124) 0:01:37.940 ******* 2020-11-20T11:35:15.498 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T11:35:15.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.041) 0:01:37.982 ******* 2020-11-20T11:35:15.542 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.043) 0:01:38.025 ******* 2020-11-20T11:35:15.584 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.045) 0:01:38.070 ******* 2020-11-20T11:35:15.628 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T11:35:15.630 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.631 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.631 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.631 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.047) 0:01:38.118 ******* 2020-11-20T11:35:15.675 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.677 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.688 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.055) 0:01:38.174 ******* 2020-11-20T11:35:15.731 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T11:35:15.734 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi186.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditiona 2020-11-20T11:35:15.736 INFO:teuthology.task.ansible.out:l result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.046) 0:01:38.221 ******* 2020-11-20T11:35:15.779 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.780 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.782 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.793 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.794 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T11:35:15.795 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.056) 0:01:38.278 ******* 2020-11-20T11:35:15.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.035) 0:01:38.313 ******* 2020-11-20T11:35:15.871 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.910 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.045) 0:01:38.358 ******* 2020-11-20T11:35:15.917 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T11:35:15.918 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.043) 0:01:38.401 ******* 2020-11-20T11:35:15.959 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:15.996 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:15 +0000 (0:00:00.043) 0:01:38.444 ******* 2020-11-20T11:35:16.002 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T11:35:16.004 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.042 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.045) 0:01:38.490 ******* 2020-11-20T11:35:16.048 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.092 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.050) 0:01:38.540 ******* 2020-11-20T11:35:16.099 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T11:35:16.100 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.042) 0:01:38.583 ******* 2020-11-20T11:35:16.142 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.177 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.042) 0:01:38.625 ******* 2020-11-20T11:35:16.184 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T11:35:16.185 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.045) 0:01:38.671 ******* 2020-11-20T11:35:16.228 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.044) 0:01:38.715 ******* 2020-11-20T11:35:16.273 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:35:16.275 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.044) 0:01:38.760 ******* 2020-11-20T11:35:16.318 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.055) 0:01:38.816 ******* 2020-11-20T11:35:16.384 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.049) 0:01:38.865 ******* 2020-11-20T11:35:16.424 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.045) 0:01:38.910 ******* 2020-11-20T11:35:16.469 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T11:35:16.474 INFO:teuthology.task.ansible.out:skipping: [smithi186.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.506 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.043) 0:01:38.954 ******* 2020-11-20T11:35:16.512 INFO:teuthology.task.ansible.out:skipping: [smithi161.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T11:35:16.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:16 +0000 (0:00:00.042) 0:01:38.997 ******* 2020-11-20T11:35:16.670 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:35:16.672 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010886", "end": "2020-11-20 11:35:16.622834", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:35:16.611948", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:16.703 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009405", "end": "2020-11-20 11:35:16.920162", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 11:35:16.910757", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:16.789 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005777", "end": "2020-11-20 11:35:16.749748", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:35:16.743971", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:16.911 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003828", "end": "2020-11-20 11:35:16.873144", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:35:16.869316", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:16.966 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005980", "end": "2020-11-20 11:35:17.060400", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 11:35:17.054420", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:17.082 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005445", "end": "2020-11-20 11:35:17.306349", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 11:35:17.300904", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:17.199 INFO:teuthology.task.ansible.out:ok: [smithi186.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026465", "end": "2020-11-20 11:35:17.019535", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:35:16.993070", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:17.335 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:17 +0000 (0:00:00.786) 0:01:39.783 ******* 2020-11-20T11:35:17.363 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:35:17.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:17 +0000 (0:00:00.066) 0:01:39.850 ******* 2020-11-20T11:35:17.419 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T11:35:17.420 INFO:teuthology.task.ansible.out:ok: [smithi161.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.207947", "end": "2020-11-20 11:35:17.644447", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 11:35:17.436500", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T11:35:17.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:17 +0000 (0:00:00.056) 0:01:39.907 ******* 2020-11-20T11:35:17.485 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T11:35:17.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 11:35:17 +0000 (0:00:00.062) 0:01:39.969 ******* 2020-11-20T11:35:17.558 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T11:35:17.560 INFO:teuthology.task.ansible.out:changed: [smithi186.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:35:17.663 INFO:teuthology.task.ansible.out:changed: [smithi161.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-11-20T11:35:17.779 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T11:35:17.783 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-11-20T11:35:17.787 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2020-11-20T11:35:17.788 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi161.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=182 rescued=0 ignored=1 smithi186.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=182 rescued=0 ignored=1 Friday 20 November 2020 11:35:17 +0000 (0:00:00.266) 0:01:40.235 ******* =============================================================================== testnode : Ensure packages are not present. ----------------------------- 8.16s testnode : Install packages --------------------------------------------- 8.00s testnode : Zap all non-root disks --------------------------------------- 7.55s common : Check for docker ----------------------------------------------- 3.78s common : Update apt cache ----------------------------------------------- 3.37s testnode : Update apt cache. -------------------------------------------- 2.42s testnode : Install apt keys --------------------------------------------- 1.67s Gathering Facts --------------------------------------------------------- 1.66s common : Install nrpe package and dependencies (Ubuntu/Fedora) ---------- 0.93s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.88s users : Create all admin users with sudo access. ------------------------ 0.88s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.86s common : Make sure smartmontools is installed --------------------------- 0.84s common : Install Kerberos Packages (Debian) ----------------------------- 0.83s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.79s Gathering Facts --------------------------------------------------------- 0.71s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.63s testnode : Blow away lingering OSD data and FSIDs ----------------------- 0.62s testnode : Inst 2020-11-20T11:35:17.790 INFO:teuthology.task.ansible.out:all packages via pip ------------------------------------- 0.58s ansible-managed : Add authorized keys for the ansible user. ------------- 0.57s 2020-11-20T11:35:18.108 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2020-11-20T11:35:18.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:35:18.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:35:18.179 INFO:teuthology.orchestra.run.smithi161:> true 2020-11-20T11:35:18.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T11:35:18.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T11:35:18.450 INFO:teuthology.orchestra.run.smithi186:> true 2020-11-20T11:35:18.655 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T11:35:18.665 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T11:35:18.666 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:35:18.666 INFO:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:35:18.719 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-20T11:35:18.719 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Command line: ntpd -gq 2020-11-20T11:35:18.720 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: proto: precision = 0.123 usec (-23) 2020-11-20T11:35:18.720 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-20T11:35:18.720 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: restrict ::: KOD does nothing without LIMITED. 2020-11-20T11:35:18.721 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen and drop on 0 v6wildcard [::]:123 2020-11-20T11:35:18.721 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-20T11:35:18.721 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-20T11:35:18.721 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-20T11:35:18.723 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen normally on 2 lo 127.0.0.1:123 2020-11-20T11:35:18.723 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2020-11-20T11:35:18.723 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen normally on 4 lo [::1]:123 2020-11-20T11:35:18.723 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2020-11-20T11:35:18.724 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:18 ntpd[5889]: Listening on routing socket on fd #22 for interface updates 2020-11-20T11:35:20.720 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:20 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:20 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:20 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:20.721 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:20 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:22.721 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:22.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:22.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:22.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:22.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:22.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:22.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:22.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:22 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:23.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:23.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:23.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:23.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:23.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:23.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:23.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:23.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:23 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:24.722 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:24.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:24.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:24.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:24.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:24.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:24.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:24.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:24 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:25.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:25.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:25.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:25.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:25.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:25.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:25.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:25.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:25 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:26.723 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:26.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:26.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:26.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:26.724 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-20T11:35:26.725 INFO:teuthology.orchestra.run.smithi161.stderr:20 Nov 11:35:26 ntpd[5889]: can't open /var/log/ntpstats/loopstats.20201120: Permission denied 2020-11-20T11:35:26.725 INFO:teuthology.orchestra.run.smithi161.stdout:20 Nov 11:35:26 ntpd[5889]: ntpd: time set -0.247171 s 2020-11-20T11:35:26.725 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time set -0.247171s 2020-11-20T11:35:26.794 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2020-11-20T11:35:26.794 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2020-11-20T11:35:26.795 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:26.795 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:26.795 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:26.795 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:26.796 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T11:35:26.797 INFO:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T11:35:26.854 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-11-20T11:35:26.854 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Command line: ntpd -gq 2020-11-20T11:35:26.856 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: proto: precision = 0.112 usec (-23) 2020-11-20T11:35:26.856 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-20T11:35:26.856 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: restrict ::: KOD does nothing without LIMITED. 2020-11-20T11:35:26.856 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen and drop on 0 v6wildcard [::]:123 2020-11-20T11:35:26.857 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-11-20T11:35:26.857 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen normally on 2 lo 127.0.0.1:123 2020-11-20T11:35:26.857 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen normally on 3 enp3s0f1 172.21.15.186:123 2020-11-20T11:35:26.857 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen normally on 4 lo [::1]:123 2020-11-20T11:35:26.857 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df5%5]:123 2020-11-20T11:35:26.858 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:26 ntpd[5863]: Listening on routing socket on fd #22 for interface updates 2020-11-20T11:35:26.858 INFO:teuthology.orchestra.run.smithi186.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-11-20T11:35:26.858 INFO:teuthology.orchestra.run.smithi186.stderr:restrict ::: KOD does nothing without LIMITED. 2020-11-20T11:35:27.855 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:27.855 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:27.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:27.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:27.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:27.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:27.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:27.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:27 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:29.855 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:29.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:29.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:29.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:29.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:29.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:29.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:29.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:29.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:29.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:29.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:29.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:29 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:31.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:31.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:31.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:31.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:31.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:31.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:31.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:31.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:31.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:31.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:31.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:31.859 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:31.859 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:31.859 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:31.859 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:31.859 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:31 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:33.855 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:33.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:33.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:33.856 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:33.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-11-20T11:35:33.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: can't open /var/log/ntpstats/rawstats.20201120: Permission denied 2020-11-20T11:35:33.857 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-11-20T11:35:33.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: can't open /var/log/ntpstats/peerstats.20201120: Permission denied 2020-11-20T11:35:33.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-11-20T11:35:33.858 INFO:teuthology.orchestra.run.smithi186.stderr:20 Nov 11:35:33 ntpd[5863]: can't open /var/log/ntpstats/loopstats.20201120: Permission denied 2020-11-20T11:35:33.859 INFO:teuthology.orchestra.run.smithi186.stdout:20 Nov 11:35:33 ntpd[5863]: ntpd: time slew +0.008712 s 2020-11-20T11:35:33.859 INFO:teuthology.orchestra.run.smithi186.stdout:ntpd: time slew +0.008712s 2020-11-20T11:35:33.906 INFO:teuthology.orchestra.run.smithi186.stdout: remote refid st t when poll reach delay offset jitter 2020-11-20T11:35:33.906 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================== 2020-11-20T11:35:33.906 INFO:teuthology.orchestra.run.smithi186.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:33.906 INFO:teuthology.orchestra.run.smithi186.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:33.907 INFO:teuthology.orchestra.run.smithi186.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:33.907 INFO:teuthology.orchestra.run.smithi186.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-11-20T11:35:33.907 INFO:teuthology.run_tasks:Running task install... 2020-11-20T11:35:33.916 DEBUG:teuthology.task.install:project ceph 2020-11-20T11:35:33.916 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T11:35:33.916 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T11:35:33.917 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T11:35:33.923 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T11:35:33.924 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T11:35:33.924 INFO:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2020-11-20T11:35:33.978 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2020-11-20T11:35:33.983 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:35:33.984 INFO:teuthology.orchestra.run.smithi186:> sudo lsb_release -is 2020-11-20T11:35:33.984 INFO:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2020-11-20T11:35:34.038 INFO:teuthology.orchestra.run.smithi186.stdout:Ubuntu 2020-11-20T11:35:34.043 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:35:34.044 INFO:teuthology.orchestra.run.smithi186:> sudo apt-key list | grep Ceph 2020-11-20T11:35:34.081 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-20T11:35:34.138 INFO:teuthology.orchestra.run.smithi186.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-11-20T11:35:34.139 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-20T11:35:34.139 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2020-11-20T11:35:34.140 INFO:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2020-11-20T11:35:34.194 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2020-11-20T11:35:34.196 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-11-20T11:35:34.196 INFO:teuthology.orchestra.run.smithi186.stdout:uid [ unknown] Ceph.com (release key) 2020-11-20T11:35:34.197 INFO:teuthology.orchestra.run.smithi186:> sudo lsb_release -is 2020-11-20T11:35:34.199 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:35:34.199 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-11-20T11:35:34.199 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-11-20T11:35:34.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:35:34.251 INFO:teuthology.orchestra.run.smithi186.stdout:Ubuntu 2020-11-20T11:35:34.256 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:35:34.257 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-11-20T11:35:34.257 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-11-20T11:35:34.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:35:34.380 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default/ 2020-11-20T11:35:34.380 INFO:teuthology.task.install.deb:Package version is 16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:35:34.420 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default/ 2020-11-20T11:35:34.420 INFO:teuthology.task.install.deb:Package version is 16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:35:34.521 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:35:34.522 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-20T11:35:34.527 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-20T11:35:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:35:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:35:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:172 bytes copied, 6.0423e-05 s, 2.8 MB/s 2020-11-20T11:35:34.537 INFO:teuthology.orchestra.run.smithi161:> sudo apt-get update 2020-11-20T11:35:34.541 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:35:34.542 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-20T11:35:34.547 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-11-20T11:35:34.556 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:35:34.556 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:35:34.557 INFO:teuthology.orchestra.run.smithi186.stderr:172 bytes copied, 6.1442e-05 s, 2.8 MB/s 2020-11-20T11:35:34.558 INFO:teuthology.orchestra.run.smithi186:> sudo apt-get update 2020-11-20T11:35:34.809 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic InRelease 2020-11-20T11:35:35.040 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic InRelease 2020-11-20T11:35:35.041 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-20T11:35:35.041 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:35:35.042 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-11-20T11:35:35.042 INFO:teuthology.orchestra.run.smithi186.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-20T11:35:35.042 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.1 kB] 2020-11-20T11:35:35.043 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-20T11:35:35.043 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,964 B] 2020-11-20T11:35:35.044 INFO:teuthology.orchestra.run.smithi186.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-20T11:35:35.044 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-11-20T11:35:35.044 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-11-20T11:35:35.045 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-11-20T11:35:35.045 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic Release.gpg 2020-11-20T11:35:35.046 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 Packages [16.1 kB] 2020-11-20T11:35:35.046 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-11-20T11:35:35.046 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,964 B] 2020-11-20T11:35:35.047 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-11-20T11:35:35.432 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 26.8 kB in 1s (38.5 kB/s) 2020-11-20T11:35:35.437 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 26.8 kB in 1s (39.3 kB/s) 2020-11-20T11:35:36.658 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:35:36.674 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:35:36.707 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-7397-gb86e691b-1bionic cephadm=16.0.0-7397-gb86e691b-1bionic ceph-mds=16.0.0-7397-gb86e691b-1bionic ceph-mgr=16.0.0-7397-gb86e691b-1bionic ceph-common=16.0.0-7397-gb86e691b-1bionic ceph-fuse=16.0.0-7397-gb86e691b-1bionic ceph-test=16.0.0-7397-gb86e691b-1bionic radosgw=16.0.0-7397-gb86e691b-1bionic python3-rados=16.0.0-7397-gb86e691b-1bionic python3-rgw=16.0.0-7397-gb86e691b-1bionic python3-cephfs=16.0.0-7397-gb86e691b-1bionic python3-rbd=16.0.0-7397-gb86e691b-1bionic libcephfs2=16.0.0-7397-gb86e691b-1bionic libcephfs-dev=16.0.0-7397-gb86e691b-1bionic librados2=16.0.0-7397-gb86e691b-1bionic librbd1=16.0.0-7397-gb86e691b-1bionic rbd-fuse=16.0.0-7397-gb86e691b-1bionic python3-cephfs=16.0.0-7397-gb86e691b-1bionic cephfs-shell=16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:35:36.722 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.0.0-7397-gb86e691b-1bionic cephadm=16.0.0-7397-gb86e691b-1bionic ceph-mds=16.0.0-7397-gb86e691b-1bionic ceph-mgr=16.0.0-7397-gb86e691b-1bionic ceph-common=16.0.0-7397-gb86e691b-1bionic ceph-fuse=16.0.0-7397-gb86e691b-1bionic ceph-test=16.0.0-7397-gb86e691b-1bionic radosgw=16.0.0-7397-gb86e691b-1bionic python3-rados=16.0.0-7397-gb86e691b-1bionic python3-rgw=16.0.0-7397-gb86e691b-1bionic python3-cephfs=16.0.0-7397-gb86e691b-1bionic python3-rbd=16.0.0-7397-gb86e691b-1bionic libcephfs2=16.0.0-7397-gb86e691b-1bionic libcephfs-dev=16.0.0-7397-gb86e691b-1bionic librados2=16.0.0-7397-gb86e691b-1bionic librbd1=16.0.0-7397-gb86e691b-1bionic rbd-fuse=16.0.0-7397-gb86e691b-1bionic python3-cephfs=16.0.0-7397-gb86e691b-1bionic cephfs-shell=16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:35:36.795 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:35:36.811 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:35:37.023 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:35:37.024 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:35:37.065 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:35:37.066 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:35:37.188 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2020-11-20T11:35:37.189 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2020-11-20T11:35:37.190 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2020-11-20T11:35:37.190 INFO:teuthology.orchestra.run.smithi161.stdout: libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-20T11:35:37.192 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-11-20T11:35:37.192 INFO:teuthology.orchestra.run.smithi161.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-11-20T11:35:37.192 INFO:teuthology.orchestra.run.smithi161.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-20T11:35:37.192 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-11-20T11:35:37.192 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-11-20T11:35:37.193 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-11-20T11:35:37.193 INFO:teuthology.orchestra.run.smithi161.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-11-20T11:35:37.193 INFO:teuthology.orchestra.run.smithi161.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-11-20T11:35:37.193 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-11-20T11:35:37.193 INFO:teuthology.orchestra.run.smithi161.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-11-20T11:35:37.194 INFO:teuthology.orchestra.run.smithi161.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-11-20T11:35:37.194 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-11-20T11:35:37.194 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-11-20T11:35:37.194 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-11-20T11:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-11-20T11:35:37.196 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2020-11-20T11:35:37.196 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-11-20T11:35:37.196 INFO:teuthology.orchestra.run.smithi161.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-11-20T11:35:37.196 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-11-20T11:35:37.196 INFO:teuthology.orchestra.run.smithi161.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-11-20T11:35:37.197 INFO:teuthology.orchestra.run.smithi161.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-11-20T11:35:37.197 INFO:teuthology.orchestra.run.smithi161.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-11-20T11:35:37.197 INFO:teuthology.orchestra.run.smithi161.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-11-20T11:35:37.197 INFO:teuthology.orchestra.run.smithi161.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-11-20T11:35:37.197 INFO:teuthology.orchestra.run.smithi161.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-11-20T11:35:37.198 INFO:teuthology.orchestra.run.smithi161.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-11-20T11:35:37.198 INFO:teuthology.orchestra.run.smithi161.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-11-20T11:35:37.198 INFO:teuthology.orchestra.run.smithi161.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-11-20T11:35:37.198 INFO:teuthology.orchestra.run.smithi161.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-11-20T11:35:37.199 INFO:teuthology.orchestra.run.smithi161.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-11-20T11:35:37.199 INFO:teuthology.orchestra.run.smithi161.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-11-20T11:35:37.231 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2020-11-20T11:35:37.231 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2020-11-20T11:35:37.232 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2020-11-20T11:35:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2020-11-20T11:35:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli 2020-11-20T11:35:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2020-11-20T11:35:37.233 INFO:teuthology.orchestra.run.smithi186.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-20T11:35:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-11-20T11:35:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-11-20T11:35:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-11-20T11:35:37.234 INFO:teuthology.orchestra.run.smithi186.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-11-20T11:35:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-11-20T11:35:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-11-20T11:35:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-11-20T11:35:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-11-20T11:35:37.235 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-11-20T11:35:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-11-20T11:35:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-11-20T11:35:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-11-20T11:35:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-11-20T11:35:37.236 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-11-20T11:35:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-11-20T11:35:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-11-20T11:35:37.237 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-11-20T11:35:37.237 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2020-11-20T11:35:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-11-20T11:35:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-11-20T11:35:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-11-20T11:35:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-11-20T11:35:37.238 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-11-20T11:35:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-11-20T11:35:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-11-20T11:35:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-11-20T11:35:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-11-20T11:35:37.239 INFO:teuthology.orchestra.run.smithi186.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-11-20T11:35:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-11-20T11:35:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-11-20T11:35:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-11-20T11:35:37.240 INFO:teuthology.orchestra.run.smithi186.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-11-20T11:35:37.241 INFO:teuthology.orchestra.run.smithi186.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-11-20T11:35:37.297 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2020-11-20T11:35:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-11-20T11:35:37.297 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2020-11-20T11:35:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm 2020-11-20T11:35:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-shell jq libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 2020-11-20T11:35:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-11-20T11:35:37.298 INFO:teuthology.orchestra.run.smithi161.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-11-20T11:35:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-11-20T11:35:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-20T11:35:37.299 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-11-20T11:35:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-backend python3-cherrypy3 python3-cmd2 python3-colorama 2020-11-20T11:35:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-11-20T11:35:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-jinja2 2020-11-20T11:35:37.301 INFO:teuthology.orchestra.run.smithi161.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2020-11-20T11:35:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-11-20T11:35:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-11-20T11:35:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-11-20T11:35:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-11-20T11:35:37.302 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-11-20T11:35:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-11-20T11:35:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-11-20T11:35:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-11-20T11:35:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-11-20T11:35:37.303 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-11-20T11:35:37.304 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-11-20T11:35:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-11-20T11:35:37.305 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-11-20T11:35:37.306 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2020-11-20T11:35:37.306 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 librbd1 2020-11-20T11:35:37.337 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2020-11-20T11:35:37.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-11-20T11:35:37.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2020-11-20T11:35:37.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm 2020-11-20T11:35:37.339 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell jq libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 2020-11-20T11:35:37.340 INFO:teuthology.orchestra.run.smithi186.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-11-20T11:35:37.340 INFO:teuthology.orchestra.run.smithi186.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-11-20T11:35:37.340 INFO:teuthology.orchestra.run.smithi186.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-11-20T11:35:37.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-11-20T11:35:37.341 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2020-11-20T11:35:37.341 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-backend python3-cherrypy3 python3-cmd2 python3-colorama 2020-11-20T11:35:37.341 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography python3-cycler python3-dateutil python3-decorator 2020-11-20T11:35:37.341 INFO:teuthology.orchestra.run.smithi186.stdout: python3-fasteners python3-html5lib python3-httplib2 python3-jinja2 2020-11-20T11:35:37.342 INFO:teuthology.orchestra.run.smithi186.stdout: python3-joblib python3-json-pointer python3-jsonpatch python3-jwt 2020-11-20T11:35:37.342 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2020-11-20T11:35:37.342 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-11-20T11:35:37.342 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-11-20T11:35:37.342 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-11-20T11:35:37.343 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-11-20T11:35:37.343 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-11-20T11:35:37.343 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-11-20T11:35:37.343 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-11-20T11:35:37.343 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-11-20T11:35:37.344 INFO:teuthology.orchestra.run.smithi186.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-11-20T11:35:37.344 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-11-20T11:35:37.344 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-11-20T11:35:37.344 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-11-20T11:35:37.345 INFO:teuthology.orchestra.run.smithi186.stdout:The following packages will be upgraded: 2020-11-20T11:35:37.345 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 librbd1 2020-11-20T11:35:37.459 INFO:teuthology.orchestra.run.smithi161.stdout:2 upgraded, 114 newly installed, 0 to remove and 20 not upgraded. 2020-11-20T11:35:37.459 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 168 MB of archives. 2020-11-20T11:35:37.460 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 782 MB of additional disk space will be used. 2020-11-20T11:35:37.460 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 16.0.0-7397-gb86e691b-1bionic [1,921 kB] 2020-11-20T11:35:37.486 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-11-20T11:35:37.507 INFO:teuthology.orchestra.run.smithi186.stdout:2 upgraded, 114 newly installed, 0 to remove and 20 not upgraded. 2020-11-20T11:35:37.508 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 168 MB of archives. 2020-11-20T11:35:37.508 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 782 MB of additional disk space will be used. 2020-11-20T11:35:37.508 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 16.0.0-7397-gb86e691b-1bionic [1,921 kB] 2020-11-20T11:35:37.531 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-11-20T11:35:37.632 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 16.0.0-7397-gb86e691b-1bionic [3,160 kB] 2020-11-20T11:35:37.765 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 16.0.0-7397-gb86e691b-1bionic [481 kB] 2020-11-20T11:35:37.769 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-11-20T11:35:37.779 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-11-20T11:35:37.780 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 16.0.0-7397-gb86e691b-1bionic [332 kB] 2020-11-20T11:35:37.785 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-11-20T11:35:37.786 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 16.0.0-7397-gb86e691b-1bionic [3,160 kB] 2020-11-20T11:35:37.794 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-11-20T11:35:37.802 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 16.0.0-7397-gb86e691b-1bionic [20.6 kB] 2020-11-20T11:35:37.803 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 16.0.0-7397-gb86e691b-1bionic [168 kB] 2020-11-20T11:35:37.805 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-11-20T11:35:37.805 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-20T11:35:37.809 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 16.0.0-7397-gb86e691b-1bionic [27.7 kB] 2020-11-20T11:35:37.810 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 16.0.0-7397-gb86e691b-1bionic [330 kB] 2020-11-20T11:35:37.814 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-11-20T11:35:37.820 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 16.0.0-7397-gb86e691b-1bionic [3,179 kB] 2020-11-20T11:35:37.822 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-11-20T11:35:37.951 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-11-20T11:35:37.963 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-20T11:35:37.978 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-11-20T11:35:37.978 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-11-20T11:35:37.979 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 16.0.0-7397-gb86e691b-1bionic [99.1 kB] 2020-11-20T11:35:37.980 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 16.0.0-7397-gb86e691b-1bionic [414 kB] 2020-11-20T11:35:37.981 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-11-20T11:35:37.993 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 16.0.0-7397-gb86e691b-1bionic [20.7 MB] 2020-11-20T11:35:37.994 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-11-20T11:35:38.054 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-20T11:35:38.056 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-20T11:35:38.081 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-20T11:35:38.085 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-11-20T11:35:38.087 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-11-20T11:35:38.090 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-11-20T11:35:38.099 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-11-20T11:35:38.109 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-11-20T11:35:38.115 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-11-20T11:35:38.116 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2020-11-20T11:35:38.122 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-11-20T11:35:38.123 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 16.0.0-7397-gb86e691b-1bionic [481 kB] 2020-11-20T11:35:38.129 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-11-20T11:35:38.134 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-11-20T11:35:38.137 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-11-20T11:35:38.140 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-11-20T11:35:38.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2020-11-20T11:35:38.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-11-20T11:35:38.176 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-11-20T11:35:38.178 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 16.0.0-7397-gb86e691b-1bionic [332 kB] 2020-11-20T11:35:38.195 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-20T11:35:38.204 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-11-20T11:35:38.204 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-11-20T11:35:38.205 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-11-20T11:35:38.206 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-11-20T11:35:38.207 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-20T11:35:38.215 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-11-20T11:35:38.225 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-11-20T11:35:38.225 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-11-20T11:35:38.226 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-11-20T11:35:38.227 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-11-20T11:35:38.229 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 16.0.0-7397-gb86e691b-1bionic [20.6 kB] 2020-11-20T11:35:38.231 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 16.0.0-7397-gb86e691b-1bionic [168 kB] 2020-11-20T11:35:38.237 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 16.0.0-7397-gb86e691b-1bionic [27.7 kB] 2020-11-20T11:35:38.238 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 16.0.0-7397-gb86e691b-1bionic [330 kB] 2020-11-20T11:35:38.274 INFO:teuthology.orchestra.run.smithi186.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-11-20T11:35:38.275 INFO:teuthology.orchestra.run.smithi186.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-20T11:35:38.277 INFO:teuthology.orchestra.run.smithi186.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-11-20T11:35:38.280 INFO:teuthology.orchestra.run.smithi186.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-11-20T11:35:38.292 INFO:teuthology.orchestra.run.smithi186.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 16.0.0-7397-gb86e691b-1bionic [3,179 kB] 2020-11-20T11:35:38.294 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-11-20T11:35:38.297 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-11-20T11:35:38.298 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-11-20T11:35:38.298 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-11-20T11:35:38.300 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-11-20T11:35:38.354 INFO:teuthology.orchestra.run.smithi186.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-11-20T11:35:38.355 INFO:teuthology.orchestra.run.smithi186.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-20T11:35:38.373 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-11-20T11:35:38.374 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-11-20T11:35:38.375 INFO:teuthology.orchestra.run.smithi186.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-20T11:35:38.375 INFO:teuthology.orchestra.run.smithi186.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-11-20T11:35:38.376 INFO:teuthology.orchestra.run.smithi186.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-11-20T11:35:38.377 INFO:teuthology.orchestra.run.smithi186.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-11-20T11:35:38.389 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-11-20T11:35:38.390 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-11-20T11:35:38.390 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-11-20T11:35:38.434 INFO:teuthology.orchestra.run.smithi186.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-20T11:35:38.442 INFO:teuthology.orchestra.run.smithi186.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-11-20T11:35:38.446 INFO:teuthology.orchestra.run.smithi186.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-11-20T11:35:38.446 INFO:teuthology.orchestra.run.smithi186.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-11-20T11:35:38.453 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-11-20T11:35:38.457 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-11-20T11:35:38.462 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-11-20T11:35:38.467 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-11-20T11:35:38.467 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-11-20T11:35:38.514 INFO:teuthology.orchestra.run.smithi186.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-11-20T11:35:38.532 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-11-20T11:35:38.598 INFO:teuthology.orchestra.run.smithi186.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-11-20T11:35:38.598 INFO:teuthology.orchestra.run.smithi186.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-11-20T11:35:38.622 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-11-20T11:35:38.623 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-11-20T11:35:38.653 INFO:teuthology.orchestra.run.smithi186.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 16.0.0-7397-gb86e691b-1bionic [99.1 kB] 2020-11-20T11:35:38.656 INFO:teuthology.orchestra.run.smithi186.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 16.0.0-7397-gb86e691b-1bionic [414 kB] 2020-11-20T11:35:38.728 INFO:teuthology.orchestra.run.smithi186.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 16.0.0-7397-gb86e691b-1bionic [20.7 MB] 2020-11-20T11:35:38.876 INFO:teuthology.orchestra.run.smithi186.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-11-20T11:35:38.892 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-11-20T11:35:38.914 INFO:teuthology.orchestra.run.smithi186.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-11-20T11:35:38.915 INFO:teuthology.orchestra.run.smithi186.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-11-20T11:35:38.956 INFO:teuthology.orchestra.run.smithi186.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-11-20T11:35:38.957 INFO:teuthology.orchestra.run.smithi186.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-11-20T11:35:38.958 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-11-20T11:35:38.958 INFO:teuthology.orchestra.run.smithi186.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-11-20T11:35:38.959 INFO:teuthology.orchestra.run.smithi186.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-11-20T11:35:38.960 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-11-20T11:35:38.961 INFO:teuthology.orchestra.run.smithi186.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-11-20T11:35:38.961 INFO:teuthology.orchestra.run.smithi186.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-11-20T11:35:38.962 INFO:teuthology.orchestra.run.smithi186.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-11-20T11:35:38.962 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 16.0.0-7397-gb86e691b-1bionic [5,571 kB] 2020-11-20T11:35:38.976 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-11-20T11:35:38.977 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-11-20T11:35:38.977 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-11-20T11:35:38.978 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-11-20T11:35:38.979 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-11-20T11:35:38.979 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-11-20T11:35:38.980 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-11-20T11:35:39.037 INFO:teuthology.orchestra.run.smithi186.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-11-20T11:35:39.040 INFO:teuthology.orchestra.run.smithi186.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-11-20T11:35:39.050 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-11-20T11:35:39.051 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-11-20T11:35:39.117 INFO:teuthology.orchestra.run.smithi186.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-20T11:35:39.118 INFO:teuthology.orchestra.run.smithi186.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-20T11:35:39.124 INFO:teuthology.orchestra.run.smithi186.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-11-20T11:35:39.124 INFO:teuthology.orchestra.run.smithi186.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-11-20T11:35:39.125 INFO:teuthology.orchestra.run.smithi186.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-20T11:35:39.128 INFO:teuthology.orchestra.run.smithi186.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-20T11:35:39.130 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-11-20T11:35:39.130 INFO:teuthology.orchestra.run.smithi186.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-20T11:35:39.131 INFO:teuthology.orchestra.run.smithi186.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-20T11:35:39.131 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-11-20T11:35:39.137 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-11-20T11:35:39.137 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-11-20T11:35:39.138 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-11-20T11:35:39.141 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-11-20T11:35:39.142 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-11-20T11:35:39.143 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-11-20T11:35:39.196 INFO:teuthology.orchestra.run.smithi186.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-20T11:35:39.200 INFO:teuthology.orchestra.run.smithi186.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-20T11:35:39.209 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-11-20T11:35:39.213 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 16.0.0-7397-gb86e691b-1bionic [165 kB] 2020-11-20T11:35:39.215 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-11-20T11:35:39.218 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 16.0.0-7397-gb86e691b-1bionic [1,365 kB] 2020-11-20T11:35:39.276 INFO:teuthology.orchestra.run.smithi186.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-11-20T11:35:39.277 INFO:teuthology.orchestra.run.smithi186.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-20T11:35:39.281 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 16.0.0-7397-gb86e691b-1bionic [6,660 kB] 2020-11-20T11:35:39.283 INFO:teuthology.orchestra.run.smithi186.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-20T11:35:39.284 INFO:teuthology.orchestra.run.smithi186.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-20T11:35:39.284 INFO:teuthology.orchestra.run.smithi186.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-20T11:35:39.285 INFO:teuthology.orchestra.run.smithi186.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-20T11:35:39.287 INFO:teuthology.orchestra.run.smithi186.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-20T11:35:39.288 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-11-20T11:35:39.289 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-11-20T11:35:39.290 INFO:teuthology.orchestra.run.smithi186.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-11-20T11:35:39.296 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-11-20T11:35:39.297 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-11-20T11:35:39.297 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-11-20T11:35:39.298 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-11-20T11:35:39.300 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-11-20T11:35:39.302 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-11-20T11:35:39.356 INFO:teuthology.orchestra.run.smithi186.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-11-20T11:35:39.356 INFO:teuthology.orchestra.run.smithi186.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-11-20T11:35:39.367 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-11-20T11:35:39.368 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-11-20T11:35:39.436 INFO:teuthology.orchestra.run.smithi186.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-11-20T11:35:39.438 INFO:teuthology.orchestra.run.smithi186.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-11-20T11:35:39.447 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-11-20T11:35:39.450 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-11-20T11:35:39.460 INFO:teuthology.orchestra.run.smithi186.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-11-20T11:35:39.461 INFO:teuthology.orchestra.run.smithi186.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-11-20T11:35:39.471 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-11-20T11:35:39.471 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-11-20T11:35:39.597 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 16.0.0-7397-gb86e691b-1bionic [24.6 MB] 2020-11-20T11:35:39.600 INFO:teuthology.orchestra.run.smithi186.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-11-20T11:35:39.601 INFO:teuthology.orchestra.run.smithi186.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-11-20T11:35:39.603 INFO:teuthology.orchestra.run.smithi186.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-11-20T11:35:39.610 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-11-20T11:35:39.611 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-11-20T11:35:39.612 INFO:teuthology.orchestra.run.smithi186.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-11-20T11:35:39.612 INFO:teuthology.orchestra.run.smithi186.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-11-20T11:35:39.613 INFO:teuthology.orchestra.run.smithi186.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-11-20T11:35:39.613 INFO:teuthology.orchestra.run.smithi186.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-11-20T11:35:39.613 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-11-20T11:35:39.614 INFO:teuthology.orchestra.run.smithi186.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-11-20T11:35:39.615 INFO:teuthology.orchestra.run.smithi186.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-11-20T11:35:39.619 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-11-20T11:35:39.620 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-11-20T11:35:39.620 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-11-20T11:35:39.621 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-11-20T11:35:39.622 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-11-20T11:35:39.622 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-11-20T11:35:40.738 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 16.0.0-7397-gb86e691b-1bionic [3,808 B] 2020-11-20T11:35:40.738 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 16.0.0-7397-gb86e691b-1bionic [566 kB] 2020-11-20T11:35:40.776 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 16.0.0-7397-gb86e691b-1bionic [1,948 kB] 2020-11-20T11:35:40.863 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 16.0.0-7397-gb86e691b-1bionic [51.7 kB] 2020-11-20T11:35:40.864 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 16.0.0-7397-gb86e691b-1bionic [56.4 kB] 2020-11-20T11:35:40.866 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 16.0.0-7397-gb86e691b-1bionic [2,878 kB] 2020-11-20T11:35:40.993 INFO:teuthology.orchestra.run.smithi186.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 16.0.0-7397-gb86e691b-1bionic [5,571 kB] 2020-11-20T11:35:41.006 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 16.0.0-7397-gb86e691b-1bionic [7,883 kB] 2020-11-20T11:35:41.376 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 16.0.0-7397-gb86e691b-1bionic [3,928 B] 2020-11-20T11:35:41.377 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 16.0.0-7397-gb86e691b-1bionic [22.3 kB] 2020-11-20T11:35:41.378 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 16.0.0-7397-gb86e691b-1bionic [49.7 MB] 2020-11-20T11:35:41.598 INFO:teuthology.orchestra.run.smithi186.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 16.0.0-7397-gb86e691b-1bionic [165 kB] 2020-11-20T11:35:41.603 INFO:teuthology.orchestra.run.smithi186.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 16.0.0-7397-gb86e691b-1bionic [1,365 kB] 2020-11-20T11:35:41.757 INFO:teuthology.orchestra.run.smithi186.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 16.0.0-7397-gb86e691b-1bionic [6,660 kB] 2020-11-20T11:35:42.480 INFO:teuthology.orchestra.run.smithi186.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 16.0.0-7397-gb86e691b-1bionic [24.6 MB] 2020-11-20T11:35:43.624 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 16.0.0-7397-gb86e691b-1bionic [17.0 kB] 2020-11-20T11:35:43.624 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 16.0.0-7397-gb86e691b-1bionic [19.5 kB] 2020-11-20T11:35:43.625 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 16.0.0-7397-gb86e691b-1bionic [9,861 kB] 2020-11-20T11:35:44.054 INFO:teuthology.orchestra.run.smithi161.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 16.0.0-7397-gb86e691b-1bionic [77.3 kB] 2020-11-20T11:35:44.609 INFO:teuthology.orchestra.run.smithi186.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 16.0.0-7397-gb86e691b-1bionic [3,808 B] 2020-11-20T11:35:44.609 INFO:teuthology.orchestra.run.smithi186.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 16.0.0-7397-gb86e691b-1bionic [566 kB] 2020-11-20T11:35:44.631 INFO:teuthology.orchestra.run.smithi186.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 16.0.0-7397-gb86e691b-1bionic [1,948 kB] 2020-11-20T11:35:44.724 INFO:teuthology.orchestra.run.smithi186.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 16.0.0-7397-gb86e691b-1bionic [51.7 kB] 2020-11-20T11:35:44.727 INFO:teuthology.orchestra.run.smithi186.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 16.0.0-7397-gb86e691b-1bionic [56.4 kB] 2020-11-20T11:35:44.728 INFO:teuthology.orchestra.run.smithi186.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 16.0.0-7397-gb86e691b-1bionic [2,878 kB] 2020-11-20T11:35:44.751 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 168 MB in 7s (25.0 MB/s) 2020-11-20T11:35:44.857 INFO:teuthology.orchestra.run.smithi186.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 16.0.0-7397-gb86e691b-1bionic [7,883 kB] 2020-11-20T11:35:44.897 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyparsing. 2020-11-20T11:35:44.945 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137607 files and directories currently installed.) 2020-11-20T11:35:44.948 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-11-20T11:35:45.004 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-20T11:35:45.187 INFO:teuthology.orchestra.run.smithi186.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 16.0.0-7397-gb86e691b-1bionic [3,928 B] 2020-11-20T11:35:45.187 INFO:teuthology.orchestra.run.smithi186.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 16.0.0-7397-gb86e691b-1bionic [22.3 kB] 2020-11-20T11:35:45.188 INFO:teuthology.orchestra.run.smithi186.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 16.0.0-7397-gb86e691b-1bionic [49.7 MB] 2020-11-20T11:35:45.240 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2020-11-20T11:35:45.256 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-11-20T11:35:45.290 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-11-20T11:35:45.609 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2020-11-20T11:35:45.624 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-11-20T11:35:45.667 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-11-20T11:35:45.987 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-uritemplate. 2020-11-20T11:35:46.001 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-20T11:35:46.045 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-11-20T11:35:46.323 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-20T11:35:46.339 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-20T11:35:46.406 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-20T11:35:46.749 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-librbd1_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:46.902 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (16.0.0-7397-gb86e691b-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2020-11-20T11:35:47.131 INFO:teuthology.orchestra.run.smithi186.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 16.0.0-7397-gb86e691b-1bionic [17.0 kB] 2020-11-20T11:35:47.131 INFO:teuthology.orchestra.run.smithi186.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 16.0.0-7397-gb86e691b-1bionic [19.5 kB] 2020-11-20T11:35:47.132 INFO:teuthology.orchestra.run.smithi186.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 16.0.0-7397-gb86e691b-1bionic [9,861 kB] 2020-11-20T11:35:47.412 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-librados2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:47.423 INFO:teuthology.orchestra.run.smithi186.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 16.0.0-7397-gb86e691b-1bionic [77.3 kB] 2020-11-20T11:35:47.514 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (16.0.0-7397-gb86e691b-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2020-11-20T11:35:48.109 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2020-11-20T11:35:48.126 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libcephfs2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:48.137 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 168 MB in 10s (16.7 MB/s) 2020-11-20T11:35:48.168 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:48.288 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyparsing. 2020-11-20T11:35:48.337 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137607 files and directories currently installed.) 2020-11-20T11:35:48.340 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-11-20T11:35:48.379 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-20T11:35:48.480 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2020-11-20T11:35:48.495 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-python3-rados_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:48.537 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:48.689 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyperclip. 2020-11-20T11:35:48.705 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-11-20T11:35:48.748 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-11-20T11:35:48.881 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-11-20T11:35:48.894 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:35:48.923 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:49.103 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cmd2. 2020-11-20T11:35:49.115 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-11-20T11:35:49.151 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-11-20T11:35:49.211 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2020-11-20T11:35:49.224 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-python3-cephfs_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:49.267 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:49.403 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-uritemplate. 2020-11-20T11:35:49.417 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-11-20T11:35:49.453 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-11-20T11:35:49.603 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2020-11-20T11:35:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-python3-ceph-common_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:35:49.662 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:49.773 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-11-20T11:35:49.788 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-11-20T11:35:49.873 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-20T11:35:49.998 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2020-11-20T11:35:50.012 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-11-20T11:35:50.056 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-11-20T11:35:50.216 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../005-librbd1_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:50.292 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2020-11-20T11:35:50.305 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-python3-rbd_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:50.342 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:50.343 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librbd1 (16.0.0-7397-gb86e691b-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2020-11-20T11:35:50.678 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-20T11:35:50.692 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-20T11:35:50.736 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-20T11:35:50.852 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../006-librados2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:50.981 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librados2 (16.0.0-7397-gb86e691b-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2020-11-20T11:35:51.047 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-11-20T11:35:51.065 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-11-20T11:35:51.105 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-20T11:35:51.433 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2020-11-20T11:35:51.448 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-librgw2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:51.491 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:51.643 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs2. 2020-11-20T11:35:51.657 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../007-libcephfs2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:51.701 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:51.995 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rados. 2020-11-20T11:35:52.011 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../008-python3-rados_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:52.018 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2020-11-20T11:35:52.031 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-rgw_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:52.045 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rados (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:52.071 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:52.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-20T11:35:52.395 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-20T11:35:52.398 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-11-20T11:35:52.412 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:35:52.431 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-20T11:35:52.457 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-argparse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:52.734 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-20T11:35:52.749 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-20T11:35:52.760 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cephfs. 2020-11-20T11:35:52.773 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../010-python3-cephfs_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:52.784 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-20T11:35:52.809 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cephfs (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:53.112 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0. 2020-11-20T11:35:53.112 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-ceph-common. 2020-11-20T11:35:53.126 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-11-20T11:35:53.127 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../011-python3-ceph-common_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:35:53.162 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:53.162 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-20T11:35:53.448 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-prettytable. 2020-11-20T11:35:53.463 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-11-20T11:35:53.464 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2020-11-20T11:35:53.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-libradosstriper1_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:53.507 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-11-20T11:35:53.523 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:53.767 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rbd. 2020-11-20T11:35:53.782 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../013-python3-rbd_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:53.826 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rbd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:53.977 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2020-11-20T11:35:53.990 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-ceph-common_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:54.035 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:54.170 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-11-20T11:35:54.185 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-11-20T11:35:54.229 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-20T11:35:54.531 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-11-20T11:35:54.546 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-11-20T11:35:54.582 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-20T11:35:54.917 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package librgw2. 2020-11-20T11:35:54.932 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../016-librgw2_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:54.976 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking librgw2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:55.528 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rgw. 2020-11-20T11:35:55.543 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../017-python3-rgw_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:55.593 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:55.881 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2020-11-20T11:35:55.896 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-ceph-base_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:55.905 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-11-20T11:35:55.919 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-11-20T11:35:55.948 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:55.956 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-20T11:35:56.234 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-11-20T11:35:56.248 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-11-20T11:35:56.292 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-11-20T11:35:56.645 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package liboath0. 2020-11-20T11:35:56.660 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-11-20T11:35:56.703 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-11-20T11:35:56.869 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-dateutil. 2020-11-20T11:35:56.882 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-11-20T11:35:56.919 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-11-20T11:35:56.997 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libradosstriper1. 2020-11-20T11:35:57.013 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../021-libradosstriper1_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:57.047 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libradosstriper1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:57.238 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asn1crypto. 2020-11-20T11:35:57.253 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-11-20T11:35:57.297 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-11-20T11:35:57.451 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-common. 2020-11-20T11:35:57.464 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../022-ceph-common_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:57.509 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cffi-backend. 2020-11-20T11:35:57.582 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-11-20T11:35:57.624 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-11-20T11:35:57.927 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cryptography. 2020-11-20T11:35:57.942 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2020-11-20T11:35:57.989 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-20T11:35:58.372 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2020-11-20T11:35:58.386 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-20T11:35:58.430 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-11-20T11:35:58.699 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-11-20T11:35:58.713 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:35:58.757 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:59.145 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2020-11-20T11:35:59.160 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-11-20T11:35:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-11-20T11:35:59.364 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-base. 2020-11-20T11:35:59.377 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../023-ceph-base_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:35:59.423 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-base (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:35:59.623 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2020-11-20T11:35:59.637 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-11-20T11:35:59.681 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-11-20T11:36:00.018 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jwt. 2020-11-20T11:36:00.034 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-11-20T11:36:00.076 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-11-20T11:36:00.335 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-dateutil. 2020-11-20T11:36:00.349 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-11-20T11:36:00.386 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-11-20T11:36:00.429 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2020-11-20T11:36:00.444 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-11-20T11:36:00.495 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-11-20T11:36:00.746 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-asn1crypto. 2020-11-20T11:36:00.782 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2020-11-20T11:36:00.798 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-11-20T11:36:00.813 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-11-20T11:36:00.840 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-11-20T11:36:01.142 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2020-11-20T11:36:01.154 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-11-20T11:36:01.157 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-11-20T11:36:01.201 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-11-20T11:36:01.432 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cffi-backend. 2020-11-20T11:36:01.447 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-11-20T11:36:01.491 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-11-20T11:36:01.512 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2020-11-20T11:36:01.525 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-11-20T11:36:01.570 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-11-20T11:36:01.785 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cryptography. 2020-11-20T11:36:01.801 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2020-11-20T11:36:01.835 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-20T11:36:01.890 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2020-11-20T11:36:01.903 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-11-20T11:36:01.939 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-11-20T11:36:02.213 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-openssl. 2020-11-20T11:36:02.229 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-11-20T11:36:02.250 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2020-11-20T11:36:02.266 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-20T11:36:02.271 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-11-20T11:36:02.309 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-11-20T11:36:02.557 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-11-20T11:36:02.571 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:02.603 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bs4. 2020-11-20T11:36:02.607 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-modules-core (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:02.619 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-11-20T11:36:02.661 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-11-20T11:36:02.962 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-bcrypt. 2020-11-20T11:36:02.981 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-11-20T11:36:02.992 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2020-11-20T11:36:03.004 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-11-20T11:36:03.020 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-11-20T11:36:03.048 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-11-20T11:36:03.348 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cherrypy3. 2020-11-20T11:36:03.363 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-11-20T11:36:03.367 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2020-11-20T11:36:03.381 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-11-20T11:36:03.406 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-11-20T11:36:03.427 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-11-20T11:36:03.728 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2020-11-20T11:36:03.743 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-20T11:36:03.785 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jwt. 2020-11-20T11:36:03.786 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-20T11:36:03.799 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-11-20T11:36:03.843 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-11-20T11:36:04.131 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-20T11:36:04.145 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-20T11:36:04.146 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-logutils. 2020-11-20T11:36:04.160 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-11-20T11:36:04.189 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-20T11:36:04.204 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-11-20T11:36:04.516 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-markupsafe. 2020-11-20T11:36:04.532 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-11-20T11:36:04.574 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-11-20T11:36:04.742 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2020-11-20T11:36:04.758 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-11-20T11:36:04.800 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-11-20T11:36:04.876 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-mako. 2020-11-20T11:36:04.891 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-11-20T11:36:04.943 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-11-20T11:36:05.136 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2020-11-20T11:36:05.150 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-20T11:36:05.203 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-11-20T11:36:05.288 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplegeneric. 2020-11-20T11:36:05.302 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-11-20T11:36:05.346 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-11-20T11:36:05.556 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2020-11-20T11:36:05.570 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-11-20T11:36:05.614 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-11-20T11:36:05.658 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-singledispatch. 2020-11-20T11:36:05.672 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-11-20T11:36:05.716 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-11-20T11:36:06.002 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2020-11-20T11:36:06.017 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-20T11:36:06.018 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webob. 2020-11-20T11:36:06.032 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-11-20T11:36:06.068 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-20T11:36:06.105 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-11-20T11:36:06.412 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-bs4. 2020-11-20T11:36:06.427 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-11-20T11:36:06.438 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2020-11-20T11:36:06.452 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-ceph-mgr_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:06.471 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-11-20T11:36:06.505 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:06.834 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-waitress. 2020-11-20T11:36:06.847 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-11-20T11:36:06.899 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-11-20T11:36:06.949 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2020-11-20T11:36:06.964 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-ceph-mon_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:07.007 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:07.268 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tempita. 2020-11-20T11:36:07.283 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-11-20T11:36:07.327 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-11-20T11:36:07.646 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-paste. 2020-11-20T11:36:07.660 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-11-20T11:36:07.704 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-20T11:36:07.953 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2020-11-20T11:36:07.966 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-ceph-osd_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:08.019 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:08.033 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-11-20T11:36:08.047 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-11-20T11:36:08.091 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-11-20T11:36:08.385 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastedeploy. 2020-11-20T11:36:08.400 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-11-20T11:36:08.444 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-11-20T11:36:08.746 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webtest. 2020-11-20T11:36:08.760 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-11-20T11:36:08.804 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-11-20T11:36:09.149 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pecan. 2020-11-20T11:36:09.164 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-11-20T11:36:09.208 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-11-20T11:36:09.538 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-werkzeug. 2020-11-20T11:36:09.553 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-11-20T11:36:09.595 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-20T11:36:09.982 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr. 2020-11-20T11:36:09.996 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../048-ceph-mgr_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:10.048 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:10.543 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mon. 2020-11-20T11:36:10.556 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../049-ceph-mon_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:10.593 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mon (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:10.883 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2020-11-20T11:36:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-ceph_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:10.941 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:11.260 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2020-11-20T11:36:11.274 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-ceph-fuse_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:11.310 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:11.688 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2020-11-20T11:36:11.705 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-ceph-mds_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:11.747 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:12.230 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-osd. 2020-11-20T11:36:12.233 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2020-11-20T11:36:12.243 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../050-ceph-osd_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:12.248 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-cephadm_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:12.288 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-osd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:12.291 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:12.610 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2020-11-20T11:36:12.625 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-11-20T11:36:12.669 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-20T11:36:13.000 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-11-20T11:36:13.012 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:13.055 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:13.391 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2020-11-20T11:36:13.405 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-11-20T11:36:13.450 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-11-20T11:36:13.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2020-11-20T11:36:13.800 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-11-20T11:36:13.844 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-11-20T11:36:14.155 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-20T11:36:14.169 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:14.213 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:14.469 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph. 2020-11-20T11:36:14.483 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../051-ceph_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:14.527 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:14.830 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-fuse. 2020-11-20T11:36:14.845 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../052-ceph-fuse_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:14.888 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:15.113 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-numpy. 2020-11-20T11:36:15.128 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-11-20T11:36:15.171 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-20T11:36:15.284 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mds. 2020-11-20T11:36:15.297 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../053-ceph-mds_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:15.333 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mds (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:15.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-decorator. 2020-11-20T11:36:15.800 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-python3-decorator_4.1.2-1_all.deb ... 2020-11-20T11:36:15.827 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephadm. 2020-11-20T11:36:15.840 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../054-cephadm_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:15.843 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-11-20T11:36:15.879 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:16.154 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-scipy. 2020-11-20T11:36:16.169 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-20T11:36:16.188 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jinja2. 2020-11-20T11:36:16.203 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-11-20T11:36:16.212 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-11-20T11:36:16.247 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-20T11:36:16.558 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-11-20T11:36:16.574 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:16.634 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:16.954 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-repoze.lru. 2020-11-20T11:36:16.969 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-11-20T11:36:17.012 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-11-20T11:36:17.314 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-routes. 2020-11-20T11:36:17.328 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-11-20T11:36:17.372 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-11-20T11:36:17.421 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-11-20T11:36:17.438 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-20T11:36:17.479 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-11-20T11:36:17.709 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-11-20T11:36:17.723 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:17.758 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-dashboard (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:17.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2020-11-20T11:36:17.955 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-python3-joblib_0.11-1_all.deb ... 2020-11-20T11:36:18.007 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.11-1) ... 2020-11-20T11:36:18.352 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2020-11-20T11:36:18.517 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-sklearn_0.19.1-3_all.deb ... 2020-11-20T11:36:18.517 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-11-20T11:36:18.608 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-numpy. 2020-11-20T11:36:18.626 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../060-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-11-20T11:36:18.666 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-20T11:36:18.959 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-20T11:36:18.973 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:19.017 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:19.255 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-decorator. 2020-11-20T11:36:19.270 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../061-python3-decorator_4.1.2-1_all.deb ... 2020-11-20T11:36:19.305 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-11-20T11:36:19.600 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-scipy. 2020-11-20T11:36:19.615 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../062-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-11-20T11:36:19.658 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-11-20T11:36:20.163 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-monotonic. 2020-11-20T11:36:20.177 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-monotonic_1.1-2_all.deb ... 2020-11-20T11:36:20.220 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-11-20T11:36:20.548 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-fasteners. 2020-11-20T11:36:20.562 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-fasteners_0.12.0-3_all.deb ... 2020-11-20T11:36:20.625 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-11-20T11:36:20.834 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-11-20T11:36:20.850 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../063-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-11-20T11:36:20.893 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-11-20T11:36:20.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-httplib2. 2020-11-20T11:36:20.925 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-20T11:36:20.967 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-20T11:36:21.253 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2020-11-20T11:36:21.270 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-pyasn1_0.4.2-3_all.deb ... 2020-11-20T11:36:21.311 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-11-20T11:36:21.379 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-joblib. 2020-11-20T11:36:21.393 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../064-python3-joblib_0.11-1_all.deb ... 2020-11-20T11:36:21.479 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-joblib (0.11-1) ... 2020-11-20T11:36:21.643 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-11-20T11:36:21.655 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-20T11:36:21.698 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-20T11:36:21.824 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sklearn. 2020-11-20T11:36:21.837 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../065-python3-sklearn_0.19.1-3_all.deb ... 2020-11-20T11:36:21.885 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-11-20T11:36:22.009 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2020-11-20T11:36:22.024 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-rsa_3.4.2-1_all.deb ... 2020-11-20T11:36:22.067 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-11-20T11:36:22.387 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-11-20T11:36:22.401 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-20T11:36:22.445 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-20T11:36:22.472 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-11-20T11:36:22.486 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../066-ceph-mgr-diskprediction-local_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:22.530 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-diskprediction-local (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:22.875 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-oauth2client. 2020-11-20T11:36:22.889 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-oauth2client_4.1.2-3_all.deb ... 2020-11-20T11:36:22.932 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-11-20T11:36:23.269 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-setuptools. 2020-11-20T11:36:23.282 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-setuptools_39.0.1-2_all.deb ... 2020-11-20T11:36:23.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-11-20T11:36:23.625 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-monotonic. 2020-11-20T11:36:23.640 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../067-python3-monotonic_1.1-2_all.deb ... 2020-11-20T11:36:23.683 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-11-20T11:36:23.722 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2020-11-20T11:36:23.737 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-20T11:36:23.780 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-11-20T11:36:23.986 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-fasteners. 2020-11-20T11:36:24.000 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../068-python3-fasteners_0.12.0-3_all.deb ... 2020-11-20T11:36:24.044 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-11-20T11:36:24.117 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2020-11-20T11:36:24.134 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-20T11:36:24.175 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-20T11:36:24.355 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-httplib2. 2020-11-20T11:36:24.369 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../069-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-11-20T11:36:24.413 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-20T11:36:24.570 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-20T11:36:24.585 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:24.629 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:24.719 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1. 2020-11-20T11:36:24.734 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../070-python3-pyasn1_0.4.2-3_all.deb ... 2020-11-20T11:36:24.776 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-11-20T11:36:24.956 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-json-pointer. 2020-11-20T11:36:24.970 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-json-pointer_1.10-1_all.deb ... 2020-11-20T11:36:25.015 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-11-20T11:36:25.121 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-11-20T11:36:25.136 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../071-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-11-20T11:36:25.180 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-20T11:36:25.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jsonpatch. 2020-11-20T11:36:25.390 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-11-20T11:36:25.499 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-rsa. 2020-11-20T11:36:25.513 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../072-python3-rsa_3.4.2-1_all.deb ... 2020-11-20T11:36:25.515 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-20T11:36:25.558 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-11-20T11:36:25.815 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-20T11:36:25.831 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-ceph-mgr-rook_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:25.873 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-rook (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:25.911 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-11-20T11:36:25.927 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../073-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-11-20T11:36:25.969 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-20T11:36:26.234 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-20T11:36:26.249 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-libonig4_6.7.0-1_amd64.deb ... 2020-11-20T11:36:26.292 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-20T11:36:26.450 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-oauth2client. 2020-11-20T11:36:26.464 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../074-python3-oauth2client_4.1.2-3_all.deb ... 2020-11-20T11:36:26.506 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-11-20T11:36:26.647 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-20T11:36:26.661 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-20T11:36:26.704 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-20T11:36:26.826 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-setuptools. 2020-11-20T11:36:26.843 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../075-python3-setuptools_39.0.1-2_all.deb ... 2020-11-20T11:36:26.893 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-11-20T11:36:26.981 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2020-11-20T11:36:26.996 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-jq_1.5+dfsg-2_amd64.deb ... 2020-11-20T11:36:27.039 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-20T11:36:27.275 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2020-11-20T11:36:27.289 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-20T11:36:27.314 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-websocket. 2020-11-20T11:36:27.328 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../076-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-11-20T11:36:27.333 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-20T11:36:27.371 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-11-20T11:36:27.683 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-kubernetes. 2020-11-20T11:36:27.699 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../077-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-11-20T11:36:27.737 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-20T11:36:27.741 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-20T11:36:27.753 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-20T11:36:27.795 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-20T11:36:28.098 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2020-11-20T11:36:28.113 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-20T11:36:28.156 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-20T11:36:28.187 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-11-20T11:36:28.201 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:28.245 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-k8sevents (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:28.502 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2020-11-20T11:36:28.515 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-ceph-test_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:28.560 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:28.565 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-json-pointer. 2020-11-20T11:36:28.579 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../079-python3-json-pointer_1.10-1_all.deb ... 2020-11-20T11:36:28.623 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-11-20T11:36:28.984 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-jsonpatch. 2020-11-20T11:36:28.999 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../080-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-11-20T11:36:29.132 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-20T11:36:29.431 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-11-20T11:36:29.447 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../081-ceph-mgr-rook_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:29.489 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-mgr-rook (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:29.809 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libonig4:amd64. 2020-11-20T11:36:29.825 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../082-libonig4_6.7.0-1_amd64.deb ... 2020-11-20T11:36:29.867 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-11-20T11:36:30.229 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libjq1:amd64. 2020-11-20T11:36:30.245 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../083-libjq1_1.5+dfsg-2_amd64.deb ... 2020-11-20T11:36:30.287 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-11-20T11:36:30.573 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package jq. 2020-11-20T11:36:30.590 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../084-jq_1.5+dfsg-2_amd64.deb ... 2020-11-20T11:36:30.631 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-11-20T11:36:30.901 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package socat. 2020-11-20T11:36:30.916 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../085-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-11-20T11:36:30.959 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-11-20T11:36:31.338 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-11-20T11:36:31.352 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../086-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-11-20T11:36:31.396 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-20T11:36:31.700 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package xmlstarlet. 2020-11-20T11:36:31.762 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../087-xmlstarlet_1.6.1-2_amd64.deb ... 2020-11-20T11:36:32.099 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-11-20T11:36:32.241 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2020-11-20T11:36:32.256 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-colorama_0.3.7-1_all.deb ... 2020-11-20T11:36:32.298 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-11-20T11:36:32.462 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ceph-test. 2020-11-20T11:36:32.475 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../088-ceph-test_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:32.520 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ceph-test (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:32.551 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2020-11-20T11:36:32.565 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-cephfs-shell_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:32.609 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:32.889 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-20T11:36:32.903 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-libcephfs-dev_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:32.944 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:33.208 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2020-11-20T11:36:33.222 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-20T11:36:33.266 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-20T11:36:33.637 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-attr. 2020-11-20T11:36:33.652 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-python-attr_17.4.0-2_all.deb ... 2020-11-20T11:36:33.696 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-20T11:36:34.006 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-funcsigs. 2020-11-20T11:36:34.020 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-python-funcsigs_1.0.2-4_all.deb ... 2020-11-20T11:36:34.067 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-20T11:36:34.376 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pluggy. 2020-11-20T11:36:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2020-11-20T11:36:34.434 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-20T11:36:34.737 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-py. 2020-11-20T11:36:34.751 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2020-11-20T11:36:34.795 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-20T11:36:35.123 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pytest. 2020-11-20T11:36:35.141 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-python-pytest_3.3.2-2_all.deb ... 2020-11-20T11:36:35.548 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-20T11:36:35.885 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-attr. 2020-11-20T11:36:35.902 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-python3-attr_17.4.0-2_all.deb ... 2020-11-20T11:36:35.969 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-11-20T11:36:36.258 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-colorama. 2020-11-20T11:36:36.270 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cycler. 2020-11-20T11:36:36.272 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../089-python3-colorama_0.3.7-1_all.deb ... 2020-11-20T11:36:36.285 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-python3-cycler_0.10.0-1_all.deb ... 2020-11-20T11:36:36.316 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-11-20T11:36:36.329 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-11-20T11:36:36.569 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package cephfs-shell. 2020-11-20T11:36:36.583 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../090-cephfs-shell_16.0.0-7397-gb86e691b-1bionic_all.deb ... 2020-11-20T11:36:36.627 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking cephfs-shell (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:36.631 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webencodings. 2020-11-20T11:36:36.640 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-python3-webencodings_0.5-2_all.deb ... 2020-11-20T11:36:36.681 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-11-20T11:36:36.871 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libcephfs-dev. 2020-11-20T11:36:36.887 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../091-libcephfs-dev_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:36.929 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libcephfs-dev (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:36.993 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-html5lib. 2020-11-20T11:36:37.009 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python3-html5lib_0.999999999-1_all.deb ... 2020-11-20T11:36:37.051 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-11-20T11:36:37.174 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package nvme-cli. 2020-11-20T11:36:37.187 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../092-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-11-20T11:36:37.233 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-11-20T11:36:37.387 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-11-20T11:36:37.401 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-20T11:36:37.445 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-20T11:36:37.620 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-attr. 2020-11-20T11:36:37.633 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../093-python-attr_17.4.0-2_all.deb ... 2020-11-20T11:36:37.670 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-attr (17.4.0-2) ... 2020-11-20T11:36:37.891 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tz. 2020-11-20T11:36:37.905 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-python3-tz_2018.3-2_all.deb ... 2020-11-20T11:36:37.947 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-funcsigs. 2020-11-20T11:36:37.948 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tz (2018.3-2) ... 2020-11-20T11:36:37.956 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../094-python-funcsigs_1.0.2-4_all.deb ... 2020-11-20T11:36:37.989 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-11-20T11:36:38.267 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-pluggy. 2020-11-20T11:36:38.277 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-matplotlib. 2020-11-20T11:36:38.283 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2020-11-20T11:36:38.292 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-11-20T11:36:38.317 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-11-20T11:36:38.335 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-20T11:36:38.595 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-py. 2020-11-20T11:36:38.609 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2020-11-20T11:36:38.653 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-py (1.5.2-1) ... 2020-11-20T11:36:38.982 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python-pytest. 2020-11-20T11:36:39.022 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-olefile. 2020-11-20T11:36:39.022 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../097-python-pytest_3.3.2-2_all.deb ... 2020-11-20T11:36:39.035 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-python3-olefile_0.45.1-1_all.deb ... 2020-11-20T11:36:39.040 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-11-20T11:36:39.082 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-11-20T11:36:39.351 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-attr. 2020-11-20T11:36:39.368 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../098-python3-attr_17.4.0-2_all.deb ... 2020-11-20T11:36:39.376 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2020-11-20T11:36:39.394 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-2_all.deb ... 2020-11-20T11:36:39.410 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-11-20T11:36:39.435 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-11-20T11:36:39.696 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-cycler. 2020-11-20T11:36:39.709 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../099-python3-cycler_0.10.0-1_all.deb ... 2020-11-20T11:36:39.754 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-11-20T11:36:39.796 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pil:amd64. 2020-11-20T11:36:39.812 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-11-20T11:36:39.863 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-20T11:36:40.082 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-webencodings. 2020-11-20T11:36:40.096 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../100-python3-webencodings_0.5-2_all.deb ... 2020-11-20T11:36:40.140 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-11-20T11:36:40.224 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2020-11-20T11:36:40.238 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-pluggy_0.6.0-1_all.deb ... 2020-11-20T11:36:40.291 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-11-20T11:36:40.385 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-html5lib. 2020-11-20T11:36:40.399 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../101-python3-html5lib_0.999999999-1_all.deb ... 2020-11-20T11:36:40.434 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-11-20T11:36:40.594 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2020-11-20T11:36:40.609 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-py_1.5.2-1_all.deb ... 2020-11-20T11:36:40.652 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.5.2-1) ... 2020-11-20T11:36:40.796 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-11-20T11:36:40.813 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../102-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-11-20T11:36:40.856 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-20T11:36:40.980 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2020-11-20T11:36:40.996 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1_all.deb ... 2020-11-20T11:36:41.038 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-11-20T11:36:41.308 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tz. 2020-11-20T11:36:41.323 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../103-python3-tz_2018.3-2_all.deb ... 2020-11-20T11:36:41.349 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2020-11-20T11:36:41.364 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-pytest_3.3.2-2_all.deb ... 2020-11-20T11:36:41.365 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tz (2018.3-2) ... 2020-11-20T11:36:41.416 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-11-20T11:36:41.669 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-matplotlib. 2020-11-20T11:36:41.685 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../104-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-11-20T11:36:41.727 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-20T11:36:41.744 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2020-11-20T11:36:41.762 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-python3-simplejson_3.13.2-1_amd64.deb ... 2020-11-20T11:36:41.802 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-11-20T11:36:42.164 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tk:amd64. 2020-11-20T11:36:42.181 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-11-20T11:36:42.222 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-20T11:36:42.433 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-olefile. 2020-11-20T11:36:42.448 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../105-python3-olefile_0.45.1-1_all.deb ... 2020-11-20T11:36:42.491 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-11-20T11:36:42.659 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2020-11-20T11:36:42.673 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-radosgw_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:42.717 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:42.803 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pastescript. 2020-11-20T11:36:42.816 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-2_all.deb ... 2020-11-20T11:36:42.869 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-11-20T11:36:43.257 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pil:amd64. 2020-11-20T11:36:43.270 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../107-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-11-20T11:36:43.322 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-20T11:36:43.684 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pluggy. 2020-11-20T11:36:43.701 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../108-python3-pluggy_0.6.0-1_all.deb ... 2020-11-20T11:36:43.742 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-11-20T11:36:43.754 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2020-11-20T11:36:43.768 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../115-rbd-fuse_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:43.820 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:44.028 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-py. 2020-11-20T11:36:44.045 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../109-python3-py_1.5.2-1_all.deb ... 2020-11-20T11:36:44.086 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-py (1.5.2-1) ... 2020-11-20T11:36:44.124 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-11-20T11:36:44.415 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pyinotify. 2020-11-20T11:36:44.428 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1_all.deb ... 2020-11-20T11:36:44.433 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-20T11:36:44.473 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-11-20T11:36:44.784 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-pytest. 2020-11-20T11:36:44.793 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-20T11:36:44.801 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../111-python3-pytest_3.3.2-2_all.deb ... 2020-11-20T11:36:44.842 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-11-20T11:36:44.919 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-20T11:36:45.197 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-simplejson. 2020-11-20T11:36:45.509 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../112-python3-simplejson_3.13.2-1_amd64.deb ... 2020-11-20T11:36:45.510 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-11-20T11:36:45.522 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-20T11:36:45.583 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package python3-tk:amd64. 2020-11-20T11:36:45.597 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../113-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-11-20T11:36:45.640 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-20T11:36:45.898 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-11-20T11:36:46.094 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package radosgw. 2020-11-20T11:36:46.108 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../114-radosgw_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:46.152 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking radosgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:46.191 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webencodings (0.5-2) ... 2020-11-20T11:36:46.509 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-20T11:36:46.702 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-11-20T11:36:46.829 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.5.2-1) ... 2020-11-20T11:36:47.163 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-11-20T11:36:47.189 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package rbd-fuse. 2020-11-20T11:36:47.204 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../115-rbd-fuse_16.0.0-7397-gb86e691b-1bionic_amd64.deb ... 2020-11-20T11:36:47.255 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking rbd-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:47.541 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-20T11:36:47.551 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-11-20T11:36:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-11-20T11:36:47.861 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-11-20T11:36:48.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:48.220 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-11-20T11:36:48.346 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-11-20T11:36:48.477 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-11-20T11:36:48.769 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-20T11:36:48.897 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-20T11:36:48.966 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-11-20T11:36:49.342 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-11-20T11:36:49.626 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webencodings (0.5-2) ... 2020-11-20T11:36:49.830 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-11-20T11:36:49.920 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-attr (17.4.0-2) ... 2020-11-20T11:36:50.129 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-11-20T11:36:50.140 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-11-20T11:36:50.264 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-py (1.5.2-1) ... 2020-11-20T11:36:50.416 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-py (1.5.2-1) ... 2020-11-20T11:36:50.607 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-11-20T11:36:50.668 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-11-20T11:36:50.976 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-11-20T11:36:51.035 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-11-20T11:36:51.125 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-11-20T11:36:51.268 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-11-20T11:36:51.354 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-20T11:36:51.480 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-20T11:36:51.569 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-argparse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:51.680 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-11-20T11:36:51.879 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-11-20T11:36:51.982 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-11-20T11:36:52.249 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-20T11:36:52.255 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-11-20T11:36:52.398 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-11-20T11:36:52.550 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-11-20T11:36:52.810 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-11-20T11:36:53.172 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-11-20T11:36:53.326 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-11-20T11:36:53.512 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-11-20T11:36:53.635 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-11-20T11:36:53.813 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:53.953 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-py (1.5.2-1) ... 2020-11-20T11:36:54.180 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-11-20T11:36:54.489 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2020-11-20T11:36:54.531 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-11-20T11:36:54.619 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-11-20T11:36:54.620 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-11-20T11:36:54.874 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-11-20T11:36:54.921 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-20T11:36:55.000 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-11-20T11:36:55.047 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-20T11:36:55.172 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-11-20T11:36:55.193 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-11-20T11:36:55.503 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-11-20T11:36:55.515 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-11-20T11:36:55.804 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-11-20T11:36:55.833 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-20T11:36:55.959 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-11-20T11:36:56.130 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-11-20T11:36:56.269 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:56.422 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-11-20T11:36:56.545 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-monotonic (1.1-2) ... 2020-11-20T11:36:56.791 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-11-20T11:36:56.846 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-20T11:36:56.973 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-20T11:36:57.125 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-11-20T11:36:57.323 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-11-20T11:36:57.426 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:36:57.658 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-20T11:36:57.748 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-11-20T11:36:57.780 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-11-20T11:36:58.010 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-11-20T11:36:58.052 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user cephadm....done 2020-11-20T11:36:58.216 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-11-20T11:36:58.277 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-20T11:36:58.534 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-11-20T11:36:58.554 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-20T11:36:58.660 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-11-20T11:36:58.795 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-11-20T11:36:58.896 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-attr (17.4.0-2) ... 2020-11-20T11:36:59.138 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-11-20T11:36:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-20T11:36:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-20T11:36:59.431 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-11-20T11:36:59.573 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-11-20T11:36:59.800 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-11-20T11:36:59.890 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-20T11:36:59.891 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:00.143 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-20T11:37:00.193 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-monotonic (1.1-2) ... 2020-11-20T11:37:00.303 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-20T11:37:00.404 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-20T11:37:00.486 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-11-20T11:37:00.637 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-11-20T11:37:00.671 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-20T11:37:00.797 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-11-20T11:37:00.971 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-11-20T11:37:01.191 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-20T11:37:01.317 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-11-20T11:37:01.323 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-11-20T11:37:01.429 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-11-20T11:37:01.470 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-11-20T11:37:01.618 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tz (2018.3-2) ... 2020-11-20T11:37:01.708 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-11-20T11:37:01.894 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-11-20T11:37:02.009 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-11-20T11:37:02.170 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-11-20T11:37:02.310 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-11-20T11:37:02.438 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.11-1) ... 2020-11-20T11:37:02.814 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.4.1-1) ... 2020-11-20T11:37:02.837 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-attr (17.4.0-2) ... 2020-11-20T11:37:03.124 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-11-20T11:37:03.544 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-11-20T11:37:03.545 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-11-20T11:37:03.546 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-11-20T11:37:03.759 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-11-20T11:37:03.774 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-11-20T11:37:03.863 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-11-20T11:37:04.052 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-20T11:37:04.126 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liboath0 (2.6.1-1) ... 2020-11-20T11:37:04.310 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-11-20T11:37:04.378 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-11-20T11:37:04.436 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-11-20T11:37:04.663 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-20T11:37:04.679 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-11-20T11:37:04.789 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-11-20T11:37:04.805 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-11-20T11:37:05.182 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-11-20T11:37:05.342 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-11-20T11:37:05.626 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-tz (2018.3-2) ... 2020-11-20T11:37:05.952 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-11-20T11:37:06.237 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-11-20T11:37:06.277 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-20T11:37:06.538 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-joblib (0.11-1) ... 2020-11-20T11:37:06.578 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-11-20T11:37:06.906 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-routes (2.4.1-1) ... 2020-11-20T11:37:06.913 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-11-20T11:37:07.041 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-11-20T11:37:07.217 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-11-20T11:37:07.409 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-11-20T11:37:07.550 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-11-20T11:37:07.708 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-20T11:37:07.876 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-11-20T11:37:07.976 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-20T11:37:08.085 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-20T11:37:08.186 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2020-11-20T11:37:08.186 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:08.287 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-11-20T11:37:08.571 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-11-20T11:37:08.596 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:08.722 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:08.848 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:08.889 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up jq (1.5+dfsg-2) ... 2020-11-20T11:37:08.974 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-11-20T11:37:09.015 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-11-20T11:37:09.369 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-11-20T11:37:09.645 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-11-20T11:37:09.954 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-20T11:37:10.170 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-11-20T11:37:10.488 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-11-20T11:37:10.807 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-11-20T11:37:10.822 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-11-20T11:37:10.957 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-11-20T11:37:11.350 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-11-20T11:37:11.645 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-11-20T11:37:11.651 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python-pytest (3.3.2-2) ... 2020-11-20T11:37:11.913 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-11-20T11:37:11.938 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.039 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-11-20T11:37:12.064 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.190 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librados2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.332 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-11-20T11:37:12.356 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.491 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.634 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.705 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-20T11:37:12.705 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-20T11:37:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libcephfs-dev (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:12.902 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rados (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:13.009 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:13.028 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-11-20T11:37:13.135 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:13.235 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-11-20T11:37:13.311 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-20T11:37:13.341 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-20T11:37:13.415 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-11-20T11:37:13.647 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-20T11:37:13.724 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-11-20T11:37:14.059 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-11-20T11:37:14.316 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:14.442 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-11-20T11:37:14.760 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:14.861 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:14.895 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-11-20T11:37:14.962 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:15.063 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:15.597 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2020-11-20T11:37:15.742 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-11-20T11:37:16.000 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2020-11-20T11:37:16.043 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libradosstriper1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:16.169 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-cephfs (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:16.276 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2020-11-20T11:37:16.431 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-20T11:37:16.462 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librgw2 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:16.597 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:16.656 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-20T11:37:16.816 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-20T11:37:16.816 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-11-20T11:37:16.939 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:17.106 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up librbd1 (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:17.197 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-20T11:37:17.197 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-20T11:37:17.241 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up cephfs-shell (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:17.375 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-11-20T11:37:17.465 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-11-20T11:37:17.495 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-11-20T11:37:17.583 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:17.709 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:17.803 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-11-20T11:37:18.047 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-20T11:37:18.336 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:18.481 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-modules-core (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:18.531 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-20T11:37:18.532 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-20T11:37:18.607 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-11-20T11:37:18.812 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:18.925 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:18.930 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.078 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up rbd-fuse (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.202 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up python3-rbd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.328 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-common (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.423 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-20T11:37:19.424 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-20T11:37:19.724 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.866 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-rook (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:19.871 INFO:teuthology.orchestra.run.smithi186.stdout:Adding group ceph....done 2020-11-20T11:37:20.009 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:20.231 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-20T11:37:20.231 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-20T11:37:20.266 INFO:teuthology.orchestra.run.smithi186.stdout:Adding system user ceph....done 2020-11-20T11:37:20.466 INFO:teuthology.orchestra.run.smithi186.stdout:Setting system user ceph properties....done 2020-11-20T11:37:20.527 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:20.617 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-11-20T11:37:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-20T11:37:20.747 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-20T11:37:20.855 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-11-20T11:37:21.012 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:21.112 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:21.138 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up radosgw (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:21.310 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:21.399 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-20T11:37:21.400 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-11-20T11:37:21.499 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-20T11:37:21.700 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-20T11:37:21.807 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-test (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:21.950 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-base (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:22.306 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-11-20T11:37:22.593 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:22.808 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-20T11:37:22.809 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-11-20T11:37:23.096 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-diskprediction-local (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:23.239 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-osd (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:23.686 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-20T11:37:23.687 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-11-20T11:37:23.752 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-20T11:37:23.795 INFO:teuthology.orchestra.run.smithi161.stdout:ureadahead will be reprofiled on next reboot 2020-11-20T11:37:23.844 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-20T11:37:23.966 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-cephadm (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:24.117 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-rook (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:24.260 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mds (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:24.284 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-20T11:37:24.286 INFO:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-11-20T11:37:24.371 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2020-11-20T11:37:24.490 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-20T11:37:24.490 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-11-20T11:37:24.629 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2020-11-20T11:37:24.629 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2020-11-20T11:37:24.761 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mon (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:24.809 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-11-20T11:37:24.809 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-11-20T11:37:24.809 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (4.15.0-2ubuntu1.2). 2020-11-20T11:37:24.810 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.31.1-0.4ubuntu3.7). 2020-11-20T11:37:24.810 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-11-20T11:37:24.811 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2020-11-20T11:37:24.811 INFO:teuthology.orchestra.run.smithi161.stdout: iputils-arping libbison-dev libfl-dev libfl2 libmbim-glib4 libmbim-proxy 2020-11-20T11:37:24.812 INFO:teuthology.orchestra.run.smithi161.stdout: libmm-glib0 libndp0 libnm0 libpolkit-agent-1-0 libpolkit-backend-1-0 2020-11-20T11:37:24.813 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-glib5 libqmi-proxy libteamdctl0 modemmanager network-manager-pptp 2020-11-20T11:37:24.813 INFO:teuthology.orchestra.run.smithi161.stdout: policykit-1 ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2020-11-20T11:37:24.814 INFO:teuthology.orchestra.run.smithi161.stdout: zlib1g-dev 2020-11-20T11:37:24.814 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2020-11-20T11:37:24.815 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils comgt 2020-11-20T11:37:24.815 INFO:teuthology.orchestra.run.smithi161.stdout: wvdial wpagui libengine-pkcs11-openssl 2020-11-20T11:37:24.847 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2020-11-20T11:37:24.848 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent iputils-arping libaio-dev libbison-dev libelf-dev 2020-11-20T11:37:24.848 INFO:teuthology.orchestra.run.smithi161.stdout: libfl-dev libfl2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 2020-11-20T11:37:24.848 INFO:teuthology.orchestra.run.smithi161.stdout: libpolkit-agent-1-0 libpolkit-backend-1-0 libqmi-glib5 libqmi-proxy 2020-11-20T11:37:24.849 INFO:teuthology.orchestra.run.smithi161.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2020-11-20T11:37:24.849 INFO:teuthology.orchestra.run.smithi161.stdout: policykit-1 ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2020-11-20T11:37:24.849 INFO:teuthology.orchestra.run.smithi161.stdout: zlib1g-dev 2020-11-20T11:37:24.979 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-20T11:37:24.979 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-11-20T11:37:25.026 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 31 newly installed, 0 to remove and 20 not upgraded. 2020-11-20T11:37:25.027 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 7,861 kB of archives. 2020-11-20T11:37:25.027 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 32.0 MB of additional disk space will be used. 2020-11-20T11:37:25.027 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-11-20T11:37:25.246 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-k8sevents (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:25.372 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph-mgr-dashboard (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:25.464 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-11-20T11:37:25.516 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ceph (16.0.0-7397-gb86e691b-1bionic) ... 2020-11-20T11:37:25.543 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-11-20T11:37:25.620 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-11-20T11:37:25.621 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-11-20T11:37:25.623 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 iputils-arping amd64 3:20161105-1ubuntu3 [29.7 kB] 2020-11-20T11:37:25.626 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-11-20T11:37:25.627 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-11-20T11:37:25.640 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-11-20T11:37:25.644 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-20T11:37:25.645 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-11-20T11:37:25.646 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-11-20T11:37:25.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmbim-glib4 amd64 1.18.0-1~ubuntu18.04.1 [91.4 kB] 2020-11-20T11:37:25.703 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmbim-proxy amd64 1.18.0-1~ubuntu18.04.1 [5,572 B] 2020-11-20T11:37:25.704 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmm-glib0 amd64 1.10.0-1~ubuntu18.04.2 [179 kB] 2020-11-20T11:37:25.714 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 libndp0 amd64 1.6-1 [10.7 kB] 2020-11-20T11:37:25.782 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libnm0 amd64 1.10.6-2ubuntu1.4 [298 kB] 2020-11-20T11:37:25.793 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpolkit-agent-1-0 amd64 0.105-20ubuntu0.18.04.5 [14.9 kB] 2020-11-20T11:37:25.794 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpolkit-backend-1-0 amd64 0.105-20ubuntu0.18.04.5 [36.3 kB] 2020-11-20T11:37:25.795 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libqmi-glib5 amd64 1.22.0-1.2~ubuntu18.04.1 [494 kB] 2020-11-20T11:37:25.815 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libqmi-proxy amd64 1.22.0-1.2~ubuntu18.04.1 [5,632 B] 2020-11-20T11:37:25.816 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-11-20T11:37:25.851 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-20T11:37:25.892 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 libteamdctl0 amd64 1.26-1 [11.6 kB] 2020-11-20T11:37:25.893 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 modemmanager amd64 1.10.0-1~ubuntu18.04.2 [728 kB] 2020-11-20T11:37:25.915 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 wpasupplicant amd64 2:2.6-15ubuntu2.5 [954 kB] 2020-11-20T11:37:25.943 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 policykit-1 amd64 0.105-20ubuntu0.18.04.5 [53.5 kB] 2020-11-20T11:37:25.944 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 network-manager amd64 1.10.6-2ubuntu1.4 [1,505 kB] 2020-11-20T11:37:25.976 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 ppp amd64 2.4.7-2+2ubuntu1.3 [328 kB] 2020-11-20T11:37:25.994 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 pptp-linux amd64 1.9.0+ds-2 [41.8 kB] 2020-11-20T11:37:25.994 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 network-manager-pptp amd64 1.2.6-1 [30.0 kB] 2020-11-20T11:37:25.995 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 usb-modeswitch-data all 20170806-2 [30.7 kB] 2020-11-20T11:37:26.016 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu1 [53.6 kB] 2020-11-20T11:37:26.507 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 7,861 kB in 1s (6,826 kB/s) 2020-11-20T11:37:26.653 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2020-11-20T11:37:26.703 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145531 files and directories currently installed.) 2020-11-20T11:37:26.707 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-11-20T11:37:26.752 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-6) ... 2020-11-20T11:37:27.097 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-11-20T11:37:27.111 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-11-20T11:37:27.147 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:27.475 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2020-11-20T11:37:27.491 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-11-20T11:37:27.537 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:27.928 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2020-11-20T11:37:27.936 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-20T11:37:27.943 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-11-20T11:37:27.979 INFO:teuthology.orchestra.run.smithi186.stdout:ureadahead will be reprofiled on next reboot 2020-11-20T11:37:27.986 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b46-3) ... 2020-11-20T11:37:28.307 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2020-11-20T11:37:28.323 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-11-20T11:37:28.363 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-20T11:37:28.365 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.11-5) ... 2020-11-20T11:37:28.643 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package iputils-arping. 2020-11-20T11:37:28.658 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-iputils-arping_3%3a20161105-1ubuntu3_amd64.deb ... 2020-11-20T11:37:28.701 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking iputils-arping (3:20161105-1ubuntu3) ... 2020-11-20T11:37:28.819 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-20T11:37:28.821 INFO:teuthology.orchestra.run.smithi186:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-11-20T11:37:28.900 INFO:teuthology.orchestra.run.smithi186.stdout:Reading package lists... 2020-11-20T11:37:28.953 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-11-20T11:37:28.969 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-11-20T11:37:29.011 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-11-20T11:37:29.159 INFO:teuthology.orchestra.run.smithi186.stdout:Building dependency tree... 2020-11-20T11:37:29.159 INFO:teuthology.orchestra.run.smithi186.stdout:Reading state information... 2020-11-20T11:37:29.273 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-11-20T11:37:29.287 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-11-20T11:37:29.330 INFO:teuthology.orchestra.run.smithi186.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-11-20T11:37:29.330 INFO:teuthology.orchestra.run.smithi186.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-11-20T11:37:29.331 INFO:teuthology.orchestra.run.smithi186.stdout:iproute2 is already the newest version (4.15.0-2ubuntu1.2). 2020-11-20T11:37:29.331 INFO:teuthology.orchestra.run.smithi186.stdout:util-linux is already the newest version (2.31.1-0.4ubuntu3.7). 2020-11-20T11:37:29.331 INFO:teuthology.orchestra.run.smithi186.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-11-20T11:37:29.331 INFO:teuthology.orchestra.run.smithi186.stdout:The following additional packages will be installed: 2020-11-20T11:37:29.331 INFO:teuthology.orchestra.run.smithi186.stdout: iputils-arping libbison-dev libfl-dev libfl2 libmbim-glib4 libmbim-proxy 2020-11-20T11:37:29.332 INFO:teuthology.orchestra.run.smithi186.stdout: libmm-glib0 libndp0 libnm0 libpolkit-agent-1-0 libpolkit-backend-1-0 2020-11-20T11:37:29.333 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-11-20T11:37:29.333 INFO:teuthology.orchestra.run.smithi186.stdout: libqmi-glib5 libqmi-proxy libteamdctl0 modemmanager network-manager-pptp 2020-11-20T11:37:29.333 INFO:teuthology.orchestra.run.smithi186.stdout: policykit-1 ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2020-11-20T11:37:29.333 INFO:teuthology.orchestra.run.smithi186.stdout: zlib1g-dev 2020-11-20T11:37:29.334 INFO:teuthology.orchestra.run.smithi186.stdout:Suggested packages: 2020-11-20T11:37:29.334 INFO:teuthology.orchestra.run.smithi186.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils comgt 2020-11-20T11:37:29.334 INFO:teuthology.orchestra.run.smithi186.stdout: wvdial wpagui libengine-pkcs11-openssl 2020-11-20T11:37:29.366 INFO:teuthology.orchestra.run.smithi186.stdout:The following NEW packages will be installed: 2020-11-20T11:37:29.367 INFO:teuthology.orchestra.run.smithi186.stdout: bison dump flex indent iputils-arping libaio-dev libbison-dev libelf-dev 2020-11-20T11:37:29.367 INFO:teuthology.orchestra.run.smithi186.stdout: libfl-dev libfl2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 2020-11-20T11:37:29.368 INFO:teuthology.orchestra.run.smithi186.stdout: libpolkit-agent-1-0 libpolkit-backend-1-0 libqmi-glib5 libqmi-proxy 2020-11-20T11:37:29.368 INFO:teuthology.orchestra.run.smithi186.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2020-11-20T11:37:29.369 INFO:teuthology.orchestra.run.smithi186.stdout: policykit-1 ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2020-11-20T11:37:29.369 INFO:teuthology.orchestra.run.smithi186.stdout: zlib1g-dev 2020-11-20T11:37:29.547 INFO:teuthology.orchestra.run.smithi186.stdout:0 upgraded, 31 newly installed, 0 to remove and 20 not upgraded. 2020-11-20T11:37:29.547 INFO:teuthology.orchestra.run.smithi186.stdout:Need to get 7,861 kB of archives. 2020-11-20T11:37:29.548 INFO:teuthology.orchestra.run.smithi186.stdout:After this operation, 32.0 MB of additional disk space will be used. 2020-11-20T11:37:29.548 INFO:teuthology.orchestra.run.smithi186.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-11-20T11:37:29.617 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-11-20T11:37:29.633 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-11-20T11:37:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-11-20T11:37:30.001 INFO:teuthology.orchestra.run.smithi186.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-11-20T11:37:30.023 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2020-11-20T11:37:30.037 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libfl2_2.6.4-6_amd64.deb ... 2020-11-20T11:37:30.080 INFO:teuthology.orchestra.run.smithi186.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-11-20T11:37:30.121 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-11-20T11:37:30.130 INFO:teuthology.orchestra.run.smithi186.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-11-20T11:37:30.149 INFO:teuthology.orchestra.run.smithi186.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-11-20T11:37:30.159 INFO:teuthology.orchestra.run.smithi186.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 iputils-arping amd64 3:20161105-1ubuntu3 [29.7 kB] 2020-11-20T11:37:30.162 INFO:teuthology.orchestra.run.smithi186.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-11-20T11:37:30.163 INFO:teuthology.orchestra.run.smithi186.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-11-20T11:37:30.176 INFO:teuthology.orchestra.run.smithi186.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-11-20T11:37:30.181 INFO:teuthology.orchestra.run.smithi186.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-11-20T11:37:30.182 INFO:teuthology.orchestra.run.smithi186.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-11-20T11:37:30.182 INFO:teuthology.orchestra.run.smithi186.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmbim-glib4 amd64 1.18.0-1~ubuntu18.04.1 [91.4 kB] 2020-11-20T11:37:30.239 INFO:teuthology.orchestra.run.smithi186.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmbim-proxy amd64 1.18.0-1~ubuntu18.04.1 [5,572 B] 2020-11-20T11:37:30.239 INFO:teuthology.orchestra.run.smithi186.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libmm-glib0 amd64 1.10.0-1~ubuntu18.04.2 [179 kB] 2020-11-20T11:37:30.248 INFO:teuthology.orchestra.run.smithi186.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 libndp0 amd64 1.6-1 [10.7 kB] 2020-11-20T11:37:30.317 INFO:teuthology.orchestra.run.smithi186.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libnm0 amd64 1.10.6-2ubuntu1.4 [298 kB] 2020-11-20T11:37:30.329 INFO:teuthology.orchestra.run.smithi186.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpolkit-agent-1-0 amd64 0.105-20ubuntu0.18.04.5 [14.9 kB] 2020-11-20T11:37:30.330 INFO:teuthology.orchestra.run.smithi186.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libpolkit-backend-1-0 amd64 0.105-20ubuntu0.18.04.5 [36.3 kB] 2020-11-20T11:37:30.330 INFO:teuthology.orchestra.run.smithi186.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libqmi-glib5 amd64 1.22.0-1.2~ubuntu18.04.1 [494 kB] 2020-11-20T11:37:30.350 INFO:teuthology.orchestra.run.smithi186.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libqmi-proxy amd64 1.22.0-1.2~ubuntu18.04.1 [5,632 B] 2020-11-20T11:37:30.350 INFO:teuthology.orchestra.run.smithi186.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-11-20T11:37:30.381 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-11-20T11:37:30.396 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libfl-dev_2.6.4-6_amd64.deb ... 2020-11-20T11:37:30.427 INFO:teuthology.orchestra.run.smithi186.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 libteamdctl0 amd64 1.26-1 [11.6 kB] 2020-11-20T11:37:30.427 INFO:teuthology.orchestra.run.smithi186.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 modemmanager amd64 1.10.0-1~ubuntu18.04.2 [728 kB] 2020-11-20T11:37:30.439 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-11-20T11:37:30.451 INFO:teuthology.orchestra.run.smithi186.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 wpasupplicant amd64 2:2.6-15ubuntu2.5 [954 kB] 2020-11-20T11:37:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 policykit-1 amd64 0.105-20ubuntu0.18.04.5 [53.5 kB] 2020-11-20T11:37:30.493 INFO:teuthology.orchestra.run.smithi186.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 network-manager amd64 1.10.6-2ubuntu1.4 [1,505 kB] 2020-11-20T11:37:30.512 INFO:teuthology.orchestra.run.smithi186.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 ppp amd64 2.4.7-2+2ubuntu1.3 [328 kB] 2020-11-20T11:37:30.536 INFO:teuthology.orchestra.run.smithi186.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 pptp-linux amd64 1.9.0+ds-2 [41.8 kB] 2020-11-20T11:37:30.538 INFO:teuthology.orchestra.run.smithi186.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 network-manager-pptp amd64 1.2.6-1 [30.0 kB] 2020-11-20T11:37:30.538 INFO:teuthology.orchestra.run.smithi186.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 usb-modeswitch-data all 20170806-2 [30.7 kB] 2020-11-20T11:37:30.552 INFO:teuthology.orchestra.run.smithi186.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu1 [53.6 kB] 2020-11-20T11:37:30.767 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2020-11-20T11:37:30.781 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.18.0-1~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:30.835 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:31.033 INFO:teuthology.orchestra.run.smithi186.stdout:Fetched 7,861 kB in 1s (6,738 kB/s) 2020-11-20T11:37:31.113 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2020-11-20T11:37:31.127 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.18.0-1~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:31.170 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package flex. 2020-11-20T11:37:31.171 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:31.220 INFO:teuthology.orchestra.run.smithi186.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 145531 files and directories currently installed.) 2020-11-20T11:37:31.224 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-11-20T11:37:31.268 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking flex (2.6.4-6) ... 2020-11-20T11:37:31.606 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2020-11-20T11:37:31.622 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.10.0-1~ubuntu18.04.2_amd64.deb ... 2020-11-20T11:37:31.664 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-11-20T11:37:31.665 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:31.679 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-11-20T11:37:31.722 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:32.009 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2020-11-20T11:37:32.026 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.6-1_amd64.deb ... 2020-11-20T11:37:32.068 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.6-1) ... 2020-11-20T11:37:32.092 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package bison. 2020-11-20T11:37:32.106 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-11-20T11:37:32.154 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:32.395 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2020-11-20T11:37:32.410 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.10.6-2ubuntu1.4_amd64.deb ... 2020-11-20T11:37:32.454 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:32.537 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package dump. 2020-11-20T11:37:32.553 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-11-20T11:37:32.595 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking dump (0.4b46-3) ... 2020-11-20T11:37:32.856 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpolkit-agent-1-0:amd64. 2020-11-20T11:37:32.871 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpolkit-agent-1-0_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:32.891 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package indent. 2020-11-20T11:37:32.904 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-11-20T11:37:32.915 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpolkit-agent-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:32.949 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking indent (2.2.11-5) ... 2020-11-20T11:37:33.242 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpolkit-backend-1-0:amd64. 2020-11-20T11:37:33.256 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libpolkit-backend-1-0_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:33.309 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpolkit-backend-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:33.654 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2020-11-20T11:37:33.670 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-glib5_1.22.0-1.2~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:33.712 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:33.752 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package iputils-arping. 2020-11-20T11:37:33.767 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../05-iputils-arping_3%3a20161105-1ubuntu3_amd64.deb ... 2020-11-20T11:37:33.810 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking iputils-arping (3:20161105-1ubuntu3) ... 2020-11-20T11:37:34.048 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2020-11-20T11:37:34.064 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libqmi-proxy_1.22.0-1.2~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:34.074 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-11-20T11:37:34.086 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../06-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-11-20T11:37:34.106 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:34.129 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-11-20T11:37:34.383 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-11-20T11:37:34.392 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-11-20T11:37:34.398 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../07-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-11-20T11:37:34.408 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-11-20T11:37:34.441 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-11-20T11:37:34.450 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-11-20T11:37:34.744 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-11-20T11:37:34.760 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../08-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-11-20T11:37:34.802 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-11-20T11:37:34.954 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2020-11-20T11:37:34.969 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-libteamdctl0_1.26-1_amd64.deb ... 2020-11-20T11:37:35.012 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.26-1) ... 2020-11-20T11:37:35.156 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl2:amd64. 2020-11-20T11:37:35.171 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../09-libfl2_2.6.4-6_amd64.deb ... 2020-11-20T11:37:35.256 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-11-20T11:37:35.390 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2020-11-20T11:37:35.403 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-modemmanager_1.10.0-1~ubuntu18.04.2_amd64.deb ... 2020-11-20T11:37:35.458 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:35.525 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-11-20T11:37:35.541 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../10-libfl-dev_2.6.4-6_amd64.deb ... 2020-11-20T11:37:35.583 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-11-20T11:37:35.928 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2020-11-20T11:37:35.942 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../11-libmbim-glib4_1.18.0-1~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:35.986 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-glib4:amd64 (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:36.070 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2020-11-20T11:37:36.088 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-wpasupplicant_2%3a2.6-15ubuntu2.5_amd64.deb ... 2020-11-20T11:37:36.256 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmbim-proxy. 2020-11-20T11:37:36.270 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../12-libmbim-proxy_1.18.0-1~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:36.272 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.6-15ubuntu2.5) ... 2020-11-20T11:37:36.314 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmbim-proxy (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:36.642 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libmm-glib0:amd64. 2020-11-20T11:37:36.658 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../13-libmm-glib0_1.10.0-1~ubuntu18.04.2_amd64.deb ... 2020-11-20T11:37:36.700 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libmm-glib0:amd64 (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:37.096 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libndp0:amd64. 2020-11-20T11:37:37.111 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../14-libndp0_1.6-1_amd64.deb ... 2020-11-20T11:37:37.153 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libndp0:amd64 (1.6-1) ... 2020-11-20T11:37:37.410 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package policykit-1. 2020-11-20T11:37:37.427 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-policykit-1_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:37.479 INFO:teuthology.orchestra.run.smithi161.stdout:Unit polkit.service does not exist, proceeding anyway. 2020-11-20T11:37:37.480 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /run/systemd/system/polkit.service -> /dev/null. 2020-11-20T11:37:37.490 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libnm0:amd64. 2020-11-20T11:37:37.506 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../15-libnm0_1.10.6-2ubuntu1.4_amd64.deb ... 2020-11-20T11:37:37.548 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libnm0:amd64 (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:37.590 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking policykit-1 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:37.926 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpolkit-agent-1-0:amd64. 2020-11-20T11:37:37.942 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../16-libpolkit-agent-1-0_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:37.984 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpolkit-agent-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:38.006 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2020-11-20T11:37:38.022 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager_1.10.6-2ubuntu1.4_amd64.deb ... 2020-11-20T11:37:38.092 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:38.354 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libpolkit-backend-1-0:amd64. 2020-11-20T11:37:38.369 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../17-libpolkit-backend-1-0_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:38.412 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libpolkit-backend-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:38.746 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2020-11-20T11:37:38.760 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-ppp_2.4.7-2+2ubuntu1.3_amd64.deb ... 2020-11-20T11:37:38.849 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2020-11-20T11:37:38.863 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../18-libqmi-glib5_1.22.0-1.2~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:38.908 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-glib5:amd64 (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:39.081 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.7-2+2ubuntu1.3) ... 2020-11-20T11:37:39.210 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libqmi-proxy. 2020-11-20T11:37:39.227 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../19-libqmi-proxy_1.22.0-1.2~ubuntu18.04.1_amd64.deb ... 2020-11-20T11:37:39.268 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libqmi-proxy (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:39.409 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2020-11-20T11:37:39.424 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-pptp-linux_1.9.0+ds-2_amd64.deb ... 2020-11-20T11:37:39.467 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.9.0+ds-2) ... 2020-11-20T11:37:39.513 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-11-20T11:37:39.527 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../20-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-11-20T11:37:39.580 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-11-20T11:37:39.846 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2020-11-20T11:37:39.860 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-network-manager-pptp_1.2.6-1_amd64.deb ... 2020-11-20T11:37:39.913 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.6-1) ... 2020-11-20T11:37:40.133 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package libteamdctl0:amd64. 2020-11-20T11:37:40.147 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../21-libteamdctl0_1.26-1_amd64.deb ... 2020-11-20T11:37:40.165 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2020-11-20T11:37:40.180 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-usb-modeswitch-data_20170806-2_all.deb ... 2020-11-20T11:37:40.191 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking libteamdctl0:amd64 (1.26-1) ... 2020-11-20T11:37:40.223 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20170806-2) ... 2020-11-20T11:37:40.578 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package modemmanager. 2020-11-20T11:37:40.594 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../22-modemmanager_1.10.0-1~ubuntu18.04.2_amd64.deb ... 2020-11-20T11:37:40.627 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2020-11-20T11:37:40.642 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-usb-modeswitch_2.5.2+repack0-2ubuntu1_amd64.deb ... 2020-11-20T11:37:40.645 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking modemmanager (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:40.694 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu1) ... 2020-11-20T11:37:40.978 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:41.098 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.7-2+2ubuntu1.3) ... 2020-11-20T11:37:41.292 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package wpasupplicant. 2020-11-20T11:37:41.306 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../23-wpasupplicant_2%3a2.6-15ubuntu2.5_amd64.deb ... 2020-11-20T11:37:41.460 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking wpasupplicant (2:2.6-15ubuntu2.5) ... 2020-11-20T11:37:41.911 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2020-11-20T11:37:41.981 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package policykit-1. 2020-11-20T11:37:41.995 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../24-policykit-1_0.105-20ubuntu0.18.04.5_amd64.deb ... 2020-11-20T11:37:42.050 INFO:teuthology.orchestra.run.smithi186.stdout:Unit polkit.service does not exist, proceeding anyway. 2020-11-20T11:37:42.051 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /run/systemd/system/polkit.service -> /dev/null. 2020-11-20T11:37:42.142 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking policykit-1 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:42.147 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-6) ... 2020-11-20T11:37:42.273 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpolkit-agent-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:42.399 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b46-3) ... 2020-11-20T11:37:42.504 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-11-20T11:37:42.576 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:42.578 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager. 2020-11-20T11:37:42.592 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../25-network-manager_1.10.6-2ubuntu1.4_amd64.deb ... 2020-11-20T11:37:42.665 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:42.710 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-11-20T11:37:42.852 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.9.0+ds-2) ... 2020-11-20T11:37:42.987 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.6-15ubuntu2.5) ... 2020-11-20T11:37:43.326 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package ppp. 2020-11-20T11:37:43.333 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2020-11-20T11:37:43.333 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2020-11-20T11:37:43.342 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../26-ppp_2.4.7-2+2ubuntu1.3_amd64.deb ... 2020-11-20T11:37:43.623 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:43.668 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking ppp (2.4.7-2+2ubuntu1.3) ... 2020-11-20T11:37:43.749 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20170806-2) ... 2020-11-20T11:37:43.875 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu1) ... 2020-11-20T11:37:44.060 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpolkit-backend-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:44.090 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package pptp-linux. 2020-11-20T11:37:44.106 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../27-pptp-linux_1.9.0+ds-2_amd64.deb ... 2020-11-20T11:37:44.149 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking pptp-linux (1.9.0+ds-2) ... 2020-11-20T11:37:44.186 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:44.303 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.11-5) ... 2020-11-20T11:37:44.404 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:44.505 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-11-20T11:37:44.527 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package network-manager-pptp. 2020-11-20T11:37:44.543 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../28-network-manager-pptp_1.2.6-1_amd64.deb ... 2020-11-20T11:37:44.594 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking network-manager-pptp (1.2.6-1) ... 2020-11-20T11:37:44.614 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:44.704 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-11-20T11:37:44.774 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-11-20T11:37:44.880 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch-data. 2020-11-20T11:37:44.896 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../29-usb-modeswitch-data_20170806-2_all.deb ... 2020-11-20T11:37:44.900 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.6-1) ... 2020-11-20T11:37:44.946 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch-data (20170806-2) ... 2020-11-20T11:37:45.026 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up iputils-arping (3:20161105-1ubuntu3) ... 2020-11-20T11:37:45.160 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.26-1) ... 2020-11-20T11:37:45.286 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-11-20T11:37:45.341 INFO:teuthology.orchestra.run.smithi186.stdout:Selecting previously unselected package usb-modeswitch. 2020-11-20T11:37:45.355 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing to unpack .../30-usb-modeswitch_2.5.2+repack0-2ubuntu1_amd64.deb ... 2020-11-20T11:37:45.395 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up policykit-1 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:45.409 INFO:teuthology.orchestra.run.smithi186.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu1) ... 2020-11-20T11:37:45.683 INFO:teuthology.orchestra.run.smithi161.stdout:Removed /run/systemd/system/polkit.service. 2020-11-20T11:37:45.710 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-glib4:amd64 (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:45.829 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up ppp (2.4.7-2+2ubuntu1.3) ... 2020-11-20T11:37:45.948 INFO:teuthology.orchestra.run.smithi161.stdout:polkit.service is a disabled or a static unit not running, not starting it. 2020-11-20T11:37:46.076 INFO:teuthology.orchestra.run.smithi161.stdout:polkit.service is a disabled or a static unit, not starting it. 2020-11-20T11:37:46.115 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:46.241 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-11-20T11:37:46.367 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:46.493 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-11-20T11:37:46.636 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:46.716 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2020-11-20T11:37:46.861 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up flex (2.6.4-6) ... 2020-11-20T11:37:47.003 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpolkit-agent-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:47.130 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up dump (0.4b46-3) ... 2020-11-20T11:37:47.206 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:37:47.207 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2020-11-20T11:37:47.207 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2020-11-20T11:37:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2020-11-20T11:37:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2020-11-20T11:37:47.208 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2020-11-20T11:37:47.209 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:37:47.241 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-11-20T11:37:47.323 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libnm0:amd64 (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:47.331 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2020-11-20T11:37:47.449 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-11-20T11:37:47.562 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2020-11-20T11:37:47.575 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up pptp-linux (1.9.0+ds-2) ... 2020-11-20T11:37:47.743 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up wpasupplicant (2:2.6-15ubuntu2.5) ... 2020-11-20T11:37:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2020-11-20T11:37:48.122 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2020-11-20T11:37:48.123 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2020-11-20T11:37:48.323 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.6-1) ... 2020-11-20T11:37:48.404 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmbim-proxy (1.18.0-1~ubuntu18.04.1) ... 2020-11-20T11:37:48.500 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:48.531 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch-data (20170806-2) ... 2020-11-20T11:37:48.673 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu1) ... 2020-11-20T11:37:48.766 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2020-11-20T11:37:48.766 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2020-11-20T11:37:49.068 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libpolkit-backend-1-0:amd64 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:49.136 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-20T11:37:49.194 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libmm-glib0:amd64 (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:49.337 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up indent (2.2.11-5) ... 2020-11-20T11:37:49.345 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-20T11:37:49.463 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:49.598 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-11-20T11:37:49.740 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-11-20T11:37:49.828 INFO:teuthology.orchestra.run.smithi186.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-11-20T11:37:49.892 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-11-20T11:37:50.018 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libndp0:amd64 (1.6-1) ... 2020-11-20T11:37:50.144 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up iputils-arping (3:20161105-1ubuntu3) ... 2020-11-20T11:37:50.270 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libteamdctl0:amd64 (1.26-1) ... 2020-11-20T11:37:50.396 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-11-20T11:37:50.531 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up policykit-1 (0.105-20ubuntu0.18.04.5) ... 2020-11-20T11:37:50.873 INFO:teuthology.orchestra.run.smithi186.stdout:Removed /run/systemd/system/polkit.service. 2020-11-20T11:37:51.134 INFO:teuthology.orchestra.run.smithi186.stdout:polkit.service is a disabled or a static unit not running, not starting it. 2020-11-20T11:37:51.284 INFO:teuthology.orchestra.run.smithi186.stdout:polkit.service is a disabled or a static unit, not starting it. 2020-11-20T11:37:51.325 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-glib5:amd64 (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:51.452 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-11-20T11:37:51.603 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libqmi-proxy (1.22.0-1.2~ubuntu18.04.1) ... 2020-11-20T11:37:51.729 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-11-20T11:37:51.838 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.2-1ubuntu1.2) ... 2020-11-20T11:37:51.855 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager (1.10.6-2ubuntu1.4) ... 2020-11-20T11:37:51.922 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2020-11-20T11:37:52.291 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-20T11:37:52.408 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-11-20T11:37:52.479 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:37:52.480 INFO:teuthology.orchestra.run.smithi186.stdout:The following network interfaces were found in /etc/network/interfaces 2020-11-20T11:37:52.480 INFO:teuthology.orchestra.run.smithi186.stdout:which means they are currently configured by ifupdown: 2020-11-20T11:37:52.480 INFO:teuthology.orchestra.run.smithi186.stdout:- enp3s0f1 2020-11-20T11:37:52.480 INFO:teuthology.orchestra.run.smithi186.stdout:If you want to manage those interfaces with NetworkManager instead 2020-11-20T11:37:52.481 INFO:teuthology.orchestra.run.smithi186.stdout:remove their configuration from /etc/network/interfaces. 2020-11-20T11:37:52.481 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:37:52.609 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2020-11-20T11:37:52.659 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-20T11:37:52.851 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2020-11-20T11:37:53.103 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2020-11-20T11:37:53.125 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-20T11:37:53.127 DEBUG:teuthology.parallel:result is None 2020-11-20T11:37:53.601 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up network-manager-pptp (1.2.6-1) ... 2020-11-20T11:37:53.777 INFO:teuthology.orchestra.run.smithi186.stdout:Setting up modemmanager (1.10.0-1~ubuntu18.04.2) ... 2020-11-20T11:37:54.090 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2020-11-20T11:37:54.090 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2020-11-20T11:37:54.438 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-11-20T11:37:54.631 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-11-20T11:37:57.034 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for dbus (1.12.2-1ubuntu1.2) ... 2020-11-20T11:37:57.125 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2020-11-20T11:37:57.519 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-11-20T11:37:57.620 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-11-20T11:37:57.888 INFO:teuthology.orchestra.run.smithi186.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2020-11-20T11:37:58.340 INFO:teuthology.orchestra.run.smithi186.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-11-20T11:37:58.342 DEBUG:teuthology.parallel:result is None 2020-11-20T11:37:58.343 INFO:teuthology.orchestra.run.smithi161:> sudo lsb_release -is 2020-11-20T11:37:58.399 INFO:teuthology.orchestra.run.smithi161.stdout:Ubuntu 2020-11-20T11:37:58.404 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:37:58.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:37:58.566 INFO:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2020-11-20T11:37:58.593 INFO:teuthology.orchestra.run.smithi161.stdout:16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:37:58.594 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:37:58.594 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397-gb86e691b-1bionic is installed. 2020-11-20T11:37:58.595 INFO:teuthology.orchestra.run.smithi186:> sudo lsb_release -is 2020-11-20T11:37:58.649 INFO:teuthology.orchestra.run.smithi186.stdout:Ubuntu 2020-11-20T11:37:58.655 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-11-20T11:37:58.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:37:58.825 INFO:teuthology.orchestra.run.smithi186:> dpkg-query -W -f '${Version}' ceph 2020-11-20T11:37:58.851 INFO:teuthology.orchestra.run.smithi186.stdout:16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:37:58.851 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397-gb86e691b-1bionic 2020-11-20T11:37:58.852 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397-gb86e691b-1bionic is installed. 2020-11-20T11:37:58.852 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T11:37:58.853 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:37:58.853 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:37:58.858 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:37:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:24+1 records in 2020-11-20T11:37:58.869 INFO:teuthology.orchestra.run.smithi161.stderr:24+1 records out 2020-11-20T11:37:58.869 INFO:teuthology.orchestra.run.smithi161.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.00022828 s, 55.5 MB/s 2020-11-20T11:37:58.870 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:37:58.871 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:37:58.897 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T11:37:58.904 INFO:teuthology.orchestra.run.smithi186.stderr:24+1 records in 2020-11-20T11:37:58.905 INFO:teuthology.orchestra.run.smithi186.stderr:24+1 records out 2020-11-20T11:37:58.905 INFO:teuthology.orchestra.run.smithi186.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000224944 s, 56.3 MB/s 2020-11-20T11:37:58.906 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T11:37:58.906 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:37:58.907 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:37:58.917 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:37:58.926 INFO:teuthology.orchestra.run.smithi161.stderr:5+1 records in 2020-11-20T11:37:58.926 INFO:teuthology.orchestra.run.smithi161.stderr:5+1 records out 2020-11-20T11:37:58.926 INFO:teuthology.orchestra.run.smithi161.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000104337 s, 29.3 MB/s 2020-11-20T11:37:58.927 INFO:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:37:58.983 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:37:59.035 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:37:59.047 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T11:37:59.056 INFO:teuthology.orchestra.run.smithi186.stderr:5+1 records in 2020-11-20T11:37:59.056 INFO:teuthology.orchestra.run.smithi186.stderr:5+1 records out 2020-11-20T11:37:59.056 INFO:teuthology.orchestra.run.smithi186.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000100763 s, 30.3 MB/s 2020-11-20T11:37:59.057 INFO:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T11:37:59.124 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T11:37:59.125 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:37:59.125 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:37:59.138 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:37:59.182 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:37:59.182 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:37:59.183 INFO:teuthology.orchestra.run.smithi161.stderr:299 bytes copied, 0.0353144 s, 8.5 kB/s 2020-11-20T11:37:59.184 INFO:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:37:59.241 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:37:59.242 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:37:59.252 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T11:37:59.299 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:37:59.300 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:37:59.300 INFO:teuthology.orchestra.run.smithi186.stderr:299 bytes copied, 0.0376582 s, 7.9 kB/s 2020-11-20T11:37:59.302 INFO:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T11:37:59.364 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T11:37:59.420 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T11:37:59.420 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2020-11-20T11:37:59.424 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2020-11-20T11:37:59.448 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T11:37:59.449 INFO:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:37:59.480 INFO:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T11:37:59.507 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T11:37:59.508 INFO:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:37:59.535 INFO:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T11:37:59.590 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T11:37:59.591 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T11:37:59.591 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T11:37:59.591 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:37:59.592 INFO:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:37:59.597 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:37:59.598 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:37:59.598 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:37:59.599 INFO:teuthology.orchestra.run.smithi161.stderr:408 bytes copied, 7.785e-05 s, 5.2 MB/s 2020-11-20T11:37:59.599 INFO:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:59.675 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:37:59.675 INFO:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:37:59.680 INFO:teuthology.orchestra.run.smithi186.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T11:37:59.682 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:37:59.682 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:37:59.682 INFO:teuthology.orchestra.run.smithi186.stderr:408 bytes copied, 8e-05 s, 5.1 MB/s 2020-11-20T11:37:59.682 INFO:teuthology.orchestra.run.smithi186:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T11:37:59.766 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T11:37:59.766 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T11:37:59.766 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640265', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.21167', 'targets': {'smithi161.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDS1Kmf7hjzfvWtlKhUj9M4a33C9L7/+qPGBe9TPhahGYYPhwdiTvVVLWxSWVe0mNIVIJTqd1Xy8McKJoCWPBJDpEk05v2vYj3R/tg/keESUOY4paA+0Ex/QIIaQ9bFWLJYIXKL4PNGhNnbMAeDblWPdO4TH32LchbPl5uQXCITkqAFiQUlFQRgEaAzsd3mmkbBpYP0s0r99TKDVCYhzmTgOD4+u53kTYchp2b4g8zPpk6QGPIQjv4s6aSLhV0gPVyO2p6RzCbb4945j5QbCiVcL4/tICpcfegBqki48rmGlffBUmB/6m8pnRCtPnJV15IKJJfL/Ayn9ef5UKdXw0bJ', 'smithi186.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD78tJzxz9SbzfIoMd9DF2Ij5TEAq2agXdWYp+K87vMXW0BEiL63goPkI8JvTrySdpcKGJVkoDTMqT+TyeSn2gtH2dX3+3mF+OHHh83ETXHDgu69zNiyf7UXghsQ0TkP7SUNxGzRKoMTKFrhi4eNKYtsUKoliMLannqsi88p7hZYy/kmxSiFxVtRrtv3awcWiXJg9sDr15PwVE1z2XogSzYkjplh3hoH5fsZIXX1jbACXC92hvqEUo8W1uNWg+/L4a93xdIFoVo1ug9Zl/tFqzDkqp4CTeU2p0wcc6VhGEX+2B5FwJVp6H9ZieqEGO0anQrgViEZC3jeh9rReweQYt1'}} 2020-11-20T11:37:59.767 INFO:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:37:59.770 INFO:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T11:37:59.807 INFO:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:37:59.819 INFO:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T11:37:59.863 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:37:59.864 INFO:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:37:59.876 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:37:59.878 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:37:59.878 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:37:59.878 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:37:59.878 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:37:59.879 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:37:59.879 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:37:59.879 INFO:teuthology.orchestra.run.smithi161.stderr:72 bytes copied, 0.000134483 s, 535 kB/s 2020-11-20T11:37:59.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:37:59.880 INFO:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:37:59.927 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:37:59.928 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:37:59.928 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-11-20T11:37:59.928 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:37:59.928 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2020-11-20 11:35:03.903657617 +0000 2020-11-20T11:37:59.928 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2020-11-20 11:35:03.899659616 +0000 2020-11-20T11:37:59.929 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2020-11-20 11:35:03.899659616 +0000 2020-11-20T11:37:59.929 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2020-11-20T11:37:59.937 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2020-11-20T11:37:59.937 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2020-11-20T11:37:59.938 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000389001 s, 1.3 MB/s 2020-11-20T11:37:59.942 INFO:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:37:59.991 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:37:59.992 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:37:59.992 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-11-20T11:37:59.992 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:37:59.992 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2020-11-20 11:35:04.115551612 +0000 2020-11-20T11:37:59.993 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2020-11-20 11:35:04.111553612 +0000 2020-11-20T11:37:59.993 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2020-11-20 11:35:04.111553612 +0000 2020-11-20T11:37:59.993 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2020-11-20T11:38:00.000 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2020-11-20T11:38:00.001 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2020-11-20T11:38:00.001 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000361453 s, 1.4 MB/s 2020-11-20T11:38:00.003 INFO:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:38:00.051 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:38:00.052 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.052 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-11-20T11:38:00.052 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.052 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2020-11-20 11:35:04.351433607 +0000 2020-11-20T11:38:00.053 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2020-11-20 11:35:04.347435606 +0000 2020-11-20T11:38:00.053 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2020-11-20 11:35:04.347435606 +0000 2020-11-20T11:38:00.053 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2020-11-20T11:38:00.061 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2020-11-20T11:38:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2020-11-20T11:38:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00038262 s, 1.3 MB/s 2020-11-20T11:38:00.067 INFO:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:38:00.115 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:38:00.116 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.116 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 6h/6d Inode: 360 Links: 1 2020-11-20T11:38:00.116 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.116 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2020-11-20 11:35:04.571323602 +0000 2020-11-20T11:38:00.117 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2020-11-20 11:35:04.567325601 +0000 2020-11-20T11:38:00.117 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2020-11-20 11:35:04.567325601 +0000 2020-11-20T11:38:00.117 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2020-11-20T11:38:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2020-11-20T11:38:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2020-11-20T11:38:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000415557 s, 1.2 MB/s 2020-11-20T11:38:00.129 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:00.130 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:00.130 INFO:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:38:00.135 INFO:teuthology.orchestra.run.smithi186.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T11:38:00.136 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/vg_nvme/lv_1 2020-11-20T11:38:00.137 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/vg_nvme/lv_2 2020-11-20T11:38:00.137 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/vg_nvme/lv_3 2020-11-20T11:38:00.137 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/vg_nvme/lv_4 2020-11-20T11:38:00.137 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:00.138 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:00.138 INFO:teuthology.orchestra.run.smithi186.stderr:72 bytes copied, 0.00017621 s, 409 kB/s 2020-11-20T11:38:00.138 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T11:38:00.138 INFO:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T11:38:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T11:38:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.188 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-11-20T11:38:00.188 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.188 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2020-11-20 11:35:04.601673126 +0000 2020-11-20T11:38:00.188 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2020-11-20 11:35:04.501673129 +0000 2020-11-20T11:38:00.188 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2020-11-20 11:35:04.501673129 +0000 2020-11-20T11:38:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2020-11-20T11:38:00.197 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2020-11-20T11:38:00.197 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2020-11-20T11:38:00.197 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.00039337 s, 1.3 MB/s 2020-11-20T11:38:00.201 INFO:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T11:38:00.251 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T11:38:00.251 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.252 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-11-20T11:38:00.252 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.252 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2020-11-20 11:35:04.853673121 +0000 2020-11-20T11:38:00.252 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2020-11-20 11:35:04.745673123 +0000 2020-11-20T11:38:00.253 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2020-11-20 11:35:04.745673123 +0000 2020-11-20T11:38:00.253 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2020-11-20T11:38:00.261 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2020-11-20T11:38:00.261 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2020-11-20T11:38:00.261 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000374221 s, 1.4 MB/s 2020-11-20T11:38:00.265 INFO:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T11:38:00.315 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T11:38:00.315 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.315 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-11-20T11:38:00.316 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.316 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2020-11-20 11:35:05.101673115 +0000 2020-11-20T11:38:00.316 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2020-11-20 11:35:04.985673118 +0000 2020-11-20T11:38:00.316 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2020-11-20 11:35:04.985673118 +0000 2020-11-20T11:38:00.316 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2020-11-20T11:38:00.324 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2020-11-20T11:38:00.324 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2020-11-20T11:38:00.324 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000329398 s, 1.6 MB/s 2020-11-20T11:38:00.328 INFO:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T11:38:00.379 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T11:38:00.379 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T11:38:00.379 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 6h/6d Inode: 360 Links: 1 2020-11-20T11:38:00.380 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:38:00.380 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2020-11-20 11:35:05.361673109 +0000 2020-11-20T11:38:00.380 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2020-11-20 11:35:05.269673111 +0000 2020-11-20T11:38:00.380 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2020-11-20 11:35:05.269673111 +0000 2020-11-20T11:38:00.380 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: - 2020-11-20T11:38:00.389 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2020-11-20T11:38:00.389 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2020-11-20T11:38:00.389 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000411584 s, 1.2 MB/s 2020-11-20T11:38:00.393 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:00.393 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:38:00.394 INFO:tasks.ceph:Generating config... 2020-11-20T11:38:00.395 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T11:38:00.395 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T11:38:00.395 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T11:38:00.396 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T11:38:00.396 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T11:38:00.396 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T11:38:00.397 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T11:38:00.397 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T11:38:00.397 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T11:38:00.397 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T11:38:00.398 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T11:38:00.398 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T11:38:00.398 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T11:38:00.398 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T11:38:00.399 INFO:tasks.ceph:[mds] mds inject traceless reply probability = 0.5 2020-11-20T11:38:00.399 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T11:38:00.399 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T11:38:00.400 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T11:38:00.400 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T11:38:00.400 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T11:38:00.400 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T11:38:00.401 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T11:38:00.401 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T11:38:00.401 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T11:38:00.401 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T11:38:00.402 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T11:38:00.402 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T11:38:00.402 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T11:38:00.403 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T11:38:00.403 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T11:38:00.403 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T11:38:00.403 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T11:38:00.404 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T11:38:00.404 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T11:38:00.404 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T11:38:00.404 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T11:38:00.405 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T11:38:00.405 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T11:38:00.406 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T11:38:00.406 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T11:38:00.406 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T11:38:00.407 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T11:38:00.407 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T11:38:00.440 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T11:38:00.442 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T11:38:00.519 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:38:00.579 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.161'), ('mon.b', '172.21.15.186'), ('mon.c', '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]')] 2020-11-20T11:38:00.580 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds inject traceless reply probability': 0.5, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T11:38:00.581 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:00.581 INFO:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:38:00.624 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:38:00.626 INFO:teuthology.orchestra.run.smithi161.stderr:6+1 records in 2020-11-20T11:38:00.626 INFO:teuthology.orchestra.run.smithi161.stderr:6+1 records out 2020-11-20T11:38:00.626 INFO:teuthology.orchestra.run.smithi161.stderr:3464 bytes (3.5 kB, 3.4 KiB) copied, 9.7818e-05 s, 35.4 MB/s 2020-11-20T11:38:00.627 INFO:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --add b 172.21.15.186 --addv c '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:00.705 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 416fbbe8-6418-42c8-b3e0-6e08bacfe8cc 2020-11-20T11:38:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2020-11-20T11:38:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 416fbbe8-6418-42c8-b3e0-6e08bacfe8cc 2020-11-20T11:38:00.706 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2020-11-20T11:38:00.708821+0000 2020-11-20T11:38:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:created 2020-11-20T11:38:00.708821+0000 2020-11-20T11:38:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 0 (unknown) 2020-11-20T11:38:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2020-11-20T11:38:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2020-11-20T11:38:00.707 INFO:teuthology.orchestra.run.smithi161.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2020-11-20T11:38:00.708 INFO:teuthology.orchestra.run.smithi161.stdout:2: [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] mon.c 2020-11-20T11:38:00.708 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T11:38:00.709 INFO:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T11:38:00.759 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 416fbbe8-6418-42c8-b3e0-6e08bacfe8cc... 2020-11-20T11:38:00.761 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:38:00.802 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T11:38:00.832 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2020-11-20T11:38:00.833 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2020-11-20T11:38:00.833 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:38:00.833 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2020-11-20T11:38:00.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.834 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2020-11-20T11:38:00.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.834 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2020-11-20T11:38:00.834 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.835 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2020-11-20T11:38:00.835 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2020-11-20T11:38:00.835 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.835 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2020-11-20T11:38:00.836 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2020-11-20T11:38:00.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:38:00.836 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2020-11-20T11:38:00.836 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.837 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:38:00.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:38:00.837 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.837 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2020-11-20T11:38:00.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.838 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2020-11-20T11:38:00.838 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2020-11-20T11:38:00.838 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:38:00.839 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:38:00.839 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2020-11-20T11:38:00.839 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:38:00.839 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2020-11-20T11:38:00.840 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:38:00.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:38:00.841 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2020-11-20T11:38:00.841 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.841 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:38:00.841 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.842 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2020-11-20T11:38:00.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.842 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2020-11-20T11:38:00.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.843 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2020-11-20T11:38:00.843 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2020-11-20T11:38:00.843 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2020-11-20T11:38:00.843 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.161,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2020-11-20T11:38:00.843 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 416fbbe8-6418-42c8-b3e0-6e08bacfe8cc 2020-11-20T11:38:00.844 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.844 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2020-11-20T11:38:00.844 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2020-11-20T11:38:00.844 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.844 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2020-11-20T11:38:00.845 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2020-11-20T11:38:00.845 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.845 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2020-11-20T11:38:00.845 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2020-11-20T11:38:00.845 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.846 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2020-11-20T11:38:00.846 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2020-11-20T11:38:00.846 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2020-11-20T11:38:00.846 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.846 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2020-11-20T11:38:00.847 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2020-11-20T11:38:00.847 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.847 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:38:00.847 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.847 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2020-11-20T11:38:00.848 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.848 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2020-11-20T11:38:00.848 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.848 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:38:00.849 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2020-11-20T11:38:00.849 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.849 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2020-11-20T11:38:00.849 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2020-11-20T11:38:00.849 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2020-11-20T11:38:00.850 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2020-11-20T11:38:00.850 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 20 2020-11-20T11:38:00.850 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 20 2020-11-20T11:38:00.850 INFO:teuthology.orchestra.run.smithi161.stdout: debug filestore = 20 2020-11-20T11:38:00.850 INFO:teuthology.orchestra.run.smithi161.stdout: debug journal = 20 2020-11-20T11:38:00.851 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 20 2020-11-20T11:38:00.851 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 25 2020-11-20T11:38:00.851 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 10 2020-11-20T11:38:00.851 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:38:00.851 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2020-11-20T11:38:00.852 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:38:00.852 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:38:00.852 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2020-11-20T11:38:00.852 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2020-11-20T11:38:00.852 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.853 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2020-11-20T11:38:00.853 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2020-11-20T11:38:00.853 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2020-11-20T11:38:00.853 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2020-11-20T11:38:00.853 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2020-11-20T11:38:00.854 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:38:00.854 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:38:00.854 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2020-11-20T11:38:00.854 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.854 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2020-11-20T11:38:00.855 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2020-11-20T11:38:00.855 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2020-11-20T11:38:00.855 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2020-11-20T11:38:00.855 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2020-11-20T11:38:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2020-11-20T11:38:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2020-11-20T11:38:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:38:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2020-11-20T11:38:00.856 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2020-11-20T11:38:00.857 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:38:00.857 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2020-11-20T11:38:00.857 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:00.857 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2020-11-20T11:38:00.857 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2020-11-20T11:38:00.858 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2020-11-20T11:38:00.858 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2020-11-20T11:38:00.858 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:38:00.858 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:38:00.858 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2020-11-20T11:38:00.859 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2020-11-20T11:38:00.859 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2020-11-20T11:38:00.859 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2020-11-20T11:38:00.859 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2020-11-20T11:38:00.859 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2020-11-20T11:38:00.860 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2020-11-20T11:38:00.860 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2020-11-20T11:38:00.860 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2020-11-20T11:38:00.860 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2020-11-20T11:38:00.860 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2020-11-20T11:38:00.861 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2020-11-20T11:38:00.861 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2020-11-20T11:38:00.861 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal frag = True 2020-11-20T11:38:00.861 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal fragment size max = 10000 2020-11-20T11:38:00.861 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal merge size = 5 2020-11-20T11:38:00.862 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split bits = 3 2020-11-20T11:38:00.862 INFO:teuthology.orchestra.run.smithi161.stdout: mds bal split size = 100 2020-11-20T11:38:00.862 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2020-11-20T11:38:00.862 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2020-11-20T11:38:00.862 INFO:teuthology.orchestra.run.smithi161.stdout: mds inject traceless reply probability = 0.5 2020-11-20T11:38:00.863 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2020-11-20T11:38:00.863 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2020-11-20T11:38:00.863 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2020-11-20T11:38:00.863 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 15m 2020-11-20T11:38:00.863 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 15m 2020-11-20T11:38:00.865 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2020-11-20T11:38:00.865 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2020-11-20T11:38:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T11:38:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2020-11-20T11:38:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2020-11-20T11:38:00.866 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2020-11-20T11:38:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2020-11-20T11:38:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2020-11-20T11:38:00.867 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2020-11-20T11:38:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2020-11-20T11:38:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T11:38:00.868 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2020-11-20T11:38:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T11:38:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T11:38:00.869 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2020-11-20T11:38:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2020-11-20T11:38:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2020-11-20T11:38:00.870 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2020-11-20T11:38:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2020-11-20T11:38:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2020-11-20T11:38:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2020-11-20T11:38:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2020-11-20T11:38:00.871 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.872 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2020-11-20T11:38:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2020-11-20T11:38:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.873 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2020-11-20T11:38:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2020-11-20T11:38:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2020-11-20T11:38:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.161,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2020-11-20T11:38:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = 416fbbe8-6418-42c8-b3e0-6e08bacfe8cc 2020-11-20T11:38:00.874 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.875 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2020-11-20T11:38:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2020-11-20T11:38:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2020-11-20T11:38:00.875 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2020-11-20T11:38:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2020-11-20T11:38:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2020-11-20T11:38:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.876 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2020-11-20T11:38:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2020-11-20T11:38:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2020-11-20T11:38:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2020-11-20T11:38:00.877 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2020-11-20T11:38:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2020-11-20T11:38:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2020-11-20T11:38:00.878 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2020-11-20T11:38:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2020-11-20T11:38:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2020-11-20T11:38:00.879 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2020-11-20T11:38:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2020-11-20T11:38:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2020-11-20T11:38:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2020-11-20T11:38:00.880 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 20 2020-11-20T11:38:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 20 2020-11-20T11:38:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: debug filestore = 20 2020-11-20T11:38:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: debug journal = 20 2020-11-20T11:38:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 20 2020-11-20T11:38:00.881 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 25 2020-11-20T11:38:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 10 2020-11-20T11:38:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T11:38:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2020-11-20T11:38:00.882 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2020-11-20T11:38:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2020-11-20T11:38:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2020-11-20T11:38:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2020-11-20T11:38:00.883 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.883 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:38:00.884 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:38:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2020-11-20T11:38:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.885 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2020-11-20T11:38:00.885 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2020-11-20T11:38:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2020-11-20T11:38:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2020-11-20T11:38:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2020-11-20T11:38:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2020-11-20T11:38:00.886 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2020-11-20T11:38:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2020-11-20T11:38:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2020-11-20T11:38:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2020-11-20T11:38:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2020-11-20T11:38:00.887 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2020-11-20T11:38:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: 2020-11-20T11:38:00.888 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2020-11-20T11:38:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2020-11-20T11:38:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2020-11-20T11:38:00.888 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2020-11-20T11:38:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T11:38:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T11:38:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2020-11-20T11:38:00.889 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2020-11-20T11:38:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2020-11-20T11:38:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 15m 2020-11-20T11:38:00.890 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 15m 2020-11-20T11:38:00.890 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2020-11-20T11:38:00.890 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2020-11-20T11:38:00.891 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2020-11-20T11:38:00.891 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2020-11-20T11:38:00.891 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2020-11-20T11:38:00.891 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2020-11-20T11:38:00.891 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2020-11-20T11:38:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2020-11-20T11:38:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: mds bal frag = True 2020-11-20T11:38:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: mds bal fragment size max = 10000 2020-11-20T11:38:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: mds bal merge size = 5 2020-11-20T11:38:00.892 INFO:teuthology.orchestra.run.smithi186.stdout: mds bal split bits = 3 2020-11-20T11:38:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: mds bal split size = 100 2020-11-20T11:38:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2020-11-20T11:38:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2020-11-20T11:38:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: mds inject traceless reply probability = 0.5 2020-11-20T11:38:00.893 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2020-11-20T11:38:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2020-11-20T11:38:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2020-11-20T11:38:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 15m 2020-11-20T11:38:00.894 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 15m 2020-11-20T11:38:00.895 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T11:38:00.895 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T11:38:00.954 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T11:38:00.955 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:00.955 INFO:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:38:00.970 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T11:38:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:00.971 INFO:teuthology.orchestra.run.smithi161.stderr:206 bytes copied, 0.000159489 s, 1.3 MB/s 2020-11-20T11:38:00.971 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.] 2020-11-20T11:38:00.972 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCYqrdf7y72HhAAJsjbV93vMNZJNqpMnNNY1Q== 2020-11-20T11:38:00.972 INFO:teuthology.orchestra.run.smithi161.stdout:[client.admin] 2020-11-20T11:38:00.972 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCYqrdfaAD8OBAA4cgykpP/9GT+f7b3d0NR3Q== 2020-11-20T11:38:00.972 INFO:teuthology.orchestra.run.smithi161.stdout: caps mds = "allow *" 2020-11-20T11:38:00.973 INFO:teuthology.orchestra.run.smithi161.stdout: caps mgr = "allow *" 2020-11-20T11:38:00.973 INFO:teuthology.orchestra.run.smithi161.stdout: caps mon = "allow *" 2020-11-20T11:38:00.973 INFO:teuthology.orchestra.run.smithi161.stdout: caps osd = "allow *" 2020-11-20T11:38:00.973 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:00.974 INFO:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:38:01.024 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T11:38:01.026 INFO:teuthology.orchestra.run.smithi161.stdout: �Ao��dBȳ�n�������_A�?*���_A�?*�aXa �����bXb �����cXc �����abc 2020-11-20T11:38:01.026 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:01.026 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:01.026 INFO:teuthology.orchestra.run.smithi161.stderr:409 bytes copied, 0.00017281 s, 2.4 MB/s 2020-11-20T11:38:01.027 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:38:01.027 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:01.027 INFO:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:38:01.028 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:38:01.080 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:38:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:01.128 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:206 bytes copied, 0.0386186 s, 5.3 kB/s 2020-11-20T11:38:01.129 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:38:01.139 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:01.140 INFO:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:01.191 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:01.236 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:01.237 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:01.237 INFO:teuthology.orchestra.run.smithi161.stderr:409 bytes copied, 0.0434491 s, 9.4 kB/s 2020-11-20T11:38:01.237 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:38:01.238 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:01.238 INFO:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:38:01.238 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:38:01.247 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T11:38:01.258 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:01.258 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:01.258 INFO:teuthology.orchestra.run.smithi186.stderr:206 bytes copied, 7.922e-05 s, 2.6 MB/s 2020-11-20T11:38:01.259 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T11:38:01.267 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:01.268 INFO:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:01.317 INFO:teuthology.orchestra.run.smithi186.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:01.320 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:01.320 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:01.320 INFO:teuthology.orchestra.run.smithi186.stderr:409 bytes copied, 7.4983e-05 s, 5.5 MB/s 2020-11-20T11:38:01.321 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T11:38:01.321 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T11:38:01.321 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:38:01.365 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T11:38:01.368 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:38:01.412 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T11:38:01.414 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T11:38:01.415 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:38:01.457 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T11:38:01.459 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T11:38:01.516 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:38:01.556 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T11:38:01.558 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T11:38:01.615 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T11:38:01.616 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T11:38:01.649 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T11:38:01.662 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T11:38:01.662 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-11-20T11:38:01.663 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T11:38:01.720 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:01.720 INFO:tasks.ceph:role: osd.0 2020-11-20T11:38:01.720 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:38:01.721 INFO:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:38:02.245 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:02.246 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:02.246 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:02.246 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:02.246 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:02.247 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:02.247 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:02.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2020-11-20T11:38:02.248 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T11:38:02.324 INFO:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T11:38:02.336 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:02.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:02.337 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T11:38:02.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:02.396 INFO:tasks.ceph:role: osd.1 2020-11-20T11:38:02.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:38:02.396 INFO:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:38:02.919 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:02.919 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:02.920 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:02.920 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:02.920 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:02.920 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:02.920 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:02.921 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:02.921 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:02.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2020-11-20T11:38:02.922 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-11-20T11:38:02.982 INFO:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T11:38:02.999 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:02.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:03.000 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T11:38:03.071 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:03.072 INFO:tasks.ceph:role: osd.2 2020-11-20T11:38:03.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:38:03.072 INFO:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:38:03.609 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:03.610 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:03.610 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:03.610 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:03.610 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:03.610 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:03.611 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:03.611 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:03.611 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:03.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2020-11-20T11:38:03.612 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-11-20T11:38:03.668 INFO:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T11:38:03.730 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:03.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:03.732 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T11:38:03.793 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:03.793 INFO:tasks.ceph:role: osd.3 2020-11-20T11:38:03.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T11:38:03.794 INFO:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:38:04.326 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:04.327 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:04.327 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:04.328 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:04.328 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:04.328 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:04.329 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:04.329 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:04.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2020-11-20T11:38:04.331 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-11-20T11:38:04.404 INFO:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T11:38:04.415 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:04.416 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:04.417 INFO:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:04.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.527+0000 7fa33b0d7d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T11:38:04.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.527+0000 7fa33b0d7d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T11:38:04.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.527+0000 7fa33b0d7d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:38:04.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.527+0000 7fa33b0d7d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:38:04.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.527+0000 7fa33b0d7d80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T11:38:04.536 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:04.535+0000 7fa33b0d7d80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T11:38:07.517 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T11:38:07.531 INFO:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T11:38:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T11:38:07.610 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:38:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:38:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T11:38:07.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:07.611+0000 7f710e1f0d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T11:38:10.565 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T11:38:10.624 INFO:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:10.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T11:38:10.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T11:38:10.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:38:10.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:38:10.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T11:38:10.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:10.707+0000 7f98b886dd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T11:38:13.688 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T11:38:13.744 INFO:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:13.830 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T11:38:13.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T11:38:13.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:38:13.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:38:13.834 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T11:38:13.835 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:13.827+0000 7f09515bcd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T11:38:16.772 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T11:38:16.827 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T11:38:16.843 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:16.843 INFO:tasks.ceph:role: osd.4 2020-11-20T11:38:16.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:38:16.844 INFO:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T11:38:17.372 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:17.372 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:17.372 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:17.372 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:17.373 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:17.373 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:17.373 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:17.373 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:17.373 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:17.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2020-11-20T11:38:17.375 INFO:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-11-20T11:38:17.435 INFO:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T11:38:17.442 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:17.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:17.444 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T11:38:17.498 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:17.499 INFO:tasks.ceph:role: osd.5 2020-11-20T11:38:17.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:38:17.499 INFO:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T11:38:18.014 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:18.014 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:18.014 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:18.014 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:18.015 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:18.015 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:18.015 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:18.015 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:18.015 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:18.016 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2020-11-20T11:38:18.017 INFO:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T11:38:18.097 INFO:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T11:38:18.109 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:18.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:18.110 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T11:38:18.167 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:18.167 INFO:tasks.ceph:role: osd.6 2020-11-20T11:38:18.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:38:18.168 INFO:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T11:38:18.670 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:18.670 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:18.670 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:18.671 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:18.671 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:18.671 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:18.671 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:18.671 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:18.672 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:18.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2020-11-20T11:38:18.673 INFO:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T11:38:18.723 INFO:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T11:38:18.734 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:18.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:18.735 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T11:38:18.789 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-11-20T11:38:18.790 INFO:tasks.ceph:role: osd.7 2020-11-20T11:38:18.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T11:38:18.791 INFO:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T11:38:19.329 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T11:38:19.329 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T11:38:19.329 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-11-20T11:38:19.329 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T11:38:19.330 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2020-11-20T11:38:19.330 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-11-20T11:38:19.330 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T11:38:19.330 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T11:38:19.331 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T11:38:19.332 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2020-11-20T11:38:19.332 INFO:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-11-20T11:38:19.380 INFO:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T11:38:19.392 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: /sbin/restorecon: command not found 2020-11-20T11:38:19.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:38:19.393 INFO:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:19.496 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.494+0000 7f600ea11d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T11:38:19.498 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.498+0000 7f600ea11d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T11:38:19.498 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.498+0000 7f600ea11d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:38:19.498 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.498+0000 7f600ea11d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:38:19.499 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.498+0000 7f600ea11d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T11:38:19.505 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:19.506+0000 7f600ea11d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T11:38:22.473 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T11:38:22.501 INFO:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:22.589 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T11:38:22.590 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T11:38:22.590 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:38:22.590 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:38:22.591 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T11:38:22.591 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:22.590+0000 7f21b83ccd80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T11:38:25.533 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T11:38:25.598 INFO:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:25.682 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T11:38:25.682 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T11:38:25.682 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:38:25.682 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:38:25.683 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T11:38:25.683 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:25.682+0000 7f47d7d44d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T11:38:28.624 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T11:38:28.683 INFO:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:28.762 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T11:38:28.763 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T11:38:28.763 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:38:28.763 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:38:28.763 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T11:38:28.764 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:28.762+0000 7fdb4355ed80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T11:38:29.769 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:29.772 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:38:31.715 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T11:38:31.731 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T11:38:31.732 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.732 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:38:31.737 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T11:38:31.746 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2020-11-20T11:38:31.746 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfR+z5FRAAEPT8s7Quakqyxs3LDwudmA== 2020-11-20T11:38:31.747 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:31.747 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:31.747 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.000177884 s, 315 kB/s 2020-11-20T11:38:31.748 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.748 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:38:31.796 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T11:38:31.805 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2020-11-20T11:38:31.805 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfat92GxAA9hchzv63ehog3Ne8HZi1Pw== 2020-11-20T11:38:31.806 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:31.806 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:31.806 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.000165037 s, 339 kB/s 2020-11-20T11:38:31.807 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.807 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:38:31.852 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T11:38:31.861 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2020-11-20T11:38:31.861 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCcqrdfi/ioHxAASIRuj+9cS8hZjBWbCRfbZg== 2020-11-20T11:38:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.00015225 s, 368 kB/s 2020-11-20T11:38:31.863 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.864 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:38:31.912 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T11:38:31.921 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2020-11-20T11:38:31.922 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCfqrdf9SCQJBAAUHwvgFgQkQxiZiHKGFCWvw== 2020-11-20T11:38:31.922 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:31.922 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:31.922 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.0001546 s, 362 kB/s 2020-11-20T11:38:31.923 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.924 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:38:31.968 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T11:38:31.977 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2020-11-20T11:38:31.977 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCiqrdfdFxaKhAAe0VQvQMRaOo2Y7fwT2FZfQ== 2020-11-20T11:38:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.000164274 s, 341 kB/s 2020-11-20T11:38:31.979 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:31.979 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:38:32.024 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T11:38:32.032 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2020-11-20T11:38:32.032 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQClqrdfiYCFMRAA7XJXRkd49WqAfHB+fSoq1w== 2020-11-20T11:38:32.032 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:32.032 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:32.033 INFO:teuthology.orchestra.run.smithi161.stderr:56 bytes copied, 0.00015756 s, 355 kB/s 2020-11-20T11:38:32.034 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.034 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:38:32.039 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T11:38:32.048 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2020-11-20T11:38:32.048 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfkE28GBAAxHDC9474MvON+PU3BAcyNw== 2020-11-20T11:38:32.048 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.048 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.049 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000169403 s, 331 kB/s 2020-11-20T11:38:32.050 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.050 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:38:32.096 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T11:38:32.105 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2020-11-20T11:38:32.105 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfk/hQIRAAyG4c892xh9Q+HVsftWUfXw== 2020-11-20T11:38:32.106 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.106 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.106 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000168627 s, 332 kB/s 2020-11-20T11:38:32.107 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.107 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:38:32.152 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T11:38:32.161 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2020-11-20T11:38:32.161 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCrqrdfh6zFHRAASPNxt5HtqRj56xMNVC3EJA== 2020-11-20T11:38:32.161 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.161 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.162 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000166753 s, 336 kB/s 2020-11-20T11:38:32.163 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.163 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:38:32.208 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T11:38:32.217 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2020-11-20T11:38:32.217 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCuqrdfDFVPIxAADNcgWrkqpxPamAJ0NQVjoQ== 2020-11-20T11:38:32.217 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.218 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.218 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000199717 s, 280 kB/s 2020-11-20T11:38:32.219 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.219 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:38:32.264 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T11:38:32.273 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2020-11-20T11:38:32.273 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCxqrdf8SLQKBAAAjodoo2rUWU8u+8FPyzvig== 2020-11-20T11:38:32.274 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.274 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.274 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000159544 s, 351 kB/s 2020-11-20T11:38:32.275 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:32.275 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:38:32.320 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T11:38:32.329 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2020-11-20T11:38:32.329 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQC0qrdfyo6jLRAAujOWMQgjNG+svuBR75BZZA== 2020-11-20T11:38:32.329 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:32.330 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:32.330 INFO:teuthology.orchestra.run.smithi186.stderr:56 bytes copied, 0.000157646 s, 355 kB/s 2020-11-20T11:38:32.331 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:32.331 INFO:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:38:32.337 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T11:38:32.338 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2020-11-20T11:38:32.338 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfauPvJhAA3JRw8tZTxjazOm38MDvyOA== 2020-11-20T11:38:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:59 bytes copied, 0.00015839 s, 372 kB/s 2020-11-20T11:38:32.339 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T11:38:32.340 INFO:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:38:32.382 INFO:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T11:38:32.393 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2020-11-20T11:38:32.393 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfR+z5FRAAEPT8s7Quakqyxs3LDwudmA== 2020-11-20T11:38:32.393 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2020-11-20T11:38:32.394 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfat92GxAA9hchzv63ehog3Ne8HZi1Pw== 2020-11-20T11:38:32.394 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2020-11-20T11:38:32.394 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCcqrdfi/ioHxAASIRuj+9cS8hZjBWbCRfbZg== 2020-11-20T11:38:32.394 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2020-11-20T11:38:32.394 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCfqrdf9SCQJBAAUHwvgFgQkQxiZiHKGFCWvw== 2020-11-20T11:38:32.395 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2020-11-20T11:38:32.395 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCiqrdfdFxaKhAAe0VQvQMRaOo2Y7fwT2FZfQ== 2020-11-20T11:38:32.395 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2020-11-20T11:38:32.395 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQClqrdfiYCFMRAA7XJXRkd49WqAfHB+fSoq1w== 2020-11-20T11:38:32.395 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2020-11-20T11:38:32.396 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfkE28GBAAxHDC9474MvON+PU3BAcyNw== 2020-11-20T11:38:32.396 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2020-11-20T11:38:32.396 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfk/hQIRAAyG4c892xh9Q+HVsftWUfXw== 2020-11-20T11:38:32.396 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2020-11-20T11:38:32.396 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCrqrdfh6zFHRAASPNxt5HtqRj56xMNVC3EJA== 2020-11-20T11:38:32.397 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2020-11-20T11:38:32.397 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCuqrdfDFVPIxAADNcgWrkqpxPamAJ0NQVjoQ== 2020-11-20T11:38:32.397 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2020-11-20T11:38:32.397 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCxqrdf8SLQKBAAAjodoo2rUWU8u+8FPyzvig== 2020-11-20T11:38:32.398 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2020-11-20T11:38:32.398 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQC0qrdfyo6jLRAAujOWMQgjNG+svuBR75BZZA== 2020-11-20T11:38:32.398 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2020-11-20T11:38:32.398 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQCZqrdfauPvJhAA3JRw8tZTxjazOm38MDvyOA== 2020-11-20T11:38:32.399 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2020-11-20T11:38:32.400 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfR+z5FRAAEPT8s7Quakqyxs3LDwudmA== 2020-11-20T11:38:32.400 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2020-11-20T11:38:32.400 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfat92GxAA9hchzv63ehog3Ne8HZi1Pw== 2020-11-20T11:38:32.400 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2020-11-20T11:38:32.401 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCcqrdfi/ioHxAASIRuj+9cS8hZjBWbCRfbZg== 2020-11-20T11:38:32.401 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2020-11-20T11:38:32.401 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCfqrdf9SCQJBAAUHwvgFgQkQxiZiHKGFCWvw== 2020-11-20T11:38:32.401 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2020-11-20T11:38:32.401 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCiqrdfdFxaKhAAe0VQvQMRaOo2Y7fwT2FZfQ== 2020-11-20T11:38:32.402 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2020-11-20T11:38:32.402 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQClqrdfiYCFMRAA7XJXRkd49WqAfHB+fSoq1w== 2020-11-20T11:38:32.402 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2020-11-20T11:38:32.402 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfkE28GBAAxHDC9474MvON+PU3BAcyNw== 2020-11-20T11:38:32.402 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2020-11-20T11:38:32.403 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfk/hQIRAAyG4c892xh9Q+HVsftWUfXw== 2020-11-20T11:38:32.403 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2020-11-20T11:38:32.403 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCrqrdfh6zFHRAASPNxt5HtqRj56xMNVC3EJA== 2020-11-20T11:38:32.403 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2020-11-20T11:38:32.403 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCuqrdfDFVPIxAADNcgWrkqpxPamAJ0NQVjoQ== 2020-11-20T11:38:32.404 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2020-11-20T11:38:32.404 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCxqrdf8SLQKBAAAjodoo2rUWU8u+8FPyzvig== 2020-11-20T11:38:32.404 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2020-11-20T11:38:32.404 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQC0qrdfyo6jLRAAujOWMQgjNG+svuBR75BZZA== 2020-11-20T11:38:32.404 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2020-11-20T11:38:32.405 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQCZqrdfauPvJhAA3JRw8tZTxjazOm38MDvyOA== 2020-11-20T11:38:32.405 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:38:32.442 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:38:32.485 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:38:32.526 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:38:32.572 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.574 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.657 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.660 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.742 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.745 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.826 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.830 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:32.910 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:38:32.914 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T11:38:32.993 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:38:32.998 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T11:38:33.080 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.083 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.165 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.169 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.248 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.275 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.361 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.378 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T11:38:33.482 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:38:33.501 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T11:38:33.579 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T11:38:33.580 INFO:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T11:38:33.614 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:38:33.741 INFO:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T11:38:33.759 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T11:38:33.780 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:38:33.897 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T11:38:33.914 INFO:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T11:38:33.971 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T11:38:34.084 INFO:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T11:38:34.099 INFO:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:34.102 INFO:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T11:38:34.145 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T11:38:34.146 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T11:38:34.147 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T11:38:34.149 INFO:tasks.ceph.mon.a:Started 2020-11-20T11:38:34.150 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T11:38:34.150 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T11:38:34.189 INFO:tasks.ceph.mon.b:Started 2020-11-20T11:38:34.190 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T11:38:34.190 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T11:38:34.193 INFO:tasks.ceph.mon.c:Started 2020-11-20T11:38:34.193 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T11:38:34.194 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T11:38:34.194 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T11:38:34.197 INFO:tasks.ceph.mgr.y:Started 2020-11-20T11:38:34.197 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T11:38:34.197 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T11:38:34.200 INFO:tasks.ceph.mgr.x:Started 2020-11-20T11:38:34.200 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T11:38:34.201 INFO:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T11:38:34.467 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.467+0000 7f4e3469d700 1 Processor -- start 2020-11-20T11:38:34.468 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.467+0000 7f4e3469d700 1 -- start start 2020-11-20T11:38:34.470 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e3469d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.470 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e3469d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e2c1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.470 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e3469d700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c0a9f50 con 0x7f4e2c138cc0 2020-11-20T11:38:34.470 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e3469d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c0a9d60 con 0x7f4e2c0a7720 2020-11-20T11:38:34.470 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e3469d700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0aa1f0 con 0x7f4e2c0ab500 2020-11-20T11:38:34.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36250/0 (socket says 172.21.15.161:36250) 2020-11-20T11:38:34.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 -- 172.21.15.161:0/2339898897 learned_addr learned my addr 172.21.15.161:0/2339898897 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:34.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 -- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 msgr2=0x7f4e2c0ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T11:38:34.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 -- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 msgr2=0x7f4e2c0ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:38:34.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 --2- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:38:34.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e32439700 1 --2- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:38:34.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e2c1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e31c38700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 msgr2=0x7f4e2c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T11:38:34.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e31c38700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 msgr2=0x7f4e2c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T11:38:34.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e2c1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T11:38:34.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.471+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e2c1387d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T11:38:34.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.523+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010531845 0 0) 0x7f4e2c0a9f50 con 0x7f4e2c138cc0 2020-11-20T11:38:34.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.523+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e14003240 con 0x7f4e2c138cc0 2020-11-20T11:38:34.527 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3823939253 0 0) 0x7f4e14003240 con 0x7f4e2c138cc0 2020-11-20T11:38:34.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 msgr2=0x7f4e2c1387d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:38:34.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e2c1387d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 msgr2=0x7f4e2c0ab010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T11:38:34.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 --2- 172.21.15.161:0/2339898897 >> v2:172.21.15.161:3300/0 conn(0x7f4e2c0a7720 0x7f4e2c0ab010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0aa490 con 0x7f4e2c138cc0 2020-11-20T11:38:34.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f4e24001860 con 0x7f4e2c138cc0 2020-11-20T11:38:34.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 >> v1:172.21.15.186:6789/0 conn(0x7f4e2c138cc0 legacy=0x7f4e2c13bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:34.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e140037b0 0x7f4e14003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e140044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140049d0 0x7f4e14004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0aa1f0 con 0x7f4e140037b0 2020-11-20T11:38:34.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140042a0 con 0x7f4e140049d0 2020-11-20T11:38:34.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1400b730 con 0x7f4e2c0ab500 2020-11-20T11:38:34.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e140044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.531 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e32439700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e140037b0 0x7f4e14003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.531 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e32c3a700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140049d0 0x7f4e14004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140049d0 msgr2=0x7f4e14004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:34.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e140049d0 0x7f4e14004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e140037b0 msgr2=0x7f4e14003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:34.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e140037b0 0x7f4e14003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.527+0000 7f4e31c38700 1 -- 172.21.15.161:0/2339898897 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14003240 con 0x7f4e2c0ab500 2020-11-20T11:38:34.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e31c38700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e140044e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4e1c006c00 tx=0x7f4e1c008040).ready entity=mon.2 client_cookie=ec561e37e25f28bf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:34.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00d830 con 0x7f4e2c0ab500 2020-11-20T11:38:34.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00d990 con 0x7f4e2c0ab500 2020-11-20T11:38:34.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e31437700 1 -- 172.21.15.161:0/2339898897 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c00dd10 con 0x7f4e2c0ab500 2020-11-20T11:38:34.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 -- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 msgr2=0x7f4e140044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:34.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 --2- 172.21.15.161:0/2339898897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c0ab500 0x7f4e140044e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4e1c006c00 tx=0x7f4e1c008040).stop 2020-11-20T11:38:34.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e32c3a700 1 -- 172.21.15.161:0/2339898897 reap_dead start 2020-11-20T11:38:34.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 -- 172.21.15.161:0/2339898897 shutdown_connections 2020-11-20T11:38:34.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 -- 172.21.15.161:0/2339898897 >> 172.21.15.161:0/2339898897 conn(0x7f4e2c062900 msgr2=0x7f4e2c062ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 -- 172.21.15.161:0/2339898897 shutdown_connections 2020-11-20T11:38:34.536 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.531+0000 7f4e3469d700 1 -- 172.21.15.161:0/2339898897 wait complete. 2020-11-20T11:38:34.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 Processor -- start 2020-11-20T11:38:34.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 -- start start 2020-11-20T11:38:34.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e2c0a4810 0x7f4e2c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c14b3d0 0x7f4e2c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:34.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c14bd40 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0a2980 con 0x7f4e2c0a4810 2020-11-20T11:38:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e3469d700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0a2c20 con 0x7f4e2c14b3d0 2020-11-20T11:38:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e31c38700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e2c0a4810 0x7f4e2c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36278/0 (socket says 172.21.15.161:36278) 2020-11-20T11:38:34.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 -- 172.21.15.161:0/3564456343 learned_addr learned my addr 172.21.15.161:0/3564456343 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32c3a700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c14b3d0 0x7f4e2c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 -- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c14b3d0 msgr2=0x7f4e2c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c14b3d0 0x7f4e2c14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 -- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e2c0a4810 msgr2=0x7f4e2c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e2c0a4810 0x7f4e2c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 -- 172.21.15.161:0/3564456343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0a2ec0 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.535+0000 7f4e32439700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4e28010c20 tx=0x7f4e28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800e960 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2800eac0 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c0a22c0 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800ee40 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c0aec30 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f4e28024070 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f4e2801d770 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.539+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c069250 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.543+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f4e2803c880 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.620 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.623+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4e2c0a7b00 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.625 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e1a7fc700 1 -- 172.21.15.161:0/3564456343 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4e2802b070 con 0x7f4e2c0a1ee0 2020-11-20T11:38:34.626 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 msgr2=0x7f4e2c0ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4e28010c20 tx=0x7f4e28008040).stop 2020-11-20T11:38:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 shutdown_connections 2020-11-20T11:38:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e2c14b3d0 0x7f4e2c14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0a1ee0 0x7f4e2c0ae740 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 --2- 172.21.15.161:0/3564456343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e2c0a4810 0x7f4e2c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 >> 172.21.15.161:0/3564456343 conn(0x7f4e2c062900 msgr2=0x7f4e2c062ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 shutdown_connections 2020-11-20T11:38:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:34.627+0000 7f4e3469d700 1 -- 172.21.15.161:0/3564456343 wait complete. 2020-11-20T11:38:34.629 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2020-11-20T11:38:34.641 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T11:38:34.642 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:34.642 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:38:34.647 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T11:38:34.654 INFO:teuthology.orchestra.run.smithi161.stdout:55c9ae94-487e-4cfe-b057-5806f0d6480d 2020-11-20T11:38:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:37 bytes copied, 6.6289e-05 s, 558 kB/s 2020-11-20T11:38:34.655 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:34.656 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:38:34.704 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T11:38:34.712 INFO:teuthology.orchestra.run.smithi161.stdout:bedce536-93d0-4197-ab10-de0a13a598e6 2020-11-20T11:38:34.712 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:34.712 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:34.713 INFO:teuthology.orchestra.run.smithi161.stderr:37 bytes copied, 0.000138915 s, 266 kB/s 2020-11-20T11:38:34.713 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:34.714 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:38:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T11:38:34.769 INFO:teuthology.orchestra.run.smithi161.stdout:9e56f2c4-17dc-46b4-bf8b-511dc51c3bee 2020-11-20T11:38:34.770 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:34.770 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:34.770 INFO:teuthology.orchestra.run.smithi161.stderr:37 bytes copied, 0.00016827 s, 220 kB/s 2020-11-20T11:38:34.771 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:38:34.771 INFO:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:38:34.816 INFO:teuthology.orchestra.run.smithi161.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T11:38:34.823 INFO:teuthology.orchestra.run.smithi161.stdout:7f02c681-34ee-48ab-bac9-d70f4ab31cec 2020-11-20T11:38:34.823 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2020-11-20T11:38:34.823 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2020-11-20T11:38:34.824 INFO:teuthology.orchestra.run.smithi161.stderr:37 bytes copied, 0.000177094 s, 209 kB/s 2020-11-20T11:38:34.824 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:34.825 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:38:34.830 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T11:38:34.839 INFO:teuthology.orchestra.run.smithi186.stdout:f03f7266-583f-41cb-a70b-da2c3d4f11fa 2020-11-20T11:38:34.840 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:34.840 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:34.840 INFO:teuthology.orchestra.run.smithi186.stderr:37 bytes copied, 0.000162936 s, 227 kB/s 2020-11-20T11:38:34.841 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:34.841 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:38:34.888 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T11:38:34.896 INFO:teuthology.orchestra.run.smithi186.stdout:6baffc6e-5a02-4a37-90ba-b221ecd507cf 2020-11-20T11:38:34.896 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:34.897 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:34.897 INFO:teuthology.orchestra.run.smithi186.stderr:37 bytes copied, 0.000207497 s, 178 kB/s 2020-11-20T11:38:34.898 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:34.898 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:38:34.944 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T11:38:34.951 INFO:teuthology.orchestra.run.smithi186.stdout:4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70 2020-11-20T11:38:34.951 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:34.952 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:34.952 INFO:teuthology.orchestra.run.smithi186.stderr:37 bytes copied, 0.000195023 s, 190 kB/s 2020-11-20T11:38:34.953 INFO:teuthology.orchestra.run.smithi186:> set -ex 2020-11-20T11:38:34.953 INFO:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:38:35.000 INFO:teuthology.orchestra.run.smithi186.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T11:38:35.009 INFO:teuthology.orchestra.run.smithi186.stdout:9625c4a8-73ac-43e1-9eee-758543842754 2020-11-20T11:38:35.009 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2020-11-20T11:38:35.009 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2020-11-20T11:38:35.010 INFO:teuthology.orchestra.run.smithi186.stderr:37 bytes copied, 0.00019511 s, 190 kB/s 2020-11-20T11:38:35.011 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 55c9ae94-487e-4cfe-b057-5806f0d6480d 0 2020-11-20T11:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 Processor -- start 2020-11-20T11:38:35.183 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 -- start start 2020-11-20T11:38:35.185 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 0x7f508c13a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.185 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.185 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c060260 con 0x7f508c0609a0 2020-11-20T11:38:35.186 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c138300 con 0x7f508c0ab310 2020-11-20T11:38:35.186 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5092d9c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c060500 con 0x7f508c0aaf30 2020-11-20T11:38:35.186 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5091d9a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 0x7f508c13a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.186 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.182+0000 7f5091599700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.186 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091599700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32810/0 (socket says 172.21.15.186:32810) 2020-11-20T11:38:35.187 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091599700 1 -- 172.21.15.186:0/2910655252 learned_addr learned my addr 172.21.15.186:0/2910655252 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.187 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091d9a700 1 -- 172.21.15.186:0/2910655252 >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 msgr2=0x7f508c061350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:35.187 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091d9a700 1 --2- 172.21.15.186:0/2910655252 >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.187 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091d9a700 1 -- 172.21.15.186:0/2910655252 >> v1:172.21.15.186:6789/0 conn(0x7f508c0609a0 legacy=0x7f508c137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.188 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091d9a700 1 -- 172.21.15.186:0/2910655252 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c13ace0 con 0x7f508c0aaf30 2020-11-20T11:38:35.188 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091599700 1 --2- 172.21.15.186:0/2910655252 >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:35.188 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5091d9a700 1 --2- 172.21.15.186:0/2910655252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 0x7f508c13a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f507c00b9a0 tx=0x7f507c006df0).ready entity=mon.2 client_cookie=6c97ac6101117d9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.188 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5090d98700 1 -- 172.21.15.186:0/2910655252 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0097b0 con 0x7f508c0aaf30 2020-11-20T11:38:35.188 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5090d98700 1 -- 172.21.15.186:0/2910655252 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c009910 con 0x7f508c0aaf30 2020-11-20T11:38:35.189 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5090d98700 1 -- 172.21.15.186:0/2910655252 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c009c90 con 0x7f508c0aaf30 2020-11-20T11:38:35.191 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 -- 172.21.15.186:0/2910655252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 msgr2=0x7f508c13a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.191 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2910655252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 0x7f508c13a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f507c00b9a0 tx=0x7f507c006df0).stop 2020-11-20T11:38:35.192 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 -- 172.21.15.186:0/2910655252 shutdown_connections 2020-11-20T11:38:35.192 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2910655252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0aaf30 0x7f508c13a7f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.192 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2910655252 >> v2:172.21.15.186:3300/0 conn(0x7f508c0ab310 0x7f508c061350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.192 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 -- 172.21.15.186:0/2910655252 >> 172.21.15.186:0/2910655252 conn(0x7f508c0ae850 msgr2=0x7f508c0aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.192 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 -- 172.21.15.186:0/2910655252 shutdown_connections 2020-11-20T11:38:35.193 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.186+0000 7f5092d9c700 1 -- 172.21.15.186:0/2910655252 wait complete. 2020-11-20T11:38:35.193 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 Processor -- start 2020-11-20T11:38:35.193 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- start start 2020-11-20T11:38:35.193 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.194 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c0aaf30 0x7f508c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.194 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f508c0ab310 0x7f508c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.194 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c149a50 con 0x7f508c0aaf30 2020-11-20T11:38:35.194 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0a40f0 con 0x7f508c0ab310 2020-11-20T11:38:35.194 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0a4390 con 0x7f508c0609a0 2020-11-20T11:38:35.195 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.195 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37232/0 (socket says 172.21.15.186:37232) 2020-11-20T11:38:35.195 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 -- 172.21.15.186:0/2570298216 learned_addr learned my addr 172.21.15.186:0/2570298216 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.195 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f509259b700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f508c0ab310 0x7f508c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.196 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091599700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c0aaf30 0x7f508c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.196 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 -- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f508c0ab310 msgr2=0x7f508c0a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.196 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f508c0ab310 0x7f508c0a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.196 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 -- 172.21.15.186:0/2570298216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c0aaf30 msgr2=0x7f508c0a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.196 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c0aaf30 0x7f508c0a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.197 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 -- 172.21.15.186:0/2570298216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c0a3db0 con 0x7f508c0609a0 2020-11-20T11:38:35.197 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5091d9a700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f507c006fd0 tx=0x7f507c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.197 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c011d50 con 0x7f508c0609a0 2020-11-20T11:38:35.197 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c01e460 con 0x7f508c0609a0 2020-11-20T11:38:35.197 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c13cd10 con 0x7f508c0609a0 2020-11-20T11:38:35.198 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c01e7e0 con 0x7f508c0609a0 2020-11-20T11:38:35.198 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c0a3160 con 0x7f508c0609a0 2020-11-20T11:38:35.198 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f507c025030 con 0x7f508c0609a0 2020-11-20T11:38:35.198 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.190+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f507c0287b0 con 0x7f508c0609a0 2020-11-20T11:38:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.194+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c141f70 con 0x7f508c0609a0 2020-11-20T11:38:35.199 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.198+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f507c02d060 con 0x7f508c0609a0 2020-11-20T11:38:35.279 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.278+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "55c9ae94-487e-4cfe-b057-5806f0d6480d", "id": 0} v 0) v1 -- 0x7f508c044f60 con 0x7f508c0609a0 2020-11-20T11:38:35.286 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5089ffb700 1 -- 172.21.15.186:0/2570298216 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55c9ae94-487e-4cfe-b057-5806f0d6480d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f507c023070 con 0x7f508c0609a0 2020-11-20T11:38:35.287 INFO:teuthology.orchestra.run.smithi186.stdout:0 2020-11-20T11:38:35.288 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 msgr2=0x7f508c141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.288 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f507c006fd0 tx=0x7f507c015000).stop 2020-11-20T11:38:35.288 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 shutdown_connections 2020-11-20T11:38:35.288 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f508c0ab310 0x7f508c0a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.289 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f508c0609a0 0x7f508c141a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.289 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 --2- 172.21.15.186:0/2570298216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f508c0aaf30 0x7f508c0a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.289 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 >> 172.21.15.186:0/2570298216 conn(0x7f508c0ae850 msgr2=0x7f508c0acfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.289 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 shutdown_connections 2020-11-20T11:38:35.289 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.286+0000 7f5092d9c700 1 -- 172.21.15.186:0/2570298216 wait complete. 2020-11-20T11:38:35.300 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new bedce536-93d0-4197-ab10-de0a13a598e6 1 2020-11-20T11:38:35.419 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.418+0000 7faf9cc7b700 1 Processor -- start 2020-11-20T11:38:35.420 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.418+0000 7faf9cc7b700 1 -- start start 2020-11-20T11:38:35.421 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf980aaf30 0x7faf9813bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.422 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faf980aa1f0 0x7faf9813c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.422 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980a9af0 con 0x7faf980ab310 2020-11-20T11:38:35.422 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf98060e30 con 0x7faf980aaf30 2020-11-20T11:38:35.422 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980aa620 con 0x7faf980aa1f0 2020-11-20T11:38:35.422 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faf980aa1f0 0x7faf9813c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faf980aa1f0 0x7faf9813c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32824/0 (socket says 172.21.15.186:32824) 2020-11-20T11:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 -- 172.21.15.186:0/3646530490 learned_addr learned my addr 172.21.15.186:0/3646530490 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf977fe700 1 --2- 172.21.15.186:0/3646530490 >> v2:172.21.15.161:3300/0 conn(0x7faf980aaf30 0x7faf9813bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 -- 172.21.15.186:0/3646530490 >> v2:172.21.15.161:3300/0 conn(0x7faf980aaf30 msgr2=0x7faf9813bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:35.423 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 --2- 172.21.15.186:0/3646530490 >> v2:172.21.15.161:3300/0 conn(0x7faf980aaf30 0x7faf9813bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.424 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 -- 172.21.15.186:0/3646530490 >> v1:172.21.15.161:6789/0 conn(0x7faf980ab310 legacy=0x7faf98060720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.424 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 -- 172.21.15.186:0/3646530490 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980a9d50 con 0x7faf980aa1f0 2020-11-20T11:38:35.424 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf97fff700 1 --2- 172.21.15.186:0/3646530490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980aa1f0 0x7faf9813c1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7faf9813c050 tx=0x7faf90009290).ready entity=mon.1 client_cookie=63baef257c6affe2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.424 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf96ffd700 1 -- 172.21.15.186:0/3646530490 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9000bbc0 con 0x7faf980aa1f0 2020-11-20T11:38:35.425 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf96ffd700 1 -- 172.21.15.186:0/3646530490 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000bd20 con 0x7faf980aa1f0 2020-11-20T11:38:35.425 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf96ffd700 1 -- 172.21.15.186:0/3646530490 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90011610 con 0x7faf980aa1f0 2020-11-20T11:38:35.427 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- 172.21.15.186:0/3646530490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980aa1f0 msgr2=0x7faf9813c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/3646530490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980aa1f0 0x7faf9813c1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7faf9813c050 tx=0x7faf90009290).stop 2020-11-20T11:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- 172.21.15.186:0/3646530490 shutdown_connections 2020-11-20T11:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/3646530490 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980aa1f0 0x7faf9813c1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.428 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/3646530490 >> v2:172.21.15.161:3300/0 conn(0x7faf980aaf30 0x7faf9813bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- 172.21.15.186:0/3646530490 >> 172.21.15.186:0/3646530490 conn(0x7faf980ae850 msgr2=0x7faf980aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- 172.21.15.186:0/3646530490 shutdown_connections 2020-11-20T11:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.422+0000 7faf9cc7b700 1 -- 172.21.15.186:0/3646530490 wait complete. 2020-11-20T11:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 Processor -- start 2020-11-20T11:38:35.429 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- start start 2020-11-20T11:38:35.430 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf980aa1f0 0x7faf9809eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.430 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf980aaf30 0x7faf980a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.430 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.430 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980a03a0 con 0x7faf980aaf30 2020-11-20T11:38:35.431 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980a0640 con 0x7faf980ab310 2020-11-20T11:38:35.431 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980a08e0 con 0x7faf980aa1f0 2020-11-20T11:38:35.431 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.431 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32830/0 (socket says 172.21.15.186:32830) 2020-11-20T11:38:35.431 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 -- 172.21.15.186:0/2362103886 learned_addr learned my addr 172.21.15.186:0/2362103886 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.432 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf977fe700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf980aa1f0 0x7faf9809eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.432 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8ffff700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf980aaf30 0x7faf980a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.432 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 -- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf980aa1f0 msgr2=0x7faf9809eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.432 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf980aa1f0 0x7faf9809eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.432 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 -- 172.21.15.186:0/2362103886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf980aaf30 msgr2=0x7faf980a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.433 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf980aaf30 0x7faf980a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.433 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 -- 172.21.15.186:0/2362103886 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9809e320 con 0x7faf980ab310 2020-11-20T11:38:35.433 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf97fff700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7faf980ab780 tx=0x7faf90016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.433 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90011e70 con 0x7faf980ab310 2020-11-20T11:38:35.433 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000be90 con 0x7faf980ab310 2020-11-20T11:38:35.434 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf98138880 con 0x7faf980ab310 2020-11-20T11:38:35.434 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90010cb0 con 0x7faf980ab310 2020-11-20T11:38:35.434 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9809dc50 con 0x7faf980ab310 2020-11-20T11:38:35.434 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7faf90017070 con 0x7faf980ab310 2020-11-20T11:38:35.434 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.426+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7faf90026840 con 0x7faf980ab310 2020-11-20T11:38:35.435 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.430+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980a0aa0 con 0x7faf980ab310 2020-11-20T11:38:35.435 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.434+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7faf90015020 con 0x7faf980ab310 2020-11-20T11:38:35.506 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.506+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bedce536-93d0-4197-ab10-de0a13a598e6", "id": 1} v 0) v1 -- 0x7faf98044f60 con 0x7faf980ab310 2020-11-20T11:38:35.517 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf8f7fe700 1 -- 172.21.15.186:0/2362103886 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bedce536-93d0-4197-ab10-de0a13a598e6", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf90010e10 con 0x7faf980ab310 2020-11-20T11:38:35.518 INFO:teuthology.orchestra.run.smithi186.stdout:1 2020-11-20T11:38:35.519 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 msgr2=0x7faf9809d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.519 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7faf980ab780 tx=0x7faf90016000).stop 2020-11-20T11:38:35.519 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 shutdown_connections 2020-11-20T11:38:35.519 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faf980ab310 0x7faf9809d5c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.519 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faf980aa1f0 0x7faf9809eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.520 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 --2- 172.21.15.186:0/2362103886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf980aaf30 0x7faf980a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.520 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 >> 172.21.15.186:0/2362103886 conn(0x7faf980ae850 msgr2=0x7faf980ad330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.520 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 shutdown_connections 2020-11-20T11:38:35.520 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.518+0000 7faf9cc7b700 1 -- 172.21.15.186:0/2362103886 wait complete. 2020-11-20T11:38:35.534 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 9e56f2c4-17dc-46b4-bf8b-511dc51c3bee 2 2020-11-20T11:38:35.653 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 Processor -- start 2020-11-20T11:38:35.654 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 -- start start 2020-11-20T11:38:35.656 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 0x7f4c9c1344d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.656 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.657 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9c065220 con 0x7f4c9c0ab0d0 2020-11-20T11:38:35.657 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9c066390 con 0x7f4c9c067070 2020-11-20T11:38:35.657 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c13b1a0 con 0x7f4c9c0674d0 2020-11-20T11:38:35.657 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.658 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37254/0 (socket says 172.21.15.186:37254) 2020-11-20T11:38:35.658 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 -- 172.21.15.186:0/3256840609 learned_addr learned my addr 172.21.15.186:0/3256840609 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.658 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca110e700 1 --2- 172.21.15.186:0/3256840609 >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 0x7f4c9c1344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.658 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 -- 172.21.15.186:0/3256840609 >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 msgr2=0x7f4c9c1344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:35.658 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 --2- 172.21.15.186:0/3256840609 >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 0x7f4c9c1344d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.659 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 -- 172.21.15.186:0/3256840609 >> v1:172.21.15.161:6789/0 conn(0x7f4c9c0ab0d0 legacy=0x7f4c9c13aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.659 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 -- 172.21.15.186:0/3256840609 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c065450 con 0x7f4c9c0674d0 2020-11-20T11:38:35.659 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca110e700 1 --2- 172.21.15.186:0/3256840609 >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 0x7f4c9c1344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:35.659 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2110700 1 --2- 172.21.15.186:0/3256840609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4c94009d50 tx=0x7f4c94009290).ready entity=mon.2 client_cookie=9234ae16b852792a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.659 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca090d700 1 -- 172.21.15.186:0/3256840609 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400bc80 con 0x7f4c9c0674d0 2020-11-20T11:38:35.660 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca090d700 1 -- 172.21.15.186:0/3256840609 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9400bde0 con 0x7f4c9c0674d0 2020-11-20T11:38:35.660 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca090d700 1 -- 172.21.15.186:0/3256840609 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94011610 con 0x7f4c9c0674d0 2020-11-20T11:38:35.660 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 -- 172.21.15.186:0/3256840609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 msgr2=0x7f4c9c1349c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.660 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.654+0000 7f4ca2911700 1 --2- 172.21.15.186:0/3256840609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4c94009d50 tx=0x7f4c94009290).stop 2020-11-20T11:38:35.660 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- 172.21.15.186:0/3256840609 shutdown_connections 2020-11-20T11:38:35.661 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 --2- 172.21.15.186:0/3256840609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c0674d0 0x7f4c9c1349c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.661 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 --2- 172.21.15.186:0/3256840609 >> v2:172.21.15.161:3300/0 conn(0x7f4c9c067070 0x7f4c9c1344d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.661 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- 172.21.15.186:0/3256840609 >> 172.21.15.186:0/3256840609 conn(0x7f4c9c0ae850 msgr2=0x7f4c9c0aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.661 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- 172.21.15.186:0/3256840609 shutdown_connections 2020-11-20T11:38:35.661 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- 172.21.15.186:0/3256840609 wait complete. 2020-11-20T11:38:35.664 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 Processor -- start 2020-11-20T11:38:35.664 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- start start 2020-11-20T11:38:35.668 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.668 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 0x7f4c9c14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.669 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 0x7f4c9c136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.669 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c1352b0 con 0x7f4c9c0674d0 2020-11-20T11:38:35.669 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0a60f0 con 0x7f4c9c0ab0d0 2020-11-20T11:38:35.669 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2911700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9c0a6390 con 0x7f4c9c067070 2020-11-20T11:38:35.669 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.670 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2110700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 0x7f4c9c136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.670 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37256/0 (socket says 172.21.15.186:37256) 2020-11-20T11:38:35.670 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 -- 172.21.15.186:0/1361610651 learned_addr learned my addr 172.21.15.186:0/1361610651 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.670 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca110e700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 0x7f4c9c14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.670 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 -- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 msgr2=0x7f4c9c136560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.671 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 0x7f4c9c136560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.671 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 -- 172.21.15.186:0/1361610651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 msgr2=0x7f4c9c14b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.671 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 0x7f4c9c14b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.671 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 -- 172.21.15.186:0/1361610651 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c137560 con 0x7f4c9c067070 2020-11-20T11:38:35.671 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca2110700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 0x7f4c9c136560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca110e700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 0x7f4c9c14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.658+0000 7f4ca190f700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4c9800c6e0 tx=0x7f4c98007c50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98007020 con 0x7f4c9c067070 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98007180 con 0x7f4c9c067070 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980064f0 con 0x7f4c9c067070 2020-11-20T11:38:35.672 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9c14ab20 con 0x7f4c9c067070 2020-11-20T11:38:35.673 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9c135620 con 0x7f4c9c067070 2020-11-20T11:38:35.673 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f4c98010070 con 0x7f4c9c067070 2020-11-20T11:38:35.673 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f4c9800e930 con 0x7f4c9c067070 2020-11-20T11:38:35.673 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.662+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c0a6550 con 0x7f4c9c067070 2020-11-20T11:38:35.674 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.666+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f4c98020060 con 0x7f4c9c067070 2020-11-20T11:38:35.742 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.742+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9e56f2c4-17dc-46b4-bf8b-511dc51c3bee", "id": 2} v 0) v1 -- 0x7f4c9c044f60 con 0x7f4c9c067070 2020-11-20T11:38:35.754 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4c8dffb700 1 -- 172.21.15.186:0/1361610651 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e56f2c4-17dc-46b4-bf8b-511dc51c3bee", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c980290b0 con 0x7f4c9c067070 2020-11-20T11:38:35.755 INFO:teuthology.orchestra.run.smithi186.stdout:2 2020-11-20T11:38:35.756 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 msgr2=0x7f4c9c13e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.756 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f4c9800c6e0 tx=0x7f4c98007c50).stop 2020-11-20T11:38:35.756 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 shutdown_connections 2020-11-20T11:38:35.756 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c9c0ab0d0 0x7f4c9c136560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.757 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4c9c067070 0x7f4c9c13e130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.757 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 --2- 172.21.15.186:0/1361610651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c9c0674d0 0x7f4c9c14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.757 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 >> 172.21.15.186:0/1361610651 conn(0x7f4c9c0ae850 msgr2=0x7f4c9c133290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.758 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 shutdown_connections 2020-11-20T11:38:35.758 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.754+0000 7f4ca2911700 1 -- 172.21.15.186:0/1361610651 wait complete. 2020-11-20T11:38:35.770 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 7f02c681-34ee-48ab-bac9-d70f4ab31cec 3 2020-11-20T11:38:35.891 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 Processor -- start 2020-11-20T11:38:35.891 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 -- start start 2020-11-20T11:38:35.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 0x7f55280a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280a5810 con 0x7f5528142ae0 2020-11-20T11:38:35.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280a9600 con 0x7f552805be80 2020-11-20T11:38:35.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.890+0000 7f552f144700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280a98a0 con 0x7f55280a9060 2020-11-20T11:38:35.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d941700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 0x7f55280a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552e142700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f552805be80 0x7f55281423d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:45300/0 (socket says 172.21.15.186:45300) 2020-11-20T11:38:35.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552e142700 1 -- 172.21.15.186:0/796793346 learned_addr learned my addr 172.21.15.186:0/796793346 (peer_addr_for_me v1:172.21.15.186:0/0) 2020-11-20T11:38:35.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d941700 1 -- 172.21.15.186:0/796793346 >> v1:172.21.15.186:6789/0 conn(0x7f552805be80 legacy=0x7f55281423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d941700 1 -- 172.21.15.186:0/796793346 >> v1:172.21.15.161:6789/0 conn(0x7f5528142ae0 legacy=0x7f55280a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d140700 1 -- 172.21.15.186:0/796793346 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453680130 0 0) 0x7f55280a9600 con 0x7f552805be80 2020-11-20T11:38:35.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d941700 1 -- 172.21.15.186:0/796793346 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55280a9b40 con 0x7f55280a9060 2020-11-20T11:38:35.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d941700 1 --2- 172.21.15.186:0/796793346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 0x7f55280a6cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f551800b9d0 tx=0x7f5518006df0).ready entity=mon.2 client_cookie=7e688f320b820602 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d140700 1 -- 172.21.15.186:0/796793346 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518009870 con 0x7f55280a9060 2020-11-20T11:38:35.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d140700 1 -- 172.21.15.186:0/796793346 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180099d0 con 0x7f55280a9060 2020-11-20T11:38:35.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552d140700 1 -- 172.21.15.186:0/796793346 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518009d50 con 0x7f55280a9060 2020-11-20T11:38:35.899 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 -- 172.21.15.186:0/796793346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 msgr2=0x7f55280a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.899 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 --2- 172.21.15.186:0/796793346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 0x7f55280a6cc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f551800b9d0 tx=0x7f5518006df0).stop 2020-11-20T11:38:35.899 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 -- 172.21.15.186:0/796793346 shutdown_connections 2020-11-20T11:38:35.899 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 --2- 172.21.15.186:0/796793346 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55280a9060 0x7f55280a6cc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.900 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 -- 172.21.15.186:0/796793346 >> 172.21.15.186:0/796793346 conn(0x7f55280ad530 msgr2=0x7f55280ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:35.900 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 -- 172.21.15.186:0/796793346 shutdown_connections 2020-11-20T11:38:35.900 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.894+0000 7f552f144700 1 -- 172.21.15.186:0/796793346 wait complete. 2020-11-20T11:38:35.900 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 Processor -- start 2020-11-20T11:38:35.901 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- start start 2020-11-20T11:38:35.901 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 0x7f5528066ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.901 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55280a9060 0x7f552809d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.901 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 0x7f55280a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:35.901 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528067dc0 con 0x7f55280a9060 2020-11-20T11:38:35.902 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55280673c0 con 0x7f552805be80 2020-11-20T11:38:35.902 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5528065800 con 0x7f5528142ae0 2020-11-20T11:38:35.902 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e142700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 0x7f5528066ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.902 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 0x7f55280a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.902 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e142700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 0x7f5528066ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32850/0 (socket says 172.21.15.186:32850) 2020-11-20T11:38:35.903 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e142700 1 -- 172.21.15.186:0/3040789497 learned_addr learned my addr 172.21.15.186:0/3040789497 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:35.903 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552d941700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55280a9060 0x7f552809d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:35.903 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 -- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 msgr2=0x7f5528066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.903 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 0x7f5528066ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.903 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 -- 172.21.15.186:0/3040789497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55280a9060 msgr2=0x7f552809d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:35.904 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55280a9060 0x7f552809d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:35.904 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 -- 172.21.15.186:0/3040789497 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528065aa0 con 0x7f5528142ae0 2020-11-20T11:38:35.904 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552e943700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 0x7f55280a0270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f552000c810 tx=0x7f5520007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:35.904 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520001340 con 0x7f5528142ae0 2020-11-20T11:38:35.904 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000e560 con 0x7f5528142ae0 2020-11-20T11:38:35.905 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5528065d40 con 0x7f5528142ae0 2020-11-20T11:38:35.905 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552000e8e0 con 0x7f5528142ae0 2020-11-20T11:38:35.905 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55280a3d60 con 0x7f5528142ae0 2020-11-20T11:38:35.905 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f5520010070 con 0x7f5528142ae0 2020-11-20T11:38:35.905 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f5520012400 con 0x7f5528142ae0 2020-11-20T11:38:35.906 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.898+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5528065ed0 con 0x7f5528142ae0 2020-11-20T11:38:35.906 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.902+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f552001b450 con 0x7f5528142ae0 2020-11-20T11:38:35.986 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.986+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f02c681-34ee-48ab-bac9-d70f4ab31cec", "id": 3} v 0) v1 -- 0x7f5528044f60 con 0x7f5528142ae0 2020-11-20T11:38:36.000 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:35.998+0000 7f55167fc700 1 -- 172.21.15.186:0/3040789497 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f02c681-34ee-48ab-bac9-d70f4ab31cec", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f552001bab0 con 0x7f5528142ae0 2020-11-20T11:38:36.000 INFO:teuthology.orchestra.run.smithi186.stdout:3 2020-11-20T11:38:36.002 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 msgr2=0x7f55280a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.002 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 0x7f55280a0270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f552000c810 tx=0x7f5520007f10).stop 2020-11-20T11:38:36.002 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 shutdown_connections 2020-11-20T11:38:36.002 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5528142ae0 0x7f55280a0270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.002 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f552805be80 0x7f5528066ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.003 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 --2- 172.21.15.186:0/3040789497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55280a9060 0x7f552809d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.003 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 >> 172.21.15.186:0/3040789497 conn(0x7f55280ad530 msgr2=0x7f55280ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.003 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 shutdown_connections 2020-11-20T11:38:36.003 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.002+0000 7f552f144700 1 -- 172.21.15.186:0/3040789497 wait complete. 2020-11-20T11:38:36.017 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new f03f7266-583f-41cb-a70b-da2c3d4f11fa 4 2020-11-20T11:38:36.142 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 Processor -- start 2020-11-20T11:38:36.143 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 -- start start 2020-11-20T11:38:36.145 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd5c40ab310 0x7fd5c413bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.146 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5c40aa1f0 0x7fd5c413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.146 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40a9af0 con 0x7fd5c40aaf30 2020-11-20T11:38:36.146 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c4060e30 con 0x7fd5c40aa1f0 2020-11-20T11:38:36.147 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c93ad700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40aa620 con 0x7fd5c40ab310 2020-11-20T11:38:36.148 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd5c40ab310 0x7fd5c413bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.148 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c3fff700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd5c40aaf30 0x7fd5c4060720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:45312/0 (socket says 172.21.15.186:45312) 2020-11-20T11:38:36.150 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c3fff700 1 -- 172.21.15.186:0/3607485777 learned_addr learned my addr 172.21.15.186:0/3607485777 (peer_addr_for_me v1:172.21.15.186:0/0) 2020-11-20T11:38:36.152 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c8bac700 1 --2- 172.21.15.186:0/3607485777 >> v2:172.21.15.161:3300/0 conn(0x7fd5c40aa1f0 0x7fd5c413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.153 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 -- 172.21.15.186:0/3607485777 >> v2:172.21.15.161:3300/0 conn(0x7fd5c40aa1f0 msgr2=0x7fd5c413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:36.156 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 --2- 172.21.15.186:0/3607485777 >> v2:172.21.15.161:3300/0 conn(0x7fd5c40aa1f0 0x7fd5c413c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.156 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 -- 172.21.15.186:0/3607485777 >> v1:172.21.15.186:6789/0 conn(0x7fd5c40aaf30 legacy=0x7fd5c4060720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.157 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 -- 172.21.15.186:0/3607485777 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40a9d50 con 0x7fd5c40ab310 2020-11-20T11:38:36.157 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5bbfff700 1 --2- 172.21.15.186:0/3607485777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c413bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd5c40652d0 tx=0x7fd5ac006df0).ready entity=mon.1 client_cookie=c0b0987a11165ac server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.157 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c37fe700 1 -- 172.21.15.186:0/3607485777 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0097b0 con 0x7fd5c40ab310 2020-11-20T11:38:36.157 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c37fe700 1 -- 172.21.15.186:0/3607485777 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac009910 con 0x7fd5c40ab310 2020-11-20T11:38:36.158 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.142+0000 7fd5c37fe700 1 -- 172.21.15.186:0/3607485777 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac009c90 con 0x7fd5c40ab310 2020-11-20T11:38:36.158 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- 172.21.15.186:0/3607485777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 msgr2=0x7fd5c413bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.158 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/3607485777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c413bb60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd5c40652d0 tx=0x7fd5ac006df0).stop 2020-11-20T11:38:36.158 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- 172.21.15.186:0/3607485777 shutdown_connections 2020-11-20T11:38:36.158 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/3607485777 >> v2:172.21.15.161:3300/0 conn(0x7fd5c40aa1f0 0x7fd5c413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.159 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/3607485777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c413bb60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.159 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- 172.21.15.186:0/3607485777 >> 172.21.15.186:0/3607485777 conn(0x7fd5c40ae850 msgr2=0x7fd5c40aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.159 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- 172.21.15.186:0/3607485777 shutdown_connections 2020-11-20T11:38:36.159 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- 172.21.15.186:0/3607485777 wait complete. 2020-11-20T11:38:36.162 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 Processor -- start 2020-11-20T11:38:36.162 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- start start 2020-11-20T11:38:36.162 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5c40aa1f0 0x7fd5c40a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.162 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 0x7fd5c413abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.163 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c41351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.163 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c409fc60 con 0x7fd5c40aa1f0 2020-11-20T11:38:36.163 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c4136200 con 0x7fd5c40ab310 2020-11-20T11:38:36.163 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c93ad700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c409f720 con 0x7fd5c40aaf30 2020-11-20T11:38:36.163 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5bbfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 0x7fd5c413abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.164 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5bbfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 0x7fd5c413abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37282/0 (socket says 172.21.15.186:37282) 2020-11-20T11:38:36.164 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5bbfff700 1 -- 172.21.15.186:0/1764508931 learned_addr learned my addr 172.21.15.186:0/1764508931 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.164 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c41351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.164 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c3fff700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5c40aa1f0 0x7fd5c40a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.164 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 -- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 msgr2=0x7fd5c413abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.165 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 0x7fd5c413abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.165 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 -- 172.21.15.186:0/1764508931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5c40aa1f0 msgr2=0x7fd5c40a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.165 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5c40aa1f0 0x7fd5c40a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.165 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 -- 172.21.15.186:0/1764508931 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c409f9c0 con 0x7fd5c40ab310 2020-11-20T11:38:36.166 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c8bac700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c41351e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd5bc00eb70 tx=0x7fd5bc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.166 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.146+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00c670 con 0x7fd5c40ab310 2020-11-20T11:38:36.166 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc00c7d0 con 0x7fd5c40ab310 2020-11-20T11:38:36.166 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc00cb50 con 0x7fd5c40ab310 2020-11-20T11:38:36.167 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c40a7e40 con 0x7fd5c40ab310 2020-11-20T11:38:36.167 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c41356d0 con 0x7fd5c40ab310 2020-11-20T11:38:36.167 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd5bc005cb0 con 0x7fd5c40ab310 2020-11-20T11:38:36.167 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fd5bc0069b0 con 0x7fd5c40ab310 2020-11-20T11:38:36.167 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c4044f60 con 0x7fd5c40ab310 2020-11-20T11:38:36.168 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.150+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd5bc00f040 con 0x7fd5c40ab310 2020-11-20T11:38:36.233 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.230+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f03f7266-583f-41cb-a70b-da2c3d4f11fa", "id": 4} v 0) v1 -- 0x7fd5c4061030 con 0x7fd5c40ab310 2020-11-20T11:38:36.243 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c0ff9700 1 -- 172.21.15.186:0/1764508931 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f03f7266-583f-41cb-a70b-da2c3d4f11fa", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd5bc02c0b0 con 0x7fd5c40ab310 2020-11-20T11:38:36.245 INFO:teuthology.orchestra.run.smithi186.stdout:4 2020-11-20T11:38:36.249 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 msgr2=0x7fd5c41351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.249 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c41351e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd5bc00eb70 tx=0x7fd5bc008040).stop 2020-11-20T11:38:36.249 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 shutdown_connections 2020-11-20T11:38:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5c40ab310 0x7fd5c41351e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5c40aa1f0 0x7fd5c40a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 --2- 172.21.15.186:0/1764508931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5c40aaf30 0x7fd5c413abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 >> 172.21.15.186:0/1764508931 conn(0x7fd5c40ae850 msgr2=0x7fd5c4138fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.250 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 shutdown_connections 2020-11-20T11:38:36.251 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.242+0000 7fd5c93ad700 1 -- 172.21.15.186:0/1764508931 wait complete. 2020-11-20T11:38:36.259 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 6baffc6e-5a02-4a37-90ba-b221ecd507cf 5 2020-11-20T11:38:36.388 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 Processor -- start 2020-11-20T11:38:36.389 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 -- start start 2020-11-20T11:38:36.389 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa1d405be80 0x7fa1d413e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.390 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.390 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d40a8620 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.391 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40a4cc0 con 0x7fa1d405be80 2020-11-20T11:38:36.391 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1da562700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d413ea30 con 0x7fa1d40a9310 2020-11-20T11:38:36.391 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d8d5f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.392 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d8d5f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37288/0 (socket says 172.21.15.186:37288) 2020-11-20T11:38:36.392 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d8d5f700 1 -- 172.21.15.186:0/1344984176 learned_addr learned my addr 172.21.15.186:0/1344984176 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.392 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d9560700 1 --2- 172.21.15.186:0/1344984176 >> v2:172.21.15.186:3300/0 conn(0x7fa1d405be80 0x7fa1d413e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.394 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d9560700 1 -- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 msgr2=0x7fa1d413e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:36.394 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d9560700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.395 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d9560700 1 -- 172.21.15.186:0/1344984176 >> v1:172.21.15.161:6789/0 conn(0x7fa1d40a6cc0 legacy=0x7fa1d40a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.395 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d9560700 1 -- 172.21.15.186:0/1344984176 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d40a88c0 con 0x7fa1d405be80 2020-11-20T11:38:36.398 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.378+0000 7fa1d8d5f700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:36.398 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d9560700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d405be80 0x7fa1d413e050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa1d000b9d0 tx=0x7fa1d0006df0).ready entity=mon.1 client_cookie=b86558be29b7ece7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.398 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1c3fff700 1 -- 172.21.15.186:0/1344984176 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0009770 con 0x7fa1d405be80 2020-11-20T11:38:36.399 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1c3fff700 1 -- 172.21.15.186:0/1344984176 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d00098d0 con 0x7fa1d405be80 2020-11-20T11:38:36.399 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1c3fff700 1 -- 172.21.15.186:0/1344984176 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0009c50 con 0x7fa1d405be80 2020-11-20T11:38:36.400 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d405be80 msgr2=0x7fa1d413e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.400 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d405be80 0x7fa1d413e050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fa1d000b9d0 tx=0x7fa1d0006df0).stop 2020-11-20T11:38:36.400 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- 172.21.15.186:0/1344984176 shutdown_connections 2020-11-20T11:38:36.401 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d405be80 0x7fa1d413e050 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.401 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- 172.21.15.186:0/1344984176 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d40a9310 0x7fa1d413e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.402 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- 172.21.15.186:0/1344984176 >> 172.21.15.186:0/1344984176 conn(0x7fa1d40ad530 msgr2=0x7fa1d40ad910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.402 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- 172.21.15.186:0/1344984176 shutdown_connections 2020-11-20T11:38:36.402 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- 172.21.15.186:0/1344984176 wait complete. 2020-11-20T11:38:36.403 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 Processor -- start 2020-11-20T11:38:36.403 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- start start 2020-11-20T11:38:36.403 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 0x7fa1d40679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.404 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.404 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 0x7fa1d4139cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.405 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4067f60 con 0x7fa1d40a9310 2020-11-20T11:38:36.405 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d4068200 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.405 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1da562700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d40684a0 con 0x7fa1d405be80 2020-11-20T11:38:36.406 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d8d5f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.406 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d9560700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 0x7fa1d40679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.406 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d8d5f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32876/0 (socket says 172.21.15.186:32876) 2020-11-20T11:38:36.407 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d8d5f700 1 -- 172.21.15.186:0/1600022037 learned_addr learned my addr 172.21.15.186:0/1600022037 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.407 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.382+0000 7fa1d9d61700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 0x7fa1d4139cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.407 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 -- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 msgr2=0x7fa1d40679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.408 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 0x7fa1d40679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.408 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 -- 172.21.15.186:0/1600022037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 msgr2=0x7fa1d4139cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.409 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 0x7fa1d4139cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.409 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 -- 172.21.15.186:0/1600022037 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d413bb20 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.409 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d9560700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 0x7fa1d40679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:36.410 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d9d61700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 0x7fa1d4139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:36.410 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1d8d5f700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fa1c400ed10 tx=0x7fa1c4006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.411 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c400cbb0 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.411 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400cd10 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.411 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d4066de0 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.412 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4012600 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.412 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d413a3d0 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.412 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fa1c4022070 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.413 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fa1c401b9b0 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.413 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.386+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d413a620 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.414 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.390+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fa1c403a880 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.474 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.474+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6baffc6e-5a02-4a37-90ba-b221ecd507cf", "id": 5} v 0) v1 -- 0x7fa1d4044f60 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.491 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.486+0000 7fa1c17fa700 1 -- 172.21.15.186:0/1600022037 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6baffc6e-5a02-4a37-90ba-b221ecd507cf", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa1c4029030 con 0x7fa1d40a6cc0 2020-11-20T11:38:36.491 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 msgr2=0x7fa1d409f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.492 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fa1c400ed10 tx=0x7fa1c4006eb0).stop 2020-11-20T11:38:36.492 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 shutdown_connections 2020-11-20T11:38:36.492 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1d40a9310 0x7fa1d4139cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.492 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1d405be80 0x7fa1d40679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.493 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 --2- 172.21.15.186:0/1600022037 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1d40a6cc0 0x7fa1d409f9e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.493 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 >> 172.21.15.186:0/1600022037 conn(0x7fa1d40ad530 msgr2=0x7fa1d40a7150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.493 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 shutdown_connections 2020-11-20T11:38:36.493 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.490+0000 7fa1da562700 1 -- 172.21.15.186:0/1600022037 wait complete. 2020-11-20T11:38:36.494 INFO:teuthology.orchestra.run.smithi186.stdout:5 2020-11-20T11:38:36.504 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70 6 2020-11-20T11:38:36.632 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 Processor -- start 2020-11-20T11:38:36.632 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- start start 2020-11-20T11:38:36.633 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff50813bb60 0x7ff5080aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.633 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5080a9af0 con 0x7ff5080ab310 2020-11-20T11:38:36.634 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5080a9d50 con 0x7ff5080aaf30 2020-11-20T11:38:36.634 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff508060e30 con 0x7ff50813bb60 2020-11-20T11:38:36.634 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5077fe700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ff5080aaf30 0x7ff508060720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:45336/0 (socket says 172.21.15.186:45336) 2020-11-20T11:38:36.634 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5077fe700 1 -- 172.21.15.186:0/3428930354 learned_addr learned my addr 172.21.15.186:0/3428930354 (peer_addr_for_me v1:172.21.15.186:0/0) 2020-11-20T11:38:36.635 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff507fff700 1 --2- 172.21.15.186:0/3428930354 >> v2:172.21.15.186:3300/0 conn(0x7ff50813bb60 0x7ff5080aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.635 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5067fc700 1 -- 172.21.15.186:0/3428930354 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307100548 0 0) 0x7ff5080a9d50 con 0x7ff5080aaf30 2020-11-20T11:38:36.635 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5067fc700 1 -- 172.21.15.186:0/3428930354 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f4003240 con 0x7ff5080aaf30 2020-11-20T11:38:36.635 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff507fff700 1 -- 172.21.15.186:0/3428930354 >> v1:172.21.15.186:6789/0 conn(0x7ff5080aaf30 legacy=0x7ff508060720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.635 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff507fff700 1 -- 172.21.15.186:0/3428930354 >> v1:172.21.15.161:6789/0 conn(0x7ff5080ab310 legacy=0x7ff50813c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.636 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff507fff700 1 -- 172.21.15.186:0/3428930354 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508061030 con 0x7ff50813bb60 2020-11-20T11:38:36.636 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff507fff700 1 --2- 172.21.15.186:0/3428930354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080aa1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff500009c90 tx=0x7ff5000091d0).ready entity=mon.1 client_cookie=1959665f933ad1c2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.636 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5067fc700 1 -- 172.21.15.186:0/3428930354 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000ba70 con 0x7ff50813bb60 2020-11-20T11:38:36.636 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5067fc700 1 -- 172.21.15.186:0/3428930354 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000bbd0 con 0x7ff50813bb60 2020-11-20T11:38:36.636 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff5067fc700 1 -- 172.21.15.186:0/3428930354 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500011400 con 0x7ff50813bb60 2020-11-20T11:38:36.637 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- 172.21.15.186:0/3428930354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 msgr2=0x7ff5080aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.637 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/3428930354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080aa1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ff500009c90 tx=0x7ff5000091d0).stop 2020-11-20T11:38:36.637 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- 172.21.15.186:0/3428930354 shutdown_connections 2020-11-20T11:38:36.637 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/3428930354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080aa1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.637 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- 172.21.15.186:0/3428930354 >> 172.21.15.186:0/3428930354 conn(0x7ff5080ae850 msgr2=0x7ff5080aa820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.638 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- 172.21.15.186:0/3428930354 shutdown_connections 2020-11-20T11:38:36.638 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.630+0000 7ff50cbc1700 1 -- 172.21.15.186:0/3428930354 wait complete. 2020-11-20T11:38:36.640 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 Processor -- start 2020-11-20T11:38:36.640 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- start start 2020-11-20T11:38:36.641 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5080aaf30 0x7ff50809d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.641 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5080ab310 0x7ff5080a3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.641 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.641 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff508138570 con 0x7ff5080aaf30 2020-11-20T11:38:36.642 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff508138810 con 0x7ff50813bb60 2020-11-20T11:38:36.642 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff508138ab0 con 0x7ff5080ab310 2020-11-20T11:38:36.642 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.642 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:32888/0 (socket says 172.21.15.186:32888) 2020-11-20T11:38:36.644 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 -- 172.21.15.186:0/4071796618 learned_addr learned my addr 172.21.15.186:0/4071796618 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.644 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff506ffd700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5080ab310 0x7ff5080a3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.644 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff5077fe700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5080aaf30 0x7ff50809d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.645 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 -- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5080ab310 msgr2=0x7ff5080a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.647 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5080ab310 0x7ff5080a3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.647 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 -- 172.21.15.186:0/4071796618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5080aaf30 msgr2=0x7ff50809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.648 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5080aaf30 0x7ff50809d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.648 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 -- 172.21.15.186:0/4071796618 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508139260 con 0x7ff50813bb60 2020-11-20T11:38:36.648 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff507fff700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff5080aa770 tx=0x7ff500016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.649 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500010700 con 0x7ff50813bb60 2020-11-20T11:38:36.649 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500010860 con 0x7ff50813bb60 2020-11-20T11:38:36.649 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff508138140 con 0x7ff50813bb60 2020-11-20T11:38:36.650 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500010be0 con 0x7ff50813bb60 2020-11-20T11:38:36.650 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50809f600 con 0x7ff50813bb60 2020-11-20T11:38:36.650 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff500024030 con 0x7ff50813bb60 2020-11-20T11:38:36.651 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.634+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7ff50001de10 con 0x7ff50813bb60 2020-11-20T11:38:36.651 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.638+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50809db70 con 0x7ff50813bb60 2020-11-20T11:38:36.652 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.638+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ff50809db70 con 0x7ff50813bb60 2020-11-20T11:38:36.737 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.734+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70", "id": 6} v 0) v1 -- 0x7ff508138c70 con 0x7ff50813bb60 2020-11-20T11:38:36.746 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff4e77fe700 1 -- 172.21.15.186:0/4071796618 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff50002c060 con 0x7ff50813bb60 2020-11-20T11:38:36.746 INFO:teuthology.orchestra.run.smithi186.stdout:6 2020-11-20T11:38:36.747 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 msgr2=0x7ff5080a4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.747 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7ff5080aa770 tx=0x7ff500016000).stop 2020-11-20T11:38:36.748 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 shutdown_connections 2020-11-20T11:38:36.748 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff50813bb60 0x7ff5080a4180 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.748 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5080aaf30 0x7ff50809d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.748 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 --2- 172.21.15.186:0/4071796618 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff5080ab310 0x7ff5080a3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.748 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 >> 172.21.15.186:0/4071796618 conn(0x7ff5080ae850 msgr2=0x7ff5080602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.749 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 shutdown_connections 2020-11-20T11:38:36.749 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.746+0000 7ff50cbc1700 1 -- 172.21.15.186:0/4071796618 wait complete. 2020-11-20T11:38:36.760 INFO:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 9625c4a8-73ac-43e1-9eee-758543842754 7 2020-11-20T11:38:36.883 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.882+0000 7f0078f04700 1 Processor -- start 2020-11-20T11:38:36.884 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.882+0000 7f0078f04700 1 -- start start 2020-11-20T11:38:36.885 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.885 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740a7740 con 0x7f0074061300 2020-11-20T11:38:36.885 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740a9470 con 0x7f00740aad70 2020-11-20T11:38:36.886 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740a9710 con 0x7f00740a9bb0 2020-11-20T11:38:36.886 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.886 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37314/0 (socket says 172.21.15.186:37314) 2020-11-20T11:38:36.886 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 -- 172.21.15.186:0/428955085 learned_addr learned my addr 172.21.15.186:0/428955085 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.887 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f006bfff700 1 --1- 172.21.15.186:0/428955085 >> v1:172.21.15.186:6789/0 conn(0x7f00740aad70 0x7f0074134880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:45348/0 (socket says 172.21.15.186:45348) 2020-11-20T11:38:36.887 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 -- 172.21.15.186:0/428955085 >> v1:172.21.15.186:6789/0 conn(0x7f00740aad70 legacy=0x7f0074134880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.887 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 -- 172.21.15.186:0/428955085 >> v1:172.21.15.161:6789/0 conn(0x7f0074061300 legacy=0x7f00740a6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.887 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 -- 172.21.15.186:0/428955085 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740616e0 con 0x7f00740a9bb0 2020-11-20T11:38:36.887 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0072d9d700 1 --2- 172.21.15.186:0/428955085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f006c009d80 tx=0x7f006c009290).ready entity=mon.2 client_cookie=f4ed428a35a5e8e8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.888 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0071d9b700 1 -- 172.21.15.186:0/428955085 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00bc80 con 0x7f00740a9bb0 2020-11-20T11:38:36.889 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0071d9b700 1 -- 172.21.15.186:0/428955085 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00bde0 con 0x7f00740a9bb0 2020-11-20T11:38:36.889 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0071d9b700 1 -- 172.21.15.186:0/428955085 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c011610 con 0x7f00740a9bb0 2020-11-20T11:38:36.889 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- 172.21.15.186:0/428955085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 msgr2=0x7f0074137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.889 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 --2- 172.21.15.186:0/428955085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f006c009d80 tx=0x7f006c009290).stop 2020-11-20T11:38:36.890 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- 172.21.15.186:0/428955085 shutdown_connections 2020-11-20T11:38:36.890 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 --2- 172.21.15.186:0/428955085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f00740a9bb0 0x7f0074137650 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.890 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- 172.21.15.186:0/428955085 >> 172.21.15.186:0/428955085 conn(0x7f00740ae1b0 msgr2=0x7f00740aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.890 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- 172.21.15.186:0/428955085 shutdown_connections 2020-11-20T11:38:36.890 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.886+0000 7f0078f04700 1 -- 172.21.15.186:0/428955085 wait complete. 2020-11-20T11:38:36.891 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 Processor -- start 2020-11-20T11:38:36.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- start start 2020-11-20T11:38:36.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00740a9bb0 0x7f0074136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.893 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 0x7f007412c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:36.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0074130cb0 con 0x7f00740a9bb0 2020-11-20T11:38:36.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007412bf70 con 0x7f00740aad70 2020-11-20T11:38:36.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0074067b80 con 0x7f0074061300 2020-11-20T11:38:36.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f007259c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.894 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 0x7f007412c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f007259c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:37316/0 (socket says 172.21.15.186:37316) 2020-11-20T11:38:36.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f007259c700 1 -- 172.21.15.186:0/1497681344 learned_addr learned my addr 172.21.15.186:0/1497681344 (peer_addr_for_me v2:172.21.15.186:0/0) 2020-11-20T11:38:36.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006bfff700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00740a9bb0 0x7f0074136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:36.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 -- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 msgr2=0x7f0074130610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.895 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 -- 172.21.15.186:0/1497681344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00740a9bb0 msgr2=0x7f0074136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00740a9bb0 0x7f0074136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 -- 172.21.15.186:0/1497681344 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007412f030 con 0x7f00740aad70 2020-11-20T11:38:36.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f007259c700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:36.896 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0072d9d700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 0x7f007412c410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f006c009d80 tx=0x7f006c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:36.897 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00bc80 con 0x7f00740aad70 2020-11-20T11:38:36.897 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c010ae0 con 0x7f00740aad70 2020-11-20T11:38:36.897 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c010e80 con 0x7f00740aad70 2020-11-20T11:38:36.897 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007412f280 con 0x7f00740aad70 2020-11-20T11:38:36.897 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007412cb20 con 0x7f00740aad70 2020-11-20T11:38:36.898 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f006c017070 con 0x7f00740aad70 2020-11-20T11:38:36.898 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f006c01c8e0 con 0x7f00740aad70 2020-11-20T11:38:36.898 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.890+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074130b00 con 0x7f00740aad70 2020-11-20T11:38:36.898 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.894+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f006c015020 con 0x7f00740aad70 2020-11-20T11:38:36.973 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.974+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9625c4a8-73ac-43e1-9eee-758543842754", "id": 7} v 0) v1 -- 0x7f0074069250 con 0x7f00740aad70 2020-11-20T11:38:36.984 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f006a7fc700 1 -- 172.21.15.186:0/1497681344 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9625c4a8-73ac-43e1-9eee-758543842754", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f006c01cb70 con 0x7f00740aad70 2020-11-20T11:38:36.984 INFO:teuthology.orchestra.run.smithi186.stdout:7 2020-11-20T11:38:36.986 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 msgr2=0x7f007412c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:36.986 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 0x7f007412c410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f006c009d80 tx=0x7f006c016000).stop 2020-11-20T11:38:36.986 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 shutdown_connections 2020-11-20T11:38:36.987 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00740aad70 0x7f007412c410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.987 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0074061300 0x7f0074130610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.987 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 --2- 172.21.15.186:0/1497681344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00740a9bb0 0x7f0074136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:36.987 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 >> 172.21.15.186:0/1497681344 conn(0x7f00740ae1b0 msgr2=0x7f0074134650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:36.988 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 shutdown_connections 2020-11-20T11:38:36.988 INFO:teuthology.orchestra.run.smithi186.stderr:2020-11-20T11:38:36.986+0000 7f0078f04700 1 -- 172.21.15.186:0/1497681344 wait complete. 2020-11-20T11:38:37.003 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T11:38:37.003 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T11:38:37.010 INFO:tasks.ceph.osd.0:Started 2020-11-20T11:38:37.011 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T11:38:37.011 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T11:38:37.017 INFO:tasks.ceph.osd.1:Started 2020-11-20T11:38:37.017 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T11:38:37.018 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T11:38:37.024 INFO:tasks.ceph.osd.2:Started 2020-11-20T11:38:37.025 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T11:38:37.025 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T11:38:37.033 INFO:tasks.ceph.osd.3:Started 2020-11-20T11:38:37.034 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T11:38:37.036 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T11:38:37.043 INFO:tasks.ceph.osd.4:Started 2020-11-20T11:38:37.043 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T11:38:37.043 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T11:38:37.047 INFO:tasks.ceph.osd.5:Started 2020-11-20T11:38:37.048 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T11:38:37.048 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T11:38:37.053 INFO:tasks.ceph.osd.6:Started 2020-11-20T11:38:37.053 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T11:38:37.054 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T11:38:37.059 INFO:tasks.ceph.osd.7:Started 2020-11-20T11:38:37.060 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T11:38:37.418 INFO:tasks.ceph.osd.6.smithi186.stderr:2020-11-20T11:38:37.418+0000 7f57f55ecd80 -1 Falling back to public interface 2020-11-20T11:38:37.629 INFO:tasks.ceph.osd.2.smithi161.stderr:2020-11-20T11:38:37.631+0000 7ff998c7ed80 -1 Falling back to public interface 2020-11-20T11:38:37.646 INFO:tasks.ceph.osd.1.smithi161.stderr:2020-11-20T11:38:37.647+0000 7f2b88253d80 -1 Falling back to public interface 2020-11-20T11:38:37.650 INFO:tasks.ceph.osd.0.smithi161.stderr:2020-11-20T11:38:37.651+0000 7fc860eabd80 -1 Falling back to public interface 2020-11-20T11:38:37.650 INFO:tasks.ceph.osd.3.smithi161.stderr:2020-11-20T11:38:37.651+0000 7f676bfb2d80 -1 Falling back to public interface 2020-11-20T11:38:37.666 INFO:tasks.ceph.osd.4.smithi186.stderr:2020-11-20T11:38:37.666+0000 7fa22b3bbd80 -1 Falling back to public interface 2020-11-20T11:38:37.666 INFO:tasks.ceph.osd.5.smithi186.stderr:2020-11-20T11:38:37.666+0000 7f4a2feced80 -1 Falling back to public interface 2020-11-20T11:38:37.697 INFO:tasks.ceph.osd.7.smithi186.stderr:2020-11-20T11:38:37.698+0000 7f090f372d80 -1 Falling back to public interface 2020-11-20T11:38:37.867 INFO:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:37.978 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 Processor -- start 2020-11-20T11:38:37.979 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- start start 2020-11-20T11:38:37.980 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f66180ad6f0 0x7f661813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:37.980 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6618134140 0x7f66181345d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:37.981 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6618066d60 con 0x7f6618067be0 2020-11-20T11:38:37.981 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6618063840 con 0x7f6618134140 2020-11-20T11:38:37.982 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180674a0 con 0x7f66180ad6f0 2020-11-20T11:38:37.982 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6618134140 0x7f66181345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:37.982 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6618134140 0x7f66181345d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36316/0 (socket says 172.21.15.161:36316) 2020-11-20T11:38:37.983 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 -- 172.21.15.161:0/1066249441 learned_addr learned my addr 172.21.15.161:0/1066249441 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:37.983 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f6616ffd700 1 --2- 172.21.15.161:0/1066249441 >> v2:172.21.15.186:3300/0 conn(0x7f66180ad6f0 0x7f661813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:37.983 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 -- 172.21.15.161:0/1066249441 >> v2:172.21.15.186:3300/0 conn(0x7f66180ad6f0 msgr2=0x7f661813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:37.983 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 --2- 172.21.15.161:0/1066249441 >> v2:172.21.15.186:3300/0 conn(0x7f66180ad6f0 0x7f661813ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:37.984 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 -- 172.21.15.161:0/1066249441 >> v1:172.21.15.186:6789/0 conn(0x7f6618067be0 legacy=0x7f66180a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:37.984 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 -- 172.21.15.161:0/1066249441 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618067740 con 0x7f6618134140 2020-11-20T11:38:37.984 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f66177fe700 1 --2- 172.21.15.161:0/1066249441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618134140 0x7f66181345d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f66180aa8f0 tx=0x7f6610009290).ready entity=mon.0 client_cookie=89ac58af7d35c9fe server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:37.985 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f6615ffb700 1 -- 172.21.15.161:0/1066249441 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661000bbc0 con 0x7f6618134140 2020-11-20T11:38:37.985 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f6615ffb700 1 -- 172.21.15.161:0/1066249441 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661000bd20 con 0x7f6618134140 2020-11-20T11:38:37.986 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f6615ffb700 1 -- 172.21.15.161:0/1066249441 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011610 con 0x7f6618134140 2020-11-20T11:38:37.986 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- 172.21.15.161:0/1066249441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618134140 msgr2=0x7f66181345d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:37.986 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 --2- 172.21.15.161:0/1066249441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618134140 0x7f66181345d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f66180aa8f0 tx=0x7f6610009290).stop 2020-11-20T11:38:37.987 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- 172.21.15.161:0/1066249441 shutdown_connections 2020-11-20T11:38:37.987 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 --2- 172.21.15.161:0/1066249441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618134140 0x7f66181345d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:37.987 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 --2- 172.21.15.161:0/1066249441 >> v2:172.21.15.186:3300/0 conn(0x7f66180ad6f0 0x7f661813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:37.988 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- 172.21.15.161:0/1066249441 >> 172.21.15.161:0/1066249441 conn(0x7f6618060c20 msgr2=0x7f66180ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:37.988 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- 172.21.15.161:0/1066249441 shutdown_connections 2020-11-20T11:38:37.989 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.975+0000 7f661d837700 1 -- 172.21.15.161:0/1066249441 wait complete. 2020-11-20T11:38:37.989 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 Processor -- start 2020-11-20T11:38:37.989 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- start start 2020-11-20T11:38:37.993 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:37.993 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66180ad6f0 0x7f661809d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:37.993 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6618134140 0x7f66180ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:37.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661809d9d0 con 0x7f6618067be0 2020-11-20T11:38:37.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66180ac170 con 0x7f66180ad6f0 2020-11-20T11:38:37.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661809dbf0 con 0x7f6618134140 2020-11-20T11:38:37.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:37.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36318/0 (socket says 172.21.15.161:36318) 2020-11-20T11:38:37.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 -- 172.21.15.161:0/1302730527 learned_addr learned my addr 172.21.15.161:0/1302730527 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:37.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f66167fc700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66180ad6f0 0x7f661809d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:37.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f66177fe700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6618134140 0x7f66180ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:37.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 -- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6618134140 msgr2=0x7f66180ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:37.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6618134140 0x7f66180ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:37.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 -- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66180ad6f0 msgr2=0x7f661809d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:37.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66180ad6f0 0x7f661809d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:37.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 -- 172.21.15.161:0/1302730527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661809de90 con 0x7f6618067be0 2020-11-20T11:38:37.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f6616ffd700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f660800eba0 tx=0x7f6608006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:37.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800ca60 con 0x7f6618067be0 2020-11-20T11:38:37.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800cbc0 con 0x7f6618067be0 2020-11-20T11:38:37.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661809f920 con 0x7f6618067be0 2020-11-20T11:38:37.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080123f0 con 0x7f6618067be0 2020-11-20T11:38:37.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66180acc30 con 0x7f6618067be0 2020-11-20T11:38:37.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f66080129c0 con 0x7f6618067be0 2020-11-20T11:38:37.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.979+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f6608012c50 con 0x7f6618067be0 2020-11-20T11:38:37.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.983+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66180aceb0 con 0x7f6618067be0 2020-11-20T11:38:37.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:37.983+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f6608012e10 con 0x7f6618067be0 2020-11-20T11:38:38.052 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6618069250 con 0x7f6618067be0 2020-11-20T11:38:38.053 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f65feffd700 1 -- 172.21.15.161:0/1302730527 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7001 (secure 0 0 0) 0x7f660801c500 con 0x7f6618067be0 2020-11-20T11:38:38.054 INFO:teuthology.misc.health.smithi161.stdout: 2020-11-20T11:38:38.054 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:36.978269+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:38.055 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 msgr2=0x7f66180a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:38.056 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f660800eba0 tx=0x7f6608006df0).stop 2020-11-20T11:38:38.056 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 shutdown_connections 2020-11-20T11:38:38.056 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6618134140 0x7f66180ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:38.056 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6618067be0 0x7f66180a7980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:38.057 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 --2- 172.21.15.161:0/1302730527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66180ad6f0 0x7f661809d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:38.057 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 >> 172.21.15.161:0/1302730527 conn(0x7f6618060c20 msgr2=0x7f6618137e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:38.057 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 shutdown_connections 2020-11-20T11:38:38.058 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:38.055+0000 7f661d837700 1 -- 172.21.15.161:0/1302730527 wait complete. 2020-11-20T11:38:38.065 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-11-20T11:38:38.826 INFO:tasks.ceph.osd.1.smithi161.stderr:2020-11-20T11:38:38.827+0000 7f2b88253d80 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T11:38:38.844 INFO:tasks.ceph.osd.6.smithi186.stderr:2020-11-20T11:38:38.842+0000 7f57f55ecd80 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T11:38:39.050 INFO:tasks.ceph.osd.2.smithi161.stderr:2020-11-20T11:38:39.051+0000 7ff998c7ed80 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T11:38:39.061 INFO:tasks.ceph.osd.4.smithi186.stderr:2020-11-20T11:38:39.062+0000 7fa22b3bbd80 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T11:38:39.079 INFO:tasks.ceph.osd.0.smithi161.stderr:2020-11-20T11:38:39.079+0000 7fc860eabd80 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T11:38:39.084 INFO:tasks.ceph.osd.3.smithi161.stderr:2020-11-20T11:38:39.087+0000 7f676bfb2d80 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T11:38:39.135 INFO:tasks.ceph.osd.5.smithi186.stderr:2020-11-20T11:38:39.134+0000 7f4a2feced80 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T11:38:39.144 INFO:tasks.ceph.osd.7.smithi186.stderr:2020-11-20T11:38:39.146+0000 7f090f372d80 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T11:38:40.300 INFO:tasks.ceph.osd.4.smithi186.stderr:2020-11-20T11:38:40.298+0000 7fa222885700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T11:38:40.301 INFO:tasks.ceph.osd.7.smithi186.stderr:2020-11-20T11:38:40.302+0000 7f090803f700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T11:38:40.301 INFO:tasks.ceph.osd.6.smithi186.stderr:2020-11-20T11:38:40.302+0000 7f57ecab6700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T11:38:40.301 INFO:tasks.ceph.osd.5.smithi186.stderr:2020-11-20T11:38:40.302+0000 7f4a27398700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T11:38:40.302 INFO:tasks.ceph.osd.0.smithi161.stderr:2020-11-20T11:38:40.299+0000 7fc859b78700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T11:38:40.302 INFO:tasks.ceph.osd.2.smithi161.stderr:2020-11-20T11:38:40.303+0000 7ff990148700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T11:38:40.303 INFO:tasks.ceph.osd.3.smithi161.stderr:2020-11-20T11:38:40.303+0000 7f676347c700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T11:38:40.310 INFO:tasks.ceph.osd.1.smithi161.stderr:2020-11-20T11:38:40.307+0000 7f2b7f71d700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T11:38:44.873 INFO:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:44.993 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.990+0000 7f94553a3700 1 Processor -- start 2020-11-20T11:38:44.994 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.990+0000 7f94553a3700 1 -- start start 2020-11-20T11:38:44.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94500a9530 0x7f94500a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:44.995 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 0x7f9450134870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:44.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500a70c0 con 0x7f945005be80 2020-11-20T11:38:44.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500a9ea0 con 0x7f94500a9530 2020-11-20T11:38:44.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500a7320 con 0x7f9450134430 2020-11-20T11:38:44.996 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94500a9530 0x7f94500a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:44.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94500a9530 0x7f94500a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36592/0 (socket says 172.21.15.161:36592) 2020-11-20T11:38:44.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 -- 172.21.15.161:0/301662807 learned_addr learned my addr 172.21.15.161:0/301662807 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:44.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f9454ba2700 1 --2- 172.21.15.161:0/301662807 >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 0x7f9450134870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:44.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 -- 172.21.15.161:0/301662807 >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 msgr2=0x7f9450134870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:44.997 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 --2- 172.21.15.161:0/301662807 >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 0x7f9450134870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:44.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 -- 172.21.15.161:0/301662807 >> v1:172.21.15.186:6789/0 conn(0x7f945005be80 legacy=0x7f94500a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:44.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 -- 172.21.15.161:0/301662807 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500a75c0 con 0x7f94500a9530 2020-11-20T11:38:44.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f9454ba2700 1 --2- 172.21.15.161:0/301662807 >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 0x7f9450134870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:38:44.998 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944f7fe700 1 --2- 172.21.15.161:0/301662807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f94500a99b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9450061840 tx=0x7f9444006eb0).ready entity=mon.0 client_cookie=6bd2641454092245 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:44.999 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944effd700 1 -- 172.21.15.161:0/301662807 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444009890 con 0x7f94500a9530 2020-11-20T11:38:44.999 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944effd700 1 -- 172.21.15.161:0/301662807 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94440099f0 con 0x7f94500a9530 2020-11-20T11:38:44.999 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f944effd700 1 -- 172.21.15.161:0/301662807 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444009d70 con 0x7f94500a9530 2020-11-20T11:38:45.002 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- 172.21.15.161:0/301662807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 msgr2=0x7f94500a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.002 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 --2- 172.21.15.161:0/301662807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f94500a99b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9450061840 tx=0x7f9444006eb0).stop 2020-11-20T11:38:45.002 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- 172.21.15.161:0/301662807 shutdown_connections 2020-11-20T11:38:45.002 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 --2- 172.21.15.161:0/301662807 >> v2:172.21.15.186:3300/0 conn(0x7f9450134430 0x7f9450134870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.002 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 --2- 172.21.15.161:0/301662807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f94500a99b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.003 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- 172.21.15.161:0/301662807 >> 172.21.15.161:0/301662807 conn(0x7f94500ad5f0 msgr2=0x7f94500ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:45.003 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- 172.21.15.161:0/301662807 shutdown_connections 2020-11-20T11:38:45.003 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.994+0000 7f94553a3700 1 -- 172.21.15.161:0/301662807 wait complete. 2020-11-20T11:38:45.003 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 Processor -- start 2020-11-20T11:38:45.003 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- start start 2020-11-20T11:38:45.004 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f945005be80 0x7f945009fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.004 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.004 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450134430 0x7f945014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.004 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501342f0 con 0x7f94500a9530 2020-11-20T11:38:45.004 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500684b0 con 0x7f9450134430 2020-11-20T11:38:45.005 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9450067690 con 0x7f945005be80 2020-11-20T11:38:45.005 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.005 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36598/0 (socket says 172.21.15.161:36598) 2020-11-20T11:38:45.005 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 -- 172.21.15.161:0/1978777138 learned_addr learned my addr 172.21.15.161:0/1978777138 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:45.006 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f9454ba2700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450134430 0x7f945014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.006 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944ffff700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f945005be80 0x7f945009fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.006 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 -- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f945005be80 msgr2=0x7f945009fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.006 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f945005be80 0x7f945009fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.006 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 -- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450134430 msgr2=0x7f945014b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450134430 0x7f945014b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 -- 172.21.15.161:0/1978777138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450067930 con 0x7f94500a9530 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f944f7fe700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9444006ef0 tx=0x7f9444015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444011e50 con 0x7f94500a9530 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944401e460 con 0x7f94500a9530 2020-11-20T11:38:45.007 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944401e800 con 0x7f94500a9530 2020-11-20T11:38:45.008 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9450067dd0 con 0x7f94500a9530 2020-11-20T11:38:45.008 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:44.998+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945013b9a0 con 0x7f94500a9530 2020-11-20T11:38:45.009 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9450067ac0 con 0x7f94500a9530 2020-11-20T11:38:45.009 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f9444025030 con 0x7f94500a9530 2020-11-20T11:38:45.010 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f942ffff700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 0x7f9428057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.010 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f944406fb40 con 0x7f94500a9530 2020-11-20T11:38:45.010 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f944ffff700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 0x7f9428057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.010 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.002+0000 7f944ffff700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 0x7f9428057c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f94400036c0 tx=0x7f9440007b70).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:45.013 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.014+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9444045d60 con 0x7f94500a9530 2020-11-20T11:38:45.172 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.169+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9450069250 con 0x7f94500a9530 2020-11-20T11:38:45.173 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.169+0000 7f942ffff700 1 -- 172.21.15.161:0/1978777138 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12200 (secure 0 0 0) 0x7f9444023070 con 0x7f94500a9530 2020-11-20T11:38:45.174 INFO:teuthology.misc.health.smithi161.stdout: 2020-11-20T11:38:45.174 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":15,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:43.374018+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:45.175 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 msgr2=0x7f9428057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.176 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 0x7f9428057c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f94400036c0 tx=0x7f9440007b70).stop 2020-11-20T11:38:45.176 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 msgr2=0x7f9450065880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.176 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9444006ef0 tx=0x7f9444015000).stop 2020-11-20T11:38:45.176 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 shutdown_connections 2020-11-20T11:38:45.176 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f94280557c0 0x7f9428057c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.177 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9450134430 0x7f945014b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.177 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f945005be80 0x7f945009fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.177 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 --2- 172.21.15.161:0/1978777138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94500a9530 0x7f9450065880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.177 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 >> 172.21.15.161:0/1978777138 conn(0x7f94500ad5f0 msgr2=0x7f94500ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:45.178 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 shutdown_connections 2020-11-20T11:38:45.178 INFO:teuthology.misc.health.smithi161.stderr:2020-11-20T11:38:45.173+0000 7f94553a3700 1 -- 172.21.15.161:0/1978777138 wait complete. 2020-11-20T11:38:45.189 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-11-20T11:38:45.190 INFO:tasks.ceph:Creating RBD pool 2020-11-20T11:38:45.190 INFO:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T11:38:45.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.313+0000 7f515ab36700 1 Processor -- start 2020-11-20T11:38:45.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- start start 2020-11-20T11:38:45.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5154067c60 0x7f51540ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540ad740 con 0x7f515413e680 2020-11-20T11:38:45.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51540ad9e0 con 0x7f5154067880 2020-11-20T11:38:45.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5154138610 con 0x7f5154067c60 2020-11-20T11:38:45.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51590d3700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f515413e680 0x7f5154145470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46850/0 (socket says 172.21.15.161:46850) 2020-11-20T11:38:45.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51590d3700 1 -- 172.21.15.161:0/1433203856 learned_addr learned my addr 172.21.15.161:0/1433203856 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:45.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f5153fff700 1 --2- 172.21.15.161:0/1433203856 >> v2:172.21.15.186:3300/0 conn(0x7f5154067c60 0x7f51540ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51537fe700 1 -- 172.21.15.161:0/1433203856 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856635391 0 0) 0x7f51540ad740 con 0x7f515413e680 2020-11-20T11:38:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51537fe700 1 -- 172.21.15.161:0/1433203856 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5134003240 con 0x7f515413e680 2020-11-20T11:38:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f5153fff700 1 -- 172.21.15.161:0/1433203856 >> v1:172.21.15.186:6789/0 conn(0x7f5154067880 legacy=0x7f51540ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f5153fff700 1 -- 172.21.15.161:0/1433203856 >> v1:172.21.15.161:6789/0 conn(0x7f515413e680 legacy=0x7f5154145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f5153fff700 1 -- 172.21.15.161:0/1433203856 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540a8a10 con 0x7f5154067c60 2020-11-20T11:38:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f5153fff700 1 --2- 172.21.15.161:0/1433203856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067c60 0x7f51540ad110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f513c00b9d0 tx=0x7f513c006df0).ready entity=mon.1 client_cookie=eb1fbb8434248378 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51537fe700 1 -- 172.21.15.161:0/1433203856 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c009770 con 0x7f5154067c60 2020-11-20T11:38:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51537fe700 1 -- 172.21.15.161:0/1433203856 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0098d0 con 0x7f5154067c60 2020-11-20T11:38:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f51537fe700 1 -- 172.21.15.161:0/1433203856 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c009c50 con 0x7f5154067c60 2020-11-20T11:38:45.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- 172.21.15.161:0/1433203856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067c60 msgr2=0x7f51540ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 --2- 172.21.15.161:0/1433203856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067c60 0x7f51540ad110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f513c00b9d0 tx=0x7f513c006df0).stop 2020-11-20T11:38:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- 172.21.15.161:0/1433203856 shutdown_connections 2020-11-20T11:38:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 --2- 172.21.15.161:0/1433203856 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067c60 0x7f51540ad110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- 172.21.15.161:0/1433203856 >> 172.21.15.161:0/1433203856 conn(0x7f5154061c80 msgr2=0x7f51540b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:45.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- 172.21.15.161:0/1433203856 shutdown_connections 2020-11-20T11:38:45.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.317+0000 7f515ab36700 1 -- 172.21.15.161:0/1433203856 wait complete. 2020-11-20T11:38:45.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 Processor -- start 2020-11-20T11:38:45.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 -- start start 2020-11-20T11:38:45.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067880 0x7f51540a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5154067c60 0x7f515409da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540a7e40 con 0x7f515413e680 2020-11-20T11:38:45.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51540a5a00 con 0x7f5154067880 2020-11-20T11:38:45.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f515ab36700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51540a5c70 con 0x7f5154067c60 2020-11-20T11:38:45.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36612/0 (socket says 172.21.15.161:36612) 2020-11-20T11:38:45.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 -- 172.21.15.161:0/1729947322 learned_addr learned my addr 172.21.15.161:0/1729947322 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:45.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51588d2700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067880 0x7f51540a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f5153fff700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5154067c60 0x7f515409da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 -- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5154067c60 msgr2=0x7f515409da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5154067c60 0x7f515409da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 -- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067880 msgr2=0x7f51540a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:45.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067880 0x7f51540a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:45.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 -- 172.21.15.161:0/1729947322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540a5f10 con 0x7f515413e680 2020-11-20T11:38:45.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.321+0000 7f51590d3700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f514c00ca60 tx=0x7f514c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:45.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c005b80 con 0x7f515413e680 2020-11-20T11:38:45.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c005ce0 con 0x7f515413e680 2020-11-20T11:38:45.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515413b920 con 0x7f515413e680 2020-11-20T11:38:45.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c007320 con 0x7f515413e680 2020-11-20T11:38:45.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51540a7330 con 0x7f515413e680 2020-11-20T11:38:45.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51540a60a0 con 0x7f515413e680 2020-11-20T11:38:45.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f514c010030 con 0x7f515413e680 2020-11-20T11:38:45.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 0x7f5130057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:45.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f514c06e230 con 0x7f515413e680 2020-11-20T11:38:45.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.325+0000 7f51588d2700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 0x7f5130057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:45.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.329+0000 7f51588d2700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 0x7f5130057c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5144003510 tx=0x7f5144009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:45.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.333+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f514c044560 con 0x7f515413e680 2020-11-20T11:38:45.490 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:45.485+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f51540a62d0 con 0x7f515413e680 2020-11-20T11:38:46.397 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.393+0000 7f5150ff9700 1 -- 172.21.15.161:0/1729947322 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f514c047b80 con 0x7f515413e680 2020-11-20T11:38:46.402 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.397+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 msgr2=0x7f5130057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:46.402 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.397+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 0x7f5130057c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5144003510 tx=0x7f5144009040).stop 2020-11-20T11:38:46.402 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.397+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 msgr2=0x7f515413ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:46.402 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.397+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f514c00ca60 tx=0x7f514c007e20).stop 2020-11-20T11:38:46.403 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.397+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 shutdown_connections 2020-11-20T11:38:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f51300557c0 0x7f5130057c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f515413e680 0x7f515413ac40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5154067880 0x7f51540a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 --2- 172.21.15.161:0/1729947322 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5154067c60 0x7f515409da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.404 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 >> 172.21.15.161:0/1729947322 conn(0x7f5154061c80 msgr2=0x7f51540afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:46.405 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 shutdown_connections 2020-11-20T11:38:46.405 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.401+0000 7f515ab36700 1 -- 172.21.15.161:0/1729947322 wait complete. 2020-11-20T11:38:46.405 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'rbd' created 2020-11-20T11:38:46.419 INFO:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T11:38:46.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.541+0000 7f777734a700 1 Processor -- start 2020-11-20T11:38:46.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.541+0000 7f777734a700 1 -- start start 2020-11-20T11:38:46.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7770061400 0x7f77700a5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77700a7510 0x7f77700a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f777013ad40 0x7f77700a0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77700a5b60 con 0x7f77700a7510 2020-11-20T11:38:46.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77700a99c0 con 0x7f777013ad40 2020-11-20T11:38:46.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f777734a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700a9c50 con 0x7f7770061400 2020-11-20T11:38:46.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77700a7510 0x7f77700a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77700a7510 0x7f77700a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36620/0 (socket says 172.21.15.161:36620) 2020-11-20T11:38:46.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 -- 172.21.15.161:0/3388668544 learned_addr learned my addr 172.21.15.161:0/3388668544 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:46.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7776b49700 1 --2- 172.21.15.161:0/3388668544 >> v2:172.21.15.186:3300/0 conn(0x7f777013ad40 0x7f77700a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7776348700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7770061400 0x7f77700a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 -- 172.21.15.161:0/3388668544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7770061400 msgr2=0x7f77700a5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:46.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7770061400 0x7f77700a5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 -- 172.21.15.161:0/3388668544 >> v2:172.21.15.186:3300/0 conn(0x7f777013ad40 msgr2=0x7f77700a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:46.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 --2- 172.21.15.161:0/3388668544 >> v2:172.21.15.186:3300/0 conn(0x7f777013ad40 0x7f77700a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 -- 172.21.15.161:0/3388668544 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77700a51d0 con 0x7f77700a7510 2020-11-20T11:38:46.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775b47700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f77700a94d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7770064a30 tx=0x7f7760006eb0).ready entity=mon.0 client_cookie=384113b20fe48474 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:46.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775346700 1 -- 172.21.15.161:0/3388668544 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760009720 con 0x7f77700a7510 2020-11-20T11:38:46.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775346700 1 -- 172.21.15.161:0/3388668544 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760009880 con 0x7f77700a7510 2020-11-20T11:38:46.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.545+0000 7f7775346700 1 -- 172.21.15.161:0/3388668544 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760009c00 con 0x7f77700a7510 2020-11-20T11:38:46.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- 172.21.15.161:0/3388668544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 msgr2=0x7f77700a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:46.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f77700a94d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f7770064a30 tx=0x7f7760006eb0).stop 2020-11-20T11:38:46.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- 172.21.15.161:0/3388668544 shutdown_connections 2020-11-20T11:38:46.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- 172.21.15.161:0/3388668544 >> v2:172.21.15.186:3300/0 conn(0x7f777013ad40 0x7f77700a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7770061400 0x7f77700a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- 172.21.15.161:0/3388668544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f77700a94d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- 172.21.15.161:0/3388668544 >> 172.21.15.161:0/3388668544 conn(0x7f77700ad590 msgr2=0x7f77700ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:46.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- 172.21.15.161:0/3388668544 shutdown_connections 2020-11-20T11:38:46.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- 172.21.15.161:0/3388668544 wait complete. 2020-11-20T11:38:46.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 Processor -- start 2020-11-20T11:38:46.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- start start 2020-11-20T11:38:46.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7770061400 0x7f7770068270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f777013ad40 0x7f7770137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77701386a0 con 0x7f77700a7510 2020-11-20T11:38:46.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7770065620 con 0x7f7770061400 2020-11-20T11:38:46.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f777734a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77700658c0 con 0x7f777013ad40 2020-11-20T11:38:46.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36626/0 (socket says 172.21.15.161:36626) 2020-11-20T11:38:46.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 -- 172.21.15.161:0/4249597077 learned_addr learned my addr 172.21.15.161:0/4249597077 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:46.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7776348700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7770061400 0x7f7770068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7776b49700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f777013ad40 0x7f7770137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 -- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f777013ad40 msgr2=0x7f7770137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:46.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f777013ad40 0x7f7770137950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 -- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7770061400 msgr2=0x7f7770068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:46.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7770061400 0x7f7770068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:46.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 -- 172.21.15.161:0/4249597077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770065b60 con 0x7f77700a7510 2020-11-20T11:38:46.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f7775b47700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7760010000 tx=0x7f7760015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:46.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.549+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7760011bc0 con 0x7f77700a7510 2020-11-20T11:38:46.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7760011d20 con 0x7f77700a7510 2020-11-20T11:38:46.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7770067e70 con 0x7f77700a7510 2020-11-20T11:38:46.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776001e670 con 0x7f77700a7510 2020-11-20T11:38:46.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777009f760 con 0x7f77700a7510 2020-11-20T11:38:46.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770044f60 con 0x7f77700a7510 2020-11-20T11:38:46.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7760025030 con 0x7f77700a7510 2020-11-20T11:38:46.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f775e7fc700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 0x7f7748057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:46.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f776006fcb0 con 0x7f77700a7510 2020-11-20T11:38:46.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f7776348700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 0x7f7748057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:46.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.553+0000 7f7776348700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 0x7f7748057c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f776c006fd0 tx=0x7f776c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:46.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.561+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7760045fc0 con 0x7f77700a7510 2020-11-20T11:38:46.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:46.741+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f777009f950 con 0x7f77700a7510 2020-11-20T11:38:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.400+0000 7f775e7fc700 1 -- 172.21.15.161:0/4249597077 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7760023020 con 0x7f77700a7510 2020-11-20T11:38:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 msgr2=0x7f7748057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 0x7f7748057c80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f776c006fd0 tx=0x7f776c008040).stop 2020-11-20T11:38:47.407 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 msgr2=0x7f7770067980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7760010000 tx=0x7f7760015000).stop 2020-11-20T11:38:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 shutdown_connections 2020-11-20T11:38:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f77480557c0 0x7f7748057c80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f777013ad40 0x7f7770137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.408 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7770061400 0x7f7770068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 --2- 172.21.15.161:0/4249597077 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77700a7510 0x7f7770067980 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 >> 172.21.15.161:0/4249597077 conn(0x7f77700ad590 msgr2=0x7f77700abaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 shutdown_connections 2020-11-20T11:38:47.409 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.404+0000 7f777734a700 1 -- 172.21.15.161:0/4249597077 wait complete. 2020-11-20T11:38:47.410 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T11:38:47.425 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T11:38:47.425 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T11:38:47.426 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T11:38:47.448 INFO:tasks.ceph.mds.a:Started 2020-11-20T11:38:47.449 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T11:38:47.449 INFO:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T11:38:47.463 INFO:tasks.ceph.mds.b:Started 2020-11-20T11:38:47.464 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T11:38:47.465 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:47.517 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2020-11-20T11:38:47.539 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2020-11-20T11:38:47.608 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 Processor -- start 2020-11-20T11:38:47.609 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- start start 2020-11-20T11:38:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f1348039640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13480c77c0 0x7f13480c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13480ca700 0x7f13480cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1348036a70 con 0x7f13480c77c0 2020-11-20T11:38:47.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480c7130 con 0x7f13480ca700 2020-11-20T11:38:47.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480357a0 con 0x7f1348039260 2020-11-20T11:38:47.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13480c77c0 0x7f13480c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.614 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13480c77c0 0x7f13480c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36646/0 (socket says 172.21.15.161:36646) 2020-11-20T11:38:47.614 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 -- 172.21.15.161:0/1963133200 learned_addr learned my addr 172.21.15.161:0/1963133200 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:47.614 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134e59c700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f1348039640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.615 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134ed9d700 1 --2- 172.21.15.161:0/1963133200 >> v2:172.21.15.186:3300/0 conn(0x7f13480ca700 0x7f13480cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.615 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 -- 172.21.15.161:0/1963133200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 msgr2=0x7f1348039640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:47.615 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f1348039640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 -- 172.21.15.161:0/1963133200 >> v2:172.21.15.186:3300/0 conn(0x7f13480ca700 msgr2=0x7f13480cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 --2- 172.21.15.161:0/1963133200 >> v2:172.21.15.186:3300/0 conn(0x7f13480ca700 0x7f13480cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 -- 172.21.15.161:0/1963133200 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348035500 con 0x7f13480c77c0 2020-11-20T11:38:47.617 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134dd9b700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480c7c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f13480c81d0 tx=0x7f1344006eb0).ready entity=mon.0 client_cookie=30d0c97b73752592 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.617 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134d59a700 1 -- 172.21.15.161:0/1963133200 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344009890 con 0x7f13480c77c0 2020-11-20T11:38:47.623 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134d59a700 1 -- 172.21.15.161:0/1963133200 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440099f0 con 0x7f13480c77c0 2020-11-20T11:38:47.623 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134d59a700 1 -- 172.21.15.161:0/1963133200 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344009d70 con 0x7f13480c77c0 2020-11-20T11:38:47.623 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- 172.21.15.161:0/1963133200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 msgr2=0x7f13480c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480c7c20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f13480c81d0 tx=0x7f1344006eb0).stop 2020-11-20T11:38:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- 172.21.15.161:0/1963133200 shutdown_connections 2020-11-20T11:38:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- 172.21.15.161:0/1963133200 >> v2:172.21.15.186:3300/0 conn(0x7f13480ca700 0x7f13480cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f1348039640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 --2- 172.21.15.161:0/1963133200 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480c7c20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- 172.21.15.161:0/1963133200 >> 172.21.15.161:0/1963133200 conn(0x7f134803d900 msgr2=0x7f134803dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- 172.21.15.161:0/1963133200 shutdown_connections 2020-11-20T11:38:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.608+0000 7f134f59e700 1 -- 172.21.15.161:0/1963133200 wait complete. 2020-11-20T11:38:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 Processor -- start 2020-11-20T11:38:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- start start 2020-11-20T11:38:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f13480cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13480ca700 0x7f13480be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134803bcb0 con 0x7f13480c77c0 2020-11-20T11:38:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134803ca10 con 0x7f13480ca700 2020-11-20T11:38:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134803ccb0 con 0x7f1348039260 2020-11-20T11:38:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36652/0 (socket says 172.21.15.161:36652) 2020-11-20T11:38:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 -- 172.21.15.161:0/380899517 learned_addr learned my addr 172.21.15.161:0/380899517 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134ed9d700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13480ca700 0x7f13480be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134e59c700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f13480cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 -- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 msgr2=0x7f13480cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f13480cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 -- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13480ca700 msgr2=0x7f13480be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13480ca700 0x7f13480be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 -- 172.21.15.161:0/380899517 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134803c700 con 0x7f13480c77c0 2020-11-20T11:38:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134dd9b700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1344010000 tx=0x7f1344015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344011d50 con 0x7f13480c77c0 2020-11-20T11:38:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134401d450 con 0x7f13480c77c0 2020-11-20T11:38:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134803d5c0 con 0x7f13480c77c0 2020-11-20T11:38:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134401d810 con 0x7f13480c77c0 2020-11-20T11:38:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.612+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13480c2030 con 0x7f13480c77c0 2020-11-20T11:38:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f134400f070 con 0x7f13480c77c0 2020-11-20T11:38:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134803ce70 con 0x7f13480c77c0 2020-11-20T11:38:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f133e7fc700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 0x7f1324057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f134406ff60 con 0x7f13480c77c0 2020-11-20T11:38:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f134e59c700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 0x7f1324057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.616+0000 7f134e59c700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 0x7f1324057c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f134000ba00 tx=0x7f1340008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.620+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1344046170 con 0x7f13480c77c0 2020-11-20T11:38:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.772+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f134803d360 con 0x7f13480c77c0 2020-11-20T11:38:47.774 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.772+0000 7f133e7fc700 1 -- 172.21.15.161:0/380899517 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13733 (secure 0 0 0) 0x7f1344049750 con 0x7f13480c77c0 2020-11-20T11:38:47.775 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:47.393669+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 msgr2=0x7f1324057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 0x7f1324057c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f134000ba00 tx=0x7f1340008040).stop 2020-11-20T11:38:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 msgr2=0x7f13480bdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1344010000 tx=0x7f1344015000).stop 2020-11-20T11:38:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 shutdown_connections 2020-11-20T11:38:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13240557c0 0x7f1324057c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13480ca700 0x7f13480be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1348039260 0x7f13480cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 --2- 172.21.15.161:0/380899517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13480c77c0 0x7f13480bdc00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 >> 172.21.15.161:0/380899517 conn(0x7f134803d900 msgr2=0x7f13480cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 shutdown_connections 2020-11-20T11:38:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.776+0000 7f134f59e700 1 -- 172.21.15.161:0/380899517 wait complete. 2020-11-20T11:38:47.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:38:38.321980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:38:45.546076+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T11:38:47.792 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:38:47.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.968+0000 7f619759e700 1 Processor -- start 2020-11-20T11:38:47.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.968+0000 7f619759e700 1 -- start start 2020-11-20T11:38:47.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61980ad560 0x7f619813a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61980a5980 0x7f61980a8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619813dec0 con 0x7f619813ead0 2020-11-20T11:38:47.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980a9540 con 0x7f61980ad560 2020-11-20T11:38:47.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980a76c0 con 0x7f61980a5980 2020-11-20T11:38:47.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f6196d9d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f619813ead0 0x7f61980a8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46900/0 (socket says 172.21.15.161:46900) 2020-11-20T11:38:47.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61980ad560 0x7f619813a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f6196d9d700 1 -- 172.21.15.161:0/3287408934 learned_addr learned my addr 172.21.15.161:0/3287408934 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:47.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f6195d9b700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61980a5980 0x7f61980a8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996328871 0 0) 0x7f619813dec0 con 0x7f619813ead0 2020-11-20T11:38:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6178003240 con 0x7f619813ead0 2020-11-20T11:38:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 -- 172.21.15.161:0/3287408934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61980a5980 msgr2=0x7f61980a8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61980a5980 0x7f61980a8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2517404950 0 0) 0x7f6178003240 con 0x7f619813ead0 2020-11-20T11:38:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 -- 172.21.15.161:0/3287408934 >> v1:172.21.15.161:6789/0 conn(0x7f619813ead0 legacy=0x7f61980a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 -- 172.21.15.161:0/3287408934 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619813e0f0 con 0x7f61980ad560 2020-11-20T11:38:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619659c700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61980ad560 0x7f619813a8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f618800b990 tx=0x7f6188006df0).ready entity=mon.0 client_cookie=b5085014156428aa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900014e0 con 0x7f61980ad560 2020-11-20T11:38:47.976 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6188011400 con 0x7f61980ad560 2020-11-20T11:38:47.977 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619559a700 1 -- 172.21.15.161:0/3287408934 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6188011780 con 0x7f61980ad560 2020-11-20T11:38:47.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- 172.21.15.161:0/3287408934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61980ad560 msgr2=0x7f619813a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61980ad560 0x7f619813a8f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f618800b990 tx=0x7f6188006df0).stop 2020-11-20T11:38:47.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- 172.21.15.161:0/3287408934 shutdown_connections 2020-11-20T11:38:47.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61980ad560 0x7f619813a8f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 --2- 172.21.15.161:0/3287408934 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f61980a5980 0x7f61980a8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- 172.21.15.161:0/3287408934 >> 172.21.15.161:0/3287408934 conn(0x7f6198060b90 msgr2=0x7f61980accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:47.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- 172.21.15.161:0/3287408934 shutdown_connections 2020-11-20T11:38:47.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.972+0000 7f619759e700 1 -- 172.21.15.161:0/3287408934 wait complete. 2020-11-20T11:38:47.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 Processor -- start 2020-11-20T11:38:47.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- start start 2020-11-20T11:38:47.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 0x7f61980a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6198149990 0x7f61980a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980a0f70 con 0x7f619813ead0 2020-11-20T11:38:47.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61980a11a0 con 0x7f61980a5980 2020-11-20T11:38:47.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980a1440 con 0x7f6198149990 2020-11-20T11:38:47.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36666/0 (socket says 172.21.15.161:36666) 2020-11-20T11:38:47.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 -- 172.21.15.161:0/3756219996 learned_addr learned my addr 172.21.15.161:0/3756219996 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:47.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6196d9d700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6198149990 0x7f61980a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619659c700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 0x7f61980a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 -- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6198149990 msgr2=0x7f61980a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6198149990 0x7f61980a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 -- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 msgr2=0x7f61980a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:47.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 0x7f61980a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:47.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 -- 172.21.15.161:0/3756219996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980a16e0 con 0x7f619813ead0 2020-11-20T11:38:47.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619659c700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 0x7f61980a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:47.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f6195d9b700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f618000ef50 tx=0x7f61800091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000ccc0 con 0x7f619813ead0 2020-11-20T11:38:47.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000ce20 con 0x7f619813ead0 2020-11-20T11:38:47.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180012600 con 0x7f619813ead0 2020-11-20T11:38:47.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198067830 con 0x7f619813ead0 2020-11-20T11:38:47.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.976+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61980a2b10 con 0x7f619813ead0 2020-11-20T11:38:47.987 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61980a1870 con 0x7f619813ead0 2020-11-20T11:38:47.987 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6180022070 con 0x7f619813ead0 2020-11-20T11:38:47.987 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f618e7fc700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 0x7f6174057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:47.988 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f618006ec00 con 0x7f619813ead0 2020-11-20T11:38:47.988 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f619659c700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 0x7f6174057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:47.988 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.980+0000 7f619659c700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 0x7f6174057c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6198061130 tx=0x7f6188015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:47.988 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:47.988+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6180074020 con 0x7f619813ead0 2020-11-20T11:38:48.142 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.140+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6198044f60 con 0x7f619813ead0 2020-11-20T11:38:48.143 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.140+0000 7f618e7fc700 1 -- 172.21.15.161:0/3756219996 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6180016030 con 0x7f619813ead0 2020-11-20T11:38:48.143 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2020-11-20T11:38:48.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 msgr2=0x7f6174057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 0x7f6174057c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f6198061130 tx=0x7f6188015000).stop 2020-11-20T11:38:48.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 msgr2=0x7f619809d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f618000ef50 tx=0x7f61800091d0).stop 2020-11-20T11:38:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 shutdown_connections 2020-11-20T11:38:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f61740557c0 0x7f6174057c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6198149990 0x7f61980a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61980a5980 0x7f61980a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 --2- 172.21.15.161:0/3756219996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f619813ead0 0x7f619809d6a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 >> 172.21.15.161:0/3756219996 conn(0x7f6198060b90 msgr2=0x7f61980a9730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 shutdown_connections 2020-11-20T11:38:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.144+0000 7f619759e700 1 -- 172.21.15.161:0/3756219996 wait complete. 2020-11-20T11:38:48.157 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:38:48.298 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.296+0000 7f62c33a6700 1 Processor -- start 2020-11-20T11:38:48.299 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.296+0000 7f62c33a6700 1 -- start start 2020-11-20T11:38:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc0aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62bc13dd40 0x7f62bc13e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62bc0661d0 con 0x7f62bc0af5d0 2020-11-20T11:38:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62bc1382b0 con 0x7f62bc13dd40 2020-11-20T11:38:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0a4dd0 con 0x7f62bc0af9b0 2020-11-20T11:38:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62bc13dd40 0x7f62bc13e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f62bc13dd40 0x7f62bc13e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36676/0 (socket says 172.21.15.161:36676) 2020-11-20T11:38:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 -- 172.21.15.161:0/1264745020 learned_addr learned my addr 172.21.15.161:0/1264745020 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c1ba3700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc0aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 -- 172.21.15.161:0/1264745020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 msgr2=0x7f62bc0aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc0aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 -- 172.21.15.161:0/1264745020 >> v1:172.21.15.186:6789/0 conn(0x7f62bc0af5d0 legacy=0x7f62bc0a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 -- 172.21.15.161:0/1264745020 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc13e1c0 con 0x7f62bc13dd40 2020-11-20T11:38:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc13e430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f62b4009d50 tx=0x7f62b4009290).ready entity=mon.0 client_cookie=2572fd3e2ad497a2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.304 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c13a2700 1 -- 172.21.15.161:0/1264745020 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400bc80 con 0x7f62bc13dd40 2020-11-20T11:38:48.304 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c13a2700 1 -- 172.21.15.161:0/1264745020 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400bde0 con 0x7f62bc13dd40 2020-11-20T11:38:48.304 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c13a2700 1 -- 172.21.15.161:0/1264745020 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011610 con 0x7f62bc13dd40 2020-11-20T11:38:48.307 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- 172.21.15.161:0/1264745020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 msgr2=0x7f62bc13e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.307 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc13e430 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f62b4009d50 tx=0x7f62b4009290).stop 2020-11-20T11:38:48.307 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- 172.21.15.161:0/1264745020 shutdown_connections 2020-11-20T11:38:48.308 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc13e430 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.308 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- 172.21.15.161:0/1264745020 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc0aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.308 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- 172.21.15.161:0/1264745020 >> 172.21.15.161:0/1264745020 conn(0x7f62bc060bc0 msgr2=0x7f62bc0aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.308 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- 172.21.15.161:0/1264745020 shutdown_connections 2020-11-20T11:38:48.308 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- 172.21.15.161:0/1264745020 wait complete. 2020-11-20T11:38:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 Processor -- start 2020-11-20T11:38:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- start start 2020-11-20T11:38:48.309 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62bc0af5d0 0x7f62bc0a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc13ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0a82f0 con 0x7f62bc13dd40 2020-11-20T11:38:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc140470 con 0x7f62bc0af5d0 2020-11-20T11:38:48.310 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c33a6700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62bc0a84e0 con 0x7f62bc0af9b0 2020-11-20T11:38:48.311 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.311 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.300+0000 7f62c2ba5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36680/0 (socket says 172.21.15.161:36680) 2020-11-20T11:38:48.311 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 -- 172.21.15.161:0/91110197 learned_addr learned my addr 172.21.15.161:0/91110197 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:48.311 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c23a4700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62bc0af5d0 0x7f62bc0a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.311 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c1ba3700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc13ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 -- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 msgr2=0x7f62bc13ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc13ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 -- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62bc0af5d0 msgr2=0x7f62bc0a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.312 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62bc0af5d0 0x7f62bc0a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 -- 172.21.15.161:0/91110197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc0a8780 con 0x7f62bc13dd40 2020-11-20T11:38:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c2ba5700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f62b40106d0 tx=0x7f62b4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400b750 con 0x7f62bc13dd40 2020-11-20T11:38:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4011e70 con 0x7f62bc13dd40 2020-11-20T11:38:48.313 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4010d50 con 0x7f62bc13dd40 2020-11-20T11:38:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc13b260 con 0x7f62bc13dd40 2020-11-20T11:38:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62bc137b30 con 0x7f62bc13dd40 2020-11-20T11:38:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62bc044f60 con 0x7f62bc13dd40 2020-11-20T11:38:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f62b4017070 con 0x7f62bc13dd40 2020-11-20T11:38:48.314 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 0x7f6294057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f62b4070180 con 0x7f62bc13dd40 2020-11-20T11:38:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c23a4700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 0x7f6294057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.304+0000 7f62c23a4700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 0x7f6294057c80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f62bc0a8090 tx=0x7f62ac009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.308+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f62b4046350 con 0x7f62bc13dd40 2020-11-20T11:38:48.489 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.488+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62bc13e1c0 con 0x7f62bc13dd40 2020-11-20T11:38:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.488+0000 7f62aa7fc700 1 -- 172.21.15.161:0/91110197 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62bc13e1c0 con 0x7f62bc13dd40 2020-11-20T11:38:48.490 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:38:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 msgr2=0x7f6294057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 0x7f6294057c80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f62bc0a8090 tx=0x7f62ac009040).stop 2020-11-20T11:38:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 msgr2=0x7f62bc140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f62b40106d0 tx=0x7f62b4016000).stop 2020-11-20T11:38:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 shutdown_connections 2020-11-20T11:38:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f62940557c0 0x7f6294057c80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f62bc13dd40 0x7f62bc140ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62bc0af5d0 0x7f62bc0a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 --2- 172.21.15.161:0/91110197 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62bc0af9b0 0x7f62bc13ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 >> 172.21.15.161:0/91110197 conn(0x7f62bc060bc0 msgr2=0x7f62bc0accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 shutdown_connections 2020-11-20T11:38:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.492+0000 7f62c33a6700 1 -- 172.21.15.161:0/91110197 wait complete. 2020-11-20T11:38:48.506 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T11:38:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.624+0000 7f41f5920700 1 Processor -- start 2020-11-20T11:38:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.624+0000 7f41f5920700 1 -- start start 2020-11-20T11:38:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.624+0000 7f41f5920700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f41f013a4d0 0x7f41f013a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0141a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00a8df0 con 0x7f41f00a4f20 2020-11-20T11:38:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00a9a60 con 0x7f41f013a4d0 2020-11-20T11:38:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00a6770 con 0x7f41f013ae70 2020-11-20T11:38:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f491e700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f41f00a4f20 0x7f41f00a71b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46930/0 (socket says 172.21.15.161:46930) 2020-11-20T11:38:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f491e700 1 -- 172.21.15.161:0/1822105961 learned_addr learned my addr 172.21.15.161:0/1822105961 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 --2- 172.21.15.161:0/1822105961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41effff700 1 --2- 172.21.15.161:0/1822105961 >> v2:172.21.15.186:3300/0 conn(0x7f41f013a4d0 0x7f41f013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41ef7fe700 1 -- 172.21.15.161:0/1822105961 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162441068 0 0) 0x7f41f00a8df0 con 0x7f41f00a4f20 2020-11-20T11:38:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41ef7fe700 1 -- 172.21.15.161:0/1822105961 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d0003240 con 0x7f41f00a4f20 2020-11-20T11:38:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 -- 172.21.15.161:0/1822105961 >> v2:172.21.15.186:3300/0 conn(0x7f41f013a4d0 msgr2=0x7f41f013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 --2- 172.21.15.161:0/1822105961 >> v2:172.21.15.186:3300/0 conn(0x7f41f013a4d0 0x7f41f013a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 -- 172.21.15.161:0/1822105961 >> v1:172.21.15.161:6789/0 conn(0x7f41f00a4f20 legacy=0x7f41f00a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 -- 172.21.15.161:0/1822105961 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00a6a10 con 0x7f41f013ae70 2020-11-20T11:38:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f511f700 1 --2- 172.21.15.161:0/1822105961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0141a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f41e800b9a0 tx=0x7f41e8006df0).ready entity=mon.2 client_cookie=4933c890a89b3cf4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41ef7fe700 1 -- 172.21.15.161:0/1822105961 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8009680 con 0x7f41f013ae70 2020-11-20T11:38:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41ef7fe700 1 -- 172.21.15.161:0/1822105961 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e80097e0 con 0x7f41f013ae70 2020-11-20T11:38:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41ef7fe700 1 -- 172.21.15.161:0/1822105961 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8009b60 con 0x7f41f013ae70 2020-11-20T11:38:48.636 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- 172.21.15.161:0/1822105961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 msgr2=0x7f41f0141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.636 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 --2- 172.21.15.161:0/1822105961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0141a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f41e800b9a0 tx=0x7f41e8006df0).stop 2020-11-20T11:38:48.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- 172.21.15.161:0/1822105961 shutdown_connections 2020-11-20T11:38:48.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 --2- 172.21.15.161:0/1822105961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0141a20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 --2- 172.21.15.161:0/1822105961 >> v2:172.21.15.186:3300/0 conn(0x7f41f013a4d0 0x7f41f013a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- 172.21.15.161:0/1822105961 >> 172.21.15.161:0/1822105961 conn(0x7f41f00ad630 msgr2=0x7f41f00ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- 172.21.15.161:0/1822105961 shutdown_connections 2020-11-20T11:38:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.628+0000 7f41f5920700 1 -- 172.21.15.161:0/1822105961 wait complete. 2020-11-20T11:38:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 Processor -- start 2020-11-20T11:38:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 -- start start 2020-11-20T11:38:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f013a4d0 0x7f41f0138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0066200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0068720 con 0x7f41f00a4f20 2020-11-20T11:38:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0139400 con 0x7f41f013a4d0 2020-11-20T11:38:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f5920700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00669f0 con 0x7f41f013ae70 2020-11-20T11:38:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f491e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f491e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36692/0 (socket says 172.21.15.161:36692) 2020-11-20T11:38:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f491e700 1 -- 172.21.15.161:0/2483395488 learned_addr learned my addr 172.21.15.161:0/2483395488 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41f511f700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0066200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.632+0000 7f41effff700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f013a4d0 0x7f41f0138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 -- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 msgr2=0x7f41f0066200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0066200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 -- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f013a4d0 msgr2=0x7f41f0138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f013a4d0 0x7f41f0138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 -- 172.21.15.161:0/2483395488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0138260 con 0x7f41f00a4f20 2020-11-20T11:38:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f491e700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f41d800c710 tx=0x7f41d8007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d80072e0 con 0x7f41f00a4f20 2020-11-20T11:38:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8007440 con 0x7f41f00a4f20 2020-11-20T11:38:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f0138500 con 0x7f41f00a4f20 2020-11-20T11:38:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8005800 con 0x7f41f00a4f20 2020-11-20T11:38:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f009f7a0 con 0x7f41f00a4f20 2020-11-20T11:38:48.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f0069250 con 0x7f41f00a4f20 2020-11-20T11:38:48.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f41d801a060 con 0x7f41f00a4f20 2020-11-20T11:38:48.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 0x7f41cc057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f41d806db10 con 0x7f41f00a4f20 2020-11-20T11:38:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.636+0000 7f41effff700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 0x7f41cc057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.640+0000 7f41effff700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 0x7f41cc057c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f41f013a4a0 tx=0x7f41e00091d0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.644+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f41d8043bd0 con 0x7f41f00a4f20 2020-11-20T11:38:48.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.796+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f41f005c9c0 con 0x7f41f00a4f20 2020-11-20T11:38:48.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.796+0000 7f41ecff9700 1 -- 172.21.15.161:0/2483395488 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f41d8018030 con 0x7f41f00a4f20 2020-11-20T11:38:48.799 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:48.799 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2020-11-20T11:38:48.799 INFO:teuthology.orchestra.run.smithi161.stdout: { 2020-11-20T11:38:48.799 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2020-11-20T11:38:48.800 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": "device_health_metrics" 2020-11-20T11:38:48.800 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2020-11-20T11:38:48.800 INFO:teuthology.orchestra.run.smithi161.stdout: { 2020-11-20T11:38:48.800 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 2, 2020-11-20T11:38:48.801 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": "rbd" 2020-11-20T11:38:48.801 INFO:teuthology.orchestra.run.smithi161.stdout: } 2020-11-20T11:38:48.801 INFO:teuthology.orchestra.run.smithi161.stdout:] 2020-11-20T11:38:48.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 msgr2=0x7f41cc057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 0x7f41cc057c80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f41f013a4a0 tx=0x7f41e00091d0).stop 2020-11-20T11:38:48.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 msgr2=0x7f41f00606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f41d800c710 tx=0x7f41d8007ad0).stop 2020-11-20T11:38:48.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 shutdown_connections 2020-11-20T11:38:48.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f41cc0557c0 0x7f41cc057c80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41f013ae70 0x7f41f0066200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41f00a4f20 0x7f41f00606c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 --2- 172.21.15.161:0/2483395488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41f013a4d0 0x7f41f0138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 >> 172.21.15.161:0/2483395488 conn(0x7f41f00ad630 msgr2=0x7f41f0068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 shutdown_connections 2020-11-20T11:38:48.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.800+0000 7f41f5920700 1 -- 172.21.15.161:0/2483395488 wait complete. 2020-11-20T11:38:48.813 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T11:38:48.814 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T11:38:48.944 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 Processor -- start 2020-11-20T11:38:48.944 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- start start 2020-11-20T11:38:48.946 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f093813b790 0x7f0938090610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.946 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 0x7f09380aca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0938090c00 con 0x7f09380adc80 2020-11-20T11:38:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093808fbd0 con 0x7f093813b790 2020-11-20T11:38:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0938093ad0 con 0x7f093808ef40 2020-11-20T11:38:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093dd3d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f09380adc80 0x7f093813b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46942/0 (socket says 172.21.15.161:46942) 2020-11-20T11:38:48.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093dd3d700 1 -- 172.21.15.161:0/1116920226 learned_addr learned my addr 172.21.15.161:0/1116920226 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 --2- 172.21.15.161:0/1116920226 >> v2:172.21.15.161:3300/0 conn(0x7f093813b790 0x7f0938090610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093e53e700 1 --2- 172.21.15.161:0/1116920226 >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 0x7f09380aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872983632 0 0) 0x7f0938090c00 con 0x7f09380adc80 2020-11-20T11:38:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0920003240 con 0x7f09380adc80 2020-11-20T11:38:48.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 -- 172.21.15.161:0/1116920226 >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 msgr2=0x7f09380aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1553296657 0 0) 0x7f0920003240 con 0x7f09380adc80 2020-11-20T11:38:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 --2- 172.21.15.161:0/1116920226 >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 0x7f09380aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 -- 172.21.15.161:0/1116920226 >> v1:172.21.15.161:6789/0 conn(0x7f09380adc80 legacy=0x7f093813b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 -- 172.21.15.161:0/1116920226 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938090ea0 con 0x7f093813b790 2020-11-20T11:38:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093e53e700 1 --2- 172.21.15.161:0/1116920226 >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 0x7f09380aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:48.950 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093d53c700 1 --2- 172.21.15.161:0/1116920226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093813b790 0x7f0938090610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f09380ae700 tx=0x7f0928006df0).ready entity=mon.0 client_cookie=6576cdc09fa2ab77 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.950 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300019e0 con 0x7f093813b790 2020-11-20T11:38:48.950 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09280094a0 con 0x7f093813b790 2020-11-20T11:38:48.950 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093cd3b700 1 -- 172.21.15.161:0/1116920226 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928009820 con 0x7f093813b790 2020-11-20T11:38:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- 172.21.15.161:0/1116920226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093813b790 msgr2=0x7f0938090610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 --2- 172.21.15.161:0/1116920226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093813b790 0x7f0938090610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f09380ae700 tx=0x7f0928006df0).stop 2020-11-20T11:38:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- 172.21.15.161:0/1116920226 shutdown_connections 2020-11-20T11:38:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 --2- 172.21.15.161:0/1116920226 >> v2:172.21.15.186:3300/0 conn(0x7f093808ef40 0x7f09380aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 --2- 172.21.15.161:0/1116920226 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093813b790 0x7f0938090610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- 172.21.15.161:0/1116920226 >> 172.21.15.161:0/1116920226 conn(0x7f0938060150 msgr2=0x7f0938060560 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- 172.21.15.161:0/1116920226 shutdown_connections 2020-11-20T11:38:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.944+0000 7f093ed3f700 1 -- 172.21.15.161:0/1116920226 wait complete. 2020-11-20T11:38:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 Processor -- start 2020-11-20T11:38:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- start start 2020-11-20T11:38:48.955 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09380adc80 0x7f09380a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f093813b790 0x7f093814cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380a7730 con 0x7f093808ef40 2020-11-20T11:38:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09380a6070 con 0x7f093813b790 2020-11-20T11:38:48.956 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09380a6310 con 0x7f09380adc80 2020-11-20T11:38:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36706/0 (socket says 172.21.15.161:36706) 2020-11-20T11:38:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 -- 172.21.15.161:0/3600956649 learned_addr learned my addr 172.21.15.161:0/3600956649 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093d53c700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09380adc80 0x7f09380a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.957 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093e53e700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f093813b790 0x7f093814cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 -- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09380adc80 msgr2=0x7f09380a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09380adc80 0x7f09380a7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 -- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f093813b790 msgr2=0x7f093814cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:48.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f093813b790 0x7f093814cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:48.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 -- 172.21.15.161:0/3600956649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09380a65b0 con 0x7f093808ef40 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093dd3d700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f093000ce30 tx=0x7f0930001830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930007320 con 0x7f093808ef40 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0930007480 con 0x7f093808ef40 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09380a5af0 con 0x7f093808ef40 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930005840 con 0x7f093808ef40 2020-11-20T11:38:48.959 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093814d400 con 0x7f093808ef40 2020-11-20T11:38:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.948+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09380a6740 con 0x7f093808ef40 2020-11-20T11:38:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.952+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f0930010030 con 0x7f093808ef40 2020-11-20T11:38:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.952+0000 7f0925ffb700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 0x7f0910057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.952+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f093006e750 con 0x7f093808ef40 2020-11-20T11:38:48.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.952+0000 7f093d53c700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 0x7f0910057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:48.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.952+0000 7f093d53c700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 0x7f0910057cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0928006e30 tx=0x7f0928015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:48.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:48.956+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f09380a6740 con 0x7f093808ef40 2020-11-20T11:38:49.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.111+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f09380a6740 con 0x7f093808ef40 2020-11-20T11:38:49.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.555+0000 7f0925ffb700 1 -- 172.21.15.161:0/3600956649 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f09380a6740 con 0x7f093808ef40 2020-11-20T11:38:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 msgr2=0x7f0910057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 0x7f0910057cb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0928006e30 tx=0x7f0928015000).stop 2020-11-20T11:38:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 msgr2=0x7f09380aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f093000ce30 tx=0x7f0930001830).stop 2020-11-20T11:38:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 shutdown_connections 2020-11-20T11:38:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f09100557f0 0x7f0910057cb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f093813b790 0x7f093814cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f093808ef40 0x7f09380aa290 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 --2- 172.21.15.161:0/3600956649 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f09380adc80 0x7f09380a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.559+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 >> 172.21.15.161:0/3600956649 conn(0x7f0938060150 msgr2=0x7f09380af600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:49.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.563+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 shutdown_connections 2020-11-20T11:38:49.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.563+0000 7f093ed3f700 1 -- 172.21.15.161:0/3600956649 wait complete. 2020-11-20T11:38:49.566 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2020-11-20T11:38:49.579 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T11:38:49.580 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T11:38:49.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 Processor -- start 2020-11-20T11:38:49.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- start start 2020-11-20T11:38:49.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb53c067d90 0x7fb53c061930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0632e0 con 0x7fb53c0af070 2020-11-20T11:38:49.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c1383d0 con 0x7fb53c1378a0 2020-11-20T11:38:49.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0aae10 con 0x7fb53c067d90 2020-11-20T11:38:49.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb53c0af070 0x7fb53c067680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46956/0 (socket says 172.21.15.161:46956) 2020-11-20T11:38:49.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 -- 172.21.15.161:0/3798226970 learned_addr learned my addr 172.21.15.161:0/3798226970 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:49.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808469030 0 0) 0x7fb53c0632e0 con 0x7fb53c0af070 2020-11-20T11:38:49.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb528003240 con 0x7fb53c0af070 2020-11-20T11:38:49.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53bfff700 1 --2- 172.21.15.161:0/3798226970 >> v2:172.21.15.186:3300/0 conn(0x7fb53c067d90 0x7fb53c061930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 650962126 0 0) 0x7fb528003240 con 0x7fb53c0af070 2020-11-20T11:38:49.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 >> v2:172.21.15.186:3300/0 conn(0x7fb53c067d90 msgr2=0x7fb53c061930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:49.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 --2- 172.21.15.161:0/3798226970 >> v2:172.21.15.186:3300/0 conn(0x7fb53c067d90 0x7fb53c061930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 >> v1:172.21.15.186:6789/0 conn(0x7fb53c1378a0 legacy=0x7fb53c137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0aa020 con 0x7fb53c0af070 2020-11-20T11:38:49.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7fb52c0014e0 con 0x7fb53c0af070 2020-11-20T11:38:49.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 >> v1:172.21.15.161:6789/0 conn(0x7fb53c0af070 legacy=0x7fb53c067680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 0x7fb528003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5280044e0 0x7fb528004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528004e50 0x7fb52800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528005330 con 0x7fb528003730 2020-11-20T11:38:49.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52800bc20 con 0x7fb528004e50 2020-11-20T11:38:49.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52800bd90 con 0x7fb5280044e0 2020-11-20T11:38:49.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 0x7fb528003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53bfff700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5280044e0 0x7fb528004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb54133e700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528004e50 0x7fb52800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 -- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5280044e0 msgr2=0x7fb528004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:49.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb5280044e0 0x7fb528004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 -- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528004e50 msgr2=0x7fb52800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:49.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528004e50 0x7fb52800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb54133e700 1 -- 172.21.15.161:0/3798226970 reap_dead start 2020-11-20T11:38:49.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 -- 172.21.15.161:0/3798226970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528003240 con 0x7fb528003730 2020-11-20T11:38:49.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb540b3d700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 0x7fb528003b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb52c00c440 tx=0x7fb53c0aa1b0).ready entity=mon.0 client_cookie=d0609fc1adb198aa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:49.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0072e0 con 0x7fb528003730 2020-11-20T11:38:49.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c007440 con 0x7fb528003730 2020-11-20T11:38:49.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb53b7fe700 1 -- 172.21.15.161:0/3798226970 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c005800 con 0x7fb528003730 2020-11-20T11:38:49.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 msgr2=0x7fb528003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 0x7fb528003b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fb52c00c440 tx=0x7fb53c0aa1b0).stop 2020-11-20T11:38:49.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- 172.21.15.161:0/3798226970 shutdown_connections 2020-11-20T11:38:49.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 --2- 172.21.15.161:0/3798226970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb528003730 0x7fb528003b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- 172.21.15.161:0/3798226970 >> 172.21.15.161:0/3798226970 conn(0x7fb53c063470 msgr2=0x7fb53c063880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:49.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- 172.21.15.161:0/3798226970 shutdown_connections 2020-11-20T11:38:49.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.715+0000 7fb541b3f700 1 -- 172.21.15.161:0/3798226970 wait complete. 2020-11-20T11:38:49.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 Processor -- start 2020-11-20T11:38:49.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- start start 2020-11-20T11:38:49.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528003730 0x7fb53c0a8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb53c0add50 0x7fb53c0a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0a7720 con 0x7fb53c1341f0 2020-11-20T11:38:49.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0ae260 con 0x7fb528003730 2020-11-20T11:38:49.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0ae500 con 0x7fb53c0add50 2020-11-20T11:38:49.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36730/0 (socket says 172.21.15.161:36730) 2020-11-20T11:38:49.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 -- 172.21.15.161:0/1026684653 learned_addr learned my addr 172.21.15.161:0/1026684653 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:49.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb540b3d700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528003730 0x7fb53c0a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb53bfff700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb53c0add50 0x7fb53c0a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 -- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb53c0add50 msgr2=0x7fb53c0a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb53c0add50 0x7fb53c0a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 -- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528003730 msgr2=0x7fb53c0a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:49.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528003730 0x7fb53c0a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:49.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 -- 172.21.15.161:0/1026684653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0940d0 con 0x7fb53c1341f0 2020-11-20T11:38:49.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb54133e700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb53c064420 tx=0x7fb534009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:49.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534003030 con 0x7fb53c1341f0 2020-11-20T11:38:49.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534003190 con 0x7fb53c1341f0 2020-11-20T11:38:49.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c134b60 con 0x7fb53c1341f0 2020-11-20T11:38:49.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb534006a80 con 0x7fb53c1341f0 2020-11-20T11:38:49.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c094f70 con 0x7fb53c1341f0 2020-11-20T11:38:49.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c0ae6c0 con 0x7fb53c1341f0 2020-11-20T11:38:49.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.719+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fb53401c060 con 0x7fb53c1341f0 2020-11-20T11:38:49.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.723+0000 7fb538ff9700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 0x7fb514057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:49.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.723+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fb53406dc30 con 0x7fb53c1341f0 2020-11-20T11:38:49.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.723+0000 7fb540b3d700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 0x7fb514057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:49.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.723+0000 7fb540b3d700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 0x7fb514057c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb52c007900 tx=0x7fb52c013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:49.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.723+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb534043c40 con 0x7fb53c1341f0 2020-11-20T11:38:49.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:49.903+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fb53c1383d0 con 0x7fb53c1341f0 2020-11-20T11:38:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.567+0000 7fb538ff9700 1 -- 172.21.15.161:0/1026684653 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fb53c1383d0 con 0x7fb53c1341f0 2020-11-20T11:38:50.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 msgr2=0x7fb514057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 0x7fb514057c80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb52c007900 tx=0x7fb52c013000).stop 2020-11-20T11:38:50.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 msgr2=0x7fb53c134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fb53c064420 tx=0x7fb534009040).stop 2020-11-20T11:38:50.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 shutdown_connections 2020-11-20T11:38:50.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb5140557c0 0x7fb514057c80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb53c1341f0 0x7fb53c134670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb528003730 0x7fb53c0a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 --2- 172.21.15.161:0/1026684653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb53c0add50 0x7fb53c0a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 >> 172.21.15.161:0/1026684653 conn(0x7fb53c063470 msgr2=0x7fb53c061e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:50.578 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 shutdown_connections 2020-11-20T11:38:50.578 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.571+0000 7fb541b3f700 1 -- 172.21.15.161:0/1026684653 wait complete. 2020-11-20T11:38:50.591 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T11:38:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 Processor -- start 2020-11-20T11:38:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 -- start start 2020-11-20T11:38:50.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e2c08eae0 0x7f6e2c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:50.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0a6620 con 0x7f6e2c0618c0 2020-11-20T11:38:50.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c0ac860 con 0x7f6e2c061ca0 2020-11-20T11:38:50.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.715+0000 7f6e2bfff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a7170 con 0x7f6e2c08eae0 2020-11-20T11:38:50.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2b7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e2c08eae0 0x7f6e2c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2affd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6e2c0618c0 0x7f6e2c0acd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:46976/0 (socket says 172.21.15.161:46976) 2020-11-20T11:38:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2affd700 1 -- 172.21.15.161:0/344284186 learned_addr learned my addr 172.21.15.161:0/344284186 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2b7fe700 1 -- 172.21.15.161:0/344284186 >> v1:172.21.15.186:6789/0 conn(0x7f6e2c061ca0 legacy=0x7f6e2c13e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2b7fe700 1 -- 172.21.15.161:0/344284186 >> v1:172.21.15.161:6789/0 conn(0x7f6e2c0618c0 legacy=0x7f6e2c0acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2b7fe700 1 -- 172.21.15.161:0/344284186 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0a62e0 con 0x7f6e2c08eae0 2020-11-20T11:38:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2b7fe700 1 --2- 172.21.15.161:0/344284186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c0ad4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6e24009c90 tx=0x7f6e240091d0).ready entity=mon.0 client_cookie=1a6120a253c6f32f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e29ffb700 1 -- 172.21.15.161:0/344284186 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2400bbc0 con 0x7f6e2c08eae0 2020-11-20T11:38:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e29ffb700 1 -- 172.21.15.161:0/344284186 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2400bd20 con 0x7f6e2c08eae0 2020-11-20T11:38:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e29ffb700 1 -- 172.21.15.161:0/344284186 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e24011610 con 0x7f6e2c08eae0 2020-11-20T11:38:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- 172.21.15.161:0/344284186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c08eae0 msgr2=0x7f6e2c0ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/344284186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c0ad4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6e24009c90 tx=0x7f6e240091d0).stop 2020-11-20T11:38:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- 172.21.15.161:0/344284186 shutdown_connections 2020-11-20T11:38:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/344284186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c0ad4d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- 172.21.15.161:0/344284186 >> 172.21.15.161:0/344284186 conn(0x7f6e2c060c20 msgr2=0x7f6e2c0611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- 172.21.15.161:0/344284186 shutdown_connections 2020-11-20T11:38:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- 172.21.15.161:0/344284186 wait complete. 2020-11-20T11:38:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 Processor -- start 2020-11-20T11:38:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.719+0000 7f6e2bfff700 1 -- start start 2020-11-20T11:38:50.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e2c0618c0 0x7f6e2c094880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:50.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:50.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:50.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c093370 con 0x7f6e2c061ca0 2020-11-20T11:38:50.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a8f10 con 0x7f6e2c08eae0 2020-11-20T11:38:50.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0a91b0 con 0x7f6e2c0618c0 2020-11-20T11:38:50.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36742/0 (socket says 172.21.15.161:36742) 2020-11-20T11:38:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 -- 172.21.15.161:0/1670686667 learned_addr learned my addr 172.21.15.161:0/1670686667 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2affd700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e2c0618c0 0x7f6e2c094880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2b7fe700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 -- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e2c0618c0 msgr2=0x7f6e2c094880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e2c0618c0 0x7f6e2c094880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 -- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 msgr2=0x7f6e2c136b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c136b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 -- 172.21.15.161:0/1670686667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c0a9450 con 0x7f6e2c061ca0 2020-11-20T11:38:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2b7fe700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2a7fc700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e14001e70 tx=0x7f6e14007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14007020 con 0x7f6e2c061ca0 2020-11-20T11:38:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14007180 con 0x7f6e2c061ca0 2020-11-20T11:38:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1400e560 con 0x7f6e2c061ca0 2020-11-20T11:38:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c13b9f0 con 0x7f6e2c061ca0 2020-11-20T11:38:50.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c141940 con 0x7f6e2c061ca0 2020-11-20T11:38:50.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.723+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c044f60 con 0x7f6e2c061ca0 2020-11-20T11:38:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.727+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6e14010070 con 0x7f6e2c061ca0 2020-11-20T11:38:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.727+0000 7f6e22ffd700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 0x7f6e08057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.727+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f6e1406d920 con 0x7f6e2c061ca0 2020-11-20T11:38:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.727+0000 7f6e2affd700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 0x7f6e08057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.727+0000 7f6e2affd700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 0x7f6e08057c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6e1c0045d0 tx=0x7f6e1c007b80).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:50.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.735+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6e14042fd0 con 0x7f6e2c061ca0 2020-11-20T11:38:50.892 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:50.887+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f6e2c13ddd0 con 0x7f6e2c061ca0 2020-11-20T11:38:52.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.575+0000 7f6e22ffd700 1 -- 172.21.15.161:0/1670686667 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7f6e14043890 con 0x7f6e2c061ca0 2020-11-20T11:38:52.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 msgr2=0x7f6e08057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 0x7f6e08057c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6e1c0045d0 tx=0x7f6e1c007b80).stop 2020-11-20T11:38:52.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 msgr2=0x7f6e2c0a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e14001e70 tx=0x7f6e14007c50).stop 2020-11-20T11:38:52.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 shutdown_connections 2020-11-20T11:38:52.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6e080557c0 0x7f6e08057c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e2c08eae0 0x7f6e2c136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e2c0618c0 0x7f6e2c094880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 --2- 172.21.15.161:0/1670686667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e2c061ca0 0x7f6e2c0a98f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 >> 172.21.15.161:0/1670686667 conn(0x7f6e2c060c20 msgr2=0x7f6e2c0acc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 shutdown_connections 2020-11-20T11:38:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.579+0000 7f6e2bfff700 1 -- 172.21.15.161:0/1670686667 wait complete. 2020-11-20T11:38:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2020-11-20T11:38:52.602 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T11:38:52.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.727+0000 7fd46a9a5700 1 Processor -- start 2020-11-20T11:38:52.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.727+0000 7fd46a9a5700 1 -- start start 2020-11-20T11:38:52.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd46413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4640ae0d0 0x7fd4640a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd464060710 con 0x7fd4640a9320 2020-11-20T11:38:52.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640609b0 con 0x7fd4640ae0d0 2020-11-20T11:38:52.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464138360 con 0x7fd4640adcf0 2020-11-20T11:38:52.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4640ae0d0 0x7fd4640a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4640ae0d0 0x7fd4640a8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36750/0 (socket says 172.21.15.161:36750) 2020-11-20T11:38:52.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 -- 172.21.15.161:0/204511423 learned_addr learned my addr 172.21.15.161:0/204511423 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:52.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4699a3700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd46413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 -- 172.21.15.161:0/204511423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 msgr2=0x7fd46413a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:52.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd46413a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 -- 172.21.15.161:0/204511423 >> v1:172.21.15.186:6789/0 conn(0x7fd4640a9320 legacy=0x7fd464137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4689a1700 1 -- 172.21.15.161:0/204511423 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301415801 0 0) 0x7fd464060710 con 0x7fd4640a9320 2020-11-20T11:38:52.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 -- 172.21.15.161:0/204511423 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464066860 con 0x7fd4640ae0d0 2020-11-20T11:38:52.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4691a2700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a8e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd454006fd0 tx=0x7fd454006eb0).ready entity=mon.0 client_cookie=78ef5193ebee1513 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:52.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4689a1700 1 -- 172.21.15.161:0/204511423 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454009810 con 0x7fd4640ae0d0 2020-11-20T11:38:52.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4689a1700 1 -- 172.21.15.161:0/204511423 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454009970 con 0x7fd4640ae0d0 2020-11-20T11:38:52.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd4689a1700 1 -- 172.21.15.161:0/204511423 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454009cf0 con 0x7fd4640ae0d0 2020-11-20T11:38:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- 172.21.15.161:0/204511423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 msgr2=0x7fd4640a8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a8e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd454006fd0 tx=0x7fd454006eb0).stop 2020-11-20T11:38:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- 172.21.15.161:0/204511423 shutdown_connections 2020-11-20T11:38:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd46413a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/204511423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a8e30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- 172.21.15.161:0/204511423 >> 172.21.15.161:0/204511423 conn(0x7fd464062730 msgr2=0x7fd464062b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- 172.21.15.161:0/204511423 shutdown_connections 2020-11-20T11:38:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.731+0000 7fd46a9a5700 1 -- 172.21.15.161:0/204511423 wait complete. 2020-11-20T11:38:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.735+0000 7fd46a9a5700 1 Processor -- start 2020-11-20T11:38:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.735+0000 7fd46a9a5700 1 -- start start 2020-11-20T11:38:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.735+0000 7fd46a9a5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd4640a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 0x7fd464149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414d570 con 0x7fd4640ae0d0 2020-11-20T11:38:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414d810 con 0x7fd46414ce60 2020-11-20T11:38:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46414dab0 con 0x7fd4640adcf0 2020-11-20T11:38:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4691a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4691a2700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36756/0 (socket says 172.21.15.161:36756) 2020-11-20T11:38:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4691a2700 1 -- 172.21.15.161:0/1960382862 learned_addr learned my addr 172.21.15.161:0/1960382862 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4699a3700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd4640a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 0x7fd464149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 -- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 msgr2=0x7fd4640a2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd4640a2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 -- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 msgr2=0x7fd4640a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 -- 172.21.15.161:0/1960382862 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46414d2a0 con 0x7fd46414ce60 2020-11-20T11:38:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4691a2700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:52.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd4699a3700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd4640a2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:52.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a1a4700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 0x7fd464149970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd464066010 tx=0x7fd45c007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:52.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00e560 con 0x7fd46414ce60 2020-11-20T11:38:52.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c00e6c0 con 0x7fd46414ce60 2020-11-20T11:38:52.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd464149e60 con 0x7fd46414ce60 2020-11-20T11:38:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00ea80 con 0x7fd46414ce60 2020-11-20T11:38:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46413cd50 con 0x7fd46414ce60 2020-11-20T11:38:52.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46414dc70 con 0x7fd46414ce60 2020-11-20T11:38:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.739+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fd45c010070 con 0x7fd46414ce60 2020-11-20T11:38:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.743+0000 7fd451ffb700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 0x7fd43c057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:52.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.743+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fd45c06e3d0 con 0x7fd46414ce60 2020-11-20T11:38:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.743+0000 7fd4699a3700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 0x7fd43c057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:52.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.743+0000 7fd4699a3700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 0x7fd43c057cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd460006fd0 tx=0x7fd460006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:52.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.751+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd45c044120 con 0x7fd46414ce60 2020-11-20T11:38:52.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:52.903+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fd464044f60 con 0x7fd46414ce60 2020-11-20T11:38:53.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.579+0000 7fd451ffb700 1 -- 172.21.15.161:0/1960382862 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7fd45c047740 con 0x7fd46414ce60 2020-11-20T11:38:53.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 msgr2=0x7fd43c057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 0x7fd43c057cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fd460006fd0 tx=0x7fd460006df0).stop 2020-11-20T11:38:53.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 msgr2=0x7fd464149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 0x7fd464149970 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fd464066010 tx=0x7fd45c007cb0).stop 2020-11-20T11:38:53.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 shutdown_connections 2020-11-20T11:38:53.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd43c0557f0 0x7fd43c057cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46414ce60 0x7fd464149970 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4640adcf0 0x7fd4640a2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 --2- 172.21.15.161:0/1960382862 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4640ae0d0 0x7fd4640a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.583+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 >> 172.21.15.161:0/1960382862 conn(0x7fd464062730 msgr2=0x7fd4640acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:53.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.587+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 shutdown_connections 2020-11-20T11:38:53.590 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.587+0000 7fd46a9a5700 1 -- 172.21.15.161:0/1960382862 wait complete. 2020-11-20T11:38:53.592 INFO:teuthology.orchestra.run.smithi161.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T11:38:53.609 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T11:38:53.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 Processor -- start 2020-11-20T11:38:53.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 -- start start 2020-11-20T11:38:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40ae050 0x7fe3c40ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3c40a9050 0x7fe3c413ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c40a95d0 con 0x7fe3c40adc70 2020-11-20T11:38:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40aabe0 con 0x7fe3c40a9050 2020-11-20T11:38:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3ca5de700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40aadd0 con 0x7fe3c40ae050 2020-11-20T11:38:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe3c40a9050 0x7fe3c413ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c37fe700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40ae050 0x7fe3c40ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c3fff700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe3c40adc70 0x7fe3c413b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46518/0 (socket says 172.21.15.161:46518) 2020-11-20T11:38:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c3fff700 1 -- 172.21.15.161:0/1269682192 learned_addr learned my addr 172.21.15.161:0/1269682192 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40ae050 msgr2=0x7fe3c40ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 --2- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40ae050 0x7fe3c40ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/1269682192 >> v1:172.21.15.186:6789/0 conn(0x7fe3c40adc70 legacy=0x7fe3c413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/1269682192 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40a8760 con 0x7fe3c40a9050 2020-11-20T11:38:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.727+0000 7fe3c8b7b700 1 --2- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413ab10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe3bc009c90 tx=0x7fe3bc0091d0).ready entity=mon.1 client_cookie=6ae44dfb39e7b171 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/1269682192 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00ba70 con 0x7fe3c40a9050 2020-11-20T11:38:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/1269682192 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00bbd0 con 0x7fe3c40a9050 2020-11-20T11:38:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3c2ffd700 1 -- 172.21.15.161:0/1269682192 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc011400 con 0x7fe3c40a9050 2020-11-20T11:38:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 msgr2=0x7fe3c413ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413ab10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe3bc009c90 tx=0x7fe3bc0091d0).stop 2020-11-20T11:38:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- 172.21.15.161:0/1269682192 shutdown_connections 2020-11-20T11:38:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413ab10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/1269682192 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40ae050 0x7fe3c40ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- 172.21.15.161:0/1269682192 >> 172.21.15.161:0/1269682192 conn(0x7fe3c4067880 msgr2=0x7fe3c4067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- 172.21.15.161:0/1269682192 shutdown_connections 2020-11-20T11:38:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- 172.21.15.161:0/1269682192 wait complete. 2020-11-20T11:38:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 Processor -- start 2020-11-20T11:38:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 -- start start 2020-11-20T11:38:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.731+0000 7fe3ca5de700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40adc70 0x7fe3c409e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a7650 con 0x7fe3c40ae050 2020-11-20T11:38:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a78f0 con 0x7fe3c40a9050 2020-11-20T11:38:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a7310 con 0x7fe3c40adc70 2020-11-20T11:38:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36772/0 (socket says 172.21.15.161:36772) 2020-11-20T11:38:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/34039165 learned_addr learned my addr 172.21.15.161:0/34039165 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c37fe700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40adc70 0x7fe3c409e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c3fff700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40adc70 msgr2=0x7fe3c409e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40adc70 0x7fe3c409e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 msgr2=0x7fe3c413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 -- 172.21.15.161:0/34039165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c409ea40 con 0x7fe3c40ae050 2020-11-20T11:38:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3c8b7b700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe3bc009210 tx=0x7fe3bc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc01c6c0 con 0x7fe3c40ae050 2020-11-20T11:38:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc01c820 con 0x7fe3c40ae050 2020-11-20T11:38:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c409ec90 con 0x7fe3c40ae050 2020-11-20T11:38:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc01cc00 con 0x7fe3c40ae050 2020-11-20T11:38:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4137c30 con 0x7fe3c40ae050 2020-11-20T11:38:53.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c40ab510 con 0x7fe3c40ae050 2020-11-20T11:38:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.735+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fe3bc017070 con 0x7fe3c40ae050 2020-11-20T11:38:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.739+0000 7fe3bbfff700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 0x7fe398057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.739+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fe3bc070be0 con 0x7fe3c40ae050 2020-11-20T11:38:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.739+0000 7fe3c3fff700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 0x7fe398057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.739+0000 7fe3c3fff700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 0x7fe398057c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe3b00045d0 tx=0x7fe3b0007b80).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:53.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.747+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe3c40ab510 con 0x7fe3c40ae050 2020-11-20T11:38:53.952 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.951+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe3c40ab510 con 0x7fe3c40ae050 2020-11-20T11:38:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.959+0000 7fe3bbfff700 1 -- 172.21.15.161:0/34039165 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe3c40ab510 con 0x7fe3c40ae050 2020-11-20T11:38:53.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 msgr2=0x7fe398057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 0x7fe398057c80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe3b00045d0 tx=0x7fe3b0007b80).stop 2020-11-20T11:38:53.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 msgr2=0x7fe3c41375a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:53.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe3bc009210 tx=0x7fe3bc016000).stop 2020-11-20T11:38:53.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 shutdown_connections 2020-11-20T11:38:53.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fe3980557c0 0x7fe398057c80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3c40ae050 0x7fe3c41375a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3c40a9050 0x7fe3c413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 --2- 172.21.15.161:0/34039165 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe3c40adc70 0x7fe3c409e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:53.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 >> 172.21.15.161:0/34039165 conn(0x7fe3c4067880 msgr2=0x7fe3c40acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:53.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 shutdown_connections 2020-11-20T11:38:53.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:53.963+0000 7fe3ca5de700 1 -- 172.21.15.161:0/34039165 wait complete. 2020-11-20T11:38:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T11:38:53.988 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:54.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 Processor -- start 2020-11-20T11:38:54.097 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- start start 2020-11-20T11:38:54.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2d4c067f70 0x7f2d4c135570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c138cb0 con 0x7f2d4c094ce0 2020-11-20T11:38:54.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c0af6c0 con 0x7f2d4c0af030 2020-11-20T11:38:54.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c0aacb0 con 0x7f2d4c067f70 2020-11-20T11:38:54.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2d4c067f70 0x7f2d4c135570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2d4c067f70 0x7f2d4c135570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42254/0 (socket says 172.21.15.161:42254) 2020-11-20T11:38:54.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 -- 172.21.15.161:0/1986094806 learned_addr learned my addr 172.21.15.161:0/1986094806 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:54.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d51b0b700 1 --1- 172.21.15.161:0/1986094806 >> v1:172.21.15.186:6789/0 conn(0x7f2d4c0af030 0x7f2d4c1385a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46542/0 (socket says 172.21.15.161:46542) 2020-11-20T11:38:54.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 -- 172.21.15.161:0/1986094806 >> v1:172.21.15.186:6789/0 conn(0x7f2d4c0af030 legacy=0x7f2d4c1385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 -- 172.21.15.161:0/1986094806 >> v1:172.21.15.161:6789/0 conn(0x7f2d4c094ce0 legacy=0x7f2d4c135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 -- 172.21.15.161:0/1986094806 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0671e0 con 0x7f2d4c067f70 2020-11-20T11:38:54.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d5130a700 1 --2- 172.21.15.161:0/1986094806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c135570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2d3c006fd0 tx=0x7f2d3c006eb0).ready entity=mon.1 client_cookie=6c40463d2e873bea server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d50b09700 1 -- 172.21.15.161:0/1986094806 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0098d0 con 0x7f2d4c067f70 2020-11-20T11:38:54.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d50b09700 1 -- 172.21.15.161:0/1986094806 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c009a30 con 0x7f2d4c067f70 2020-11-20T11:38:54.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d50b09700 1 -- 172.21.15.161:0/1986094806 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c009db0 con 0x7f2d4c067f70 2020-11-20T11:38:54.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- 172.21.15.161:0/1986094806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 msgr2=0x7f2d4c135570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/1986094806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c135570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2d3c006fd0 tx=0x7f2d3c006eb0).stop 2020-11-20T11:38:54.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- 172.21.15.161:0/1986094806 shutdown_connections 2020-11-20T11:38:54.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/1986094806 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c135570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- 172.21.15.161:0/1986094806 >> 172.21.15.161:0/1986094806 conn(0x7f2d4c064540 msgr2=0x7f2d4c064950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:54.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- 172.21.15.161:0/1986094806 shutdown_connections 2020-11-20T11:38:54.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.095+0000 7f2d53d6f700 1 -- 172.21.15.161:0/1986094806 wait complete. 2020-11-20T11:38:54.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.099+0000 7f2d53d6f700 1 Processor -- start 2020-11-20T11:38:54.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.099+0000 7f2d53d6f700 1 -- start start 2020-11-20T11:38:54.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.099+0000 7f2d53d6f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c13de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d4c094ce0 0x7f2d4c13e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 0x7f2d4c136b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c136440 con 0x7f2d4c0af030 2020-11-20T11:38:54.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c148510 con 0x7f2d4c067f70 2020-11-20T11:38:54.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c136670 con 0x7f2d4c094ce0 2020-11-20T11:38:54.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d5230c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 0x7f2d4c136b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d5230c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 0x7f2d4c136b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36796/0 (socket says 172.21.15.161:36796) 2020-11-20T11:38:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c13de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d5230c700 1 -- 172.21.15.161:0/548101509 learned_addr learned my addr 172.21.15.161:0/548101509 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d5130a700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d4c094ce0 0x7f2d4c13e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 -- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d4c094ce0 msgr2=0x7f2d4c13e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d4c094ce0 0x7f2d4c13e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 -- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 msgr2=0x7f2d4c136b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 0x7f2d4c136b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 -- 172.21.15.161:0/548101509 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0a6770 con 0x7f2d4c067f70 2020-11-20T11:38:54.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d51b0b700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c13de70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2d4800c740 tx=0x7f2d48007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480072e0 con 0x7f2d4c067f70 2020-11-20T11:38:54.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48005530 con 0x7f2d4c067f70 2020-11-20T11:38:54.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c137e80 con 0x7f2d4c067f70 2020-11-20T11:38:54.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480058d0 con 0x7f2d4c067f70 2020-11-20T11:38:54.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c1371a0 con 0x7f2d4c067f70 2020-11-20T11:38:54.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c148680 con 0x7f2d4c067f70 2020-11-20T11:38:54.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.103+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f2d4801a060 con 0x7f2d4c067f70 2020-11-20T11:38:54.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.107+0000 7f2d41ffb700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 0x7f2d2c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.107+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2d4806dd10 con 0x7f2d4c067f70 2020-11-20T11:38:54.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.107+0000 7f2d5130a700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 0x7f2d2c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.107+0000 7f2d5130a700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 0x7f2d2c057c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2d3c00b1b0 tx=0x7f2d3c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.115+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2d4c148680 con 0x7f2d4c067f70 2020-11-20T11:38:54.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.267+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d4c148650 con 0x7f2d4c067f70 2020-11-20T11:38:54.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.271+0000 7f2d41ffb700 1 -- 172.21.15.161:0/548101509 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f2d48018030 con 0x7f2d4c067f70 2020-11-20T11:38:54.275 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:54.275 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:54.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 msgr2=0x7f2d2c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 0x7f2d2c057c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2d3c00b1b0 tx=0x7f2d3c015000).stop 2020-11-20T11:38:54.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 msgr2=0x7f2d4c13de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c13de70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2d4800c740 tx=0x7f2d48007b80).stop 2020-11-20T11:38:54.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 shutdown_connections 2020-11-20T11:38:54.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f2d2c0557c0 0x7f2d2c057c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d4c0af030 0x7f2d4c136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d4c067f70 0x7f2d4c13de70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 --2- 172.21.15.161:0/548101509 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d4c094ce0 0x7f2d4c13e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 >> 172.21.15.161:0/548101509 conn(0x7f2d4c064540 msgr2=0x7f2d4c068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:54.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 shutdown_connections 2020-11-20T11:38:54.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.275+0000 7f2d53d6f700 1 -- 172.21.15.161:0/548101509 wait complete. 2020-11-20T11:38:54.290 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:54.409 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 Processor -- start 2020-11-20T11:38:54.410 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 -- start start 2020-11-20T11:38:54.411 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac980a7590 0x7fac98142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.411 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980a4a70 con 0x7fac9805be80 2020-11-20T11:38:54.411 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980a4750 con 0x7fac980a9cc0 2020-11-20T11:38:54.411 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9eaa9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980a5420 con 0x7fac980a7590 2020-11-20T11:38:54.412 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9e2a8700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac980a7590 0x7fac98142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.412 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9daa7700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fac9805be80 0x7fac980a95b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47044/0 (socket says 172.21.15.161:47044) 2020-11-20T11:38:54.412 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9daa7700 1 -- 172.21.15.161:0/1823006139 learned_addr learned my addr 172.21.15.161:0/1823006139 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:54.413 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9e2a8700 1 -- 172.21.15.161:0/1823006139 >> v1:172.21.15.186:6789/0 conn(0x7fac980a9cc0 legacy=0x7fac981348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9e2a8700 1 -- 172.21.15.161:0/1823006139 >> v1:172.21.15.161:6789/0 conn(0x7fac9805be80 legacy=0x7fac980a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9e2a8700 1 -- 172.21.15.161:0/1823006139 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980a56c0 con 0x7fac980a7590 2020-11-20T11:38:54.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9caa5700 1 -- 172.21.15.161:0/1823006139 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543110609 0 0) 0x7fac980a4a70 con 0x7fac9805be80 2020-11-20T11:38:54.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9e2a8700 1 --2- 172.21.15.161:0/1823006139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a7590 0x7fac98142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fac90009c90 tx=0x7fac900091d0).ready entity=mon.0 client_cookie=16dfa5b78e7326a8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9caa5700 1 -- 172.21.15.161:0/1823006139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000bbc0 con 0x7fac980a7590 2020-11-20T11:38:54.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9caa5700 1 -- 172.21.15.161:0/1823006139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9000bd20 con 0x7fac980a7590 2020-11-20T11:38:54.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.407+0000 7fac9caa5700 1 -- 172.21.15.161:0/1823006139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011610 con 0x7fac980a7590 2020-11-20T11:38:54.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- 172.21.15.161:0/1823006139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a7590 msgr2=0x7fac98142f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/1823006139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a7590 0x7fac98142f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fac90009c90 tx=0x7fac900091d0).stop 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- 172.21.15.161:0/1823006139 shutdown_connections 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/1823006139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a7590 0x7fac98142f60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- 172.21.15.161:0/1823006139 >> 172.21.15.161:0/1823006139 conn(0x7fac980ad630 msgr2=0x7fac980ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- 172.21.15.161:0/1823006139 shutdown_connections 2020-11-20T11:38:54.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- 172.21.15.161:0/1823006139 wait complete. 2020-11-20T11:38:54.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 Processor -- start 2020-11-20T11:38:54.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.411+0000 7fac9eaa9700 1 -- start start 2020-11-20T11:38:54.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac9805be80 0x7fac9809e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac980a7590 0x7fac980a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980a1740 con 0x7fac980a9cc0 2020-11-20T11:38:54.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980a2050 con 0x7fac980a7590 2020-11-20T11:38:54.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980a22f0 con 0x7fac9805be80 2020-11-20T11:38:54.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36810/0 (socket says 172.21.15.161:36810) 2020-11-20T11:38:54.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 -- 172.21.15.161:0/3197574367 learned_addr learned my addr 172.21.15.161:0/3197574367 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:54.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9daa7700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac9805be80 0x7fac9809e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9d2a6700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac980a7590 0x7fac980a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 -- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac9805be80 msgr2=0x7fac9809e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac9805be80 0x7fac9809e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 -- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac980a7590 msgr2=0x7fac980a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac980a7590 0x7fac980a3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 -- 172.21.15.161:0/3197574367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980a2590 con 0x7fac980a9cc0 2020-11-20T11:38:54.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9e2a8700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fac90009440 tx=0x7fac90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90011e30 con 0x7fac980a9cc0 2020-11-20T11:38:54.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90010ae0 con 0x7fac980a9cc0 2020-11-20T11:38:54.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980a2830 con 0x7fac980a9cc0 2020-11-20T11:38:54.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90010e60 con 0x7fac980a9cc0 2020-11-20T11:38:54.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac98146760 con 0x7fac980a9cc0 2020-11-20T11:38:54.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.415+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac980a2bf0 con 0x7fac980a9cc0 2020-11-20T11:38:54.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.419+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fac90017070 con 0x7fac980a9cc0 2020-11-20T11:38:54.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.419+0000 7fac89ffb700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 0x7fac70057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.419+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fac90070fa0 con 0x7fac980a9cc0 2020-11-20T11:38:54.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.419+0000 7fac9daa7700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 0x7fac70057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.419+0000 7fac9daa7700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 0x7fac70057c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fac8c0011a0 tx=0x7fac8c0079e0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.423+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fac980a2bf0 con 0x7fac980a9cc0 2020-11-20T11:38:54.574 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.571+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac980a2bf0 con 0x7fac980a9cc0 2020-11-20T11:38:54.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac89ffb700 1 -- 172.21.15.161:0/3197574367 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7fac980a2bf0 con 0x7fac980a9cc0 2020-11-20T11:38:54.577 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:54.578 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:54.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 msgr2=0x7fac70057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 0x7fac70057c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fac8c0011a0 tx=0x7fac8c0079e0).stop 2020-11-20T11:38:54.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 msgr2=0x7fac98146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fac90009440 tx=0x7fac90016000).stop 2020-11-20T11:38:54.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 shutdown_connections 2020-11-20T11:38:54.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fac700557c0 0x7fac70057c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac980a9cc0 0x7fac98146270 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac9805be80 0x7fac9809e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 --2- 172.21.15.161:0/3197574367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac980a7590 0x7fac980a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 >> 172.21.15.161:0/3197574367 conn(0x7fac980ad630 msgr2=0x7fac980abda0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:54.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 shutdown_connections 2020-11-20T11:38:54.584 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.575+0000 7fac9eaa9700 1 -- 172.21.15.161:0/3197574367 wait complete. 2020-11-20T11:38:54.591 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T11:38:54.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 Processor -- start 2020-11-20T11:38:54.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 -- start start 2020-11-20T11:38:54.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6940ad560 0x7fc6940a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc69413c3f0 0x7fc6940a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6940a5510 con 0x7fc6940a8800 2020-11-20T11:38:54.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6940a8ca0 con 0x7fc69413c3f0 2020-11-20T11:38:54.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.715+0000 7fc69af68700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940a46f0 con 0x7fc6940ad560 2020-11-20T11:38:54.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc699f66700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6940ad560 0x7fc6940a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc69413c3f0 0x7fc6940a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc699765700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc6940a8800 0x7fc69413bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46574/0 (socket says 172.21.15.161:46574) 2020-11-20T11:38:54.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc699765700 1 -- 172.21.15.161:0/1502208879 learned_addr learned my addr 172.21.15.161:0/1502208879 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:54.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 -- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6940ad560 msgr2=0x7fc6940a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:54.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 --2- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6940ad560 0x7fc6940a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 -- 172.21.15.161:0/1502208879 >> v1:172.21.15.186:6789/0 conn(0x7fc6940a8800 legacy=0x7fc69413bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc698f64700 1 -- 172.21.15.161:0/1502208879 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115855930 0 0) 0x7fc6940a5510 con 0x7fc6940a8800 2020-11-20T11:38:54.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 -- 172.21.15.161:0/1502208879 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940a5770 con 0x7fc69413c3f0 2020-11-20T11:38:54.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69a767700 1 --2- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69413c3f0 0x7fc6940a7e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc68c00b9a0 tx=0x7fc68c006df0).ready entity=mon.1 client_cookie=ca8711b5291e1d8d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc698f64700 1 -- 172.21.15.161:0/1502208879 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0097b0 con 0x7fc69413c3f0 2020-11-20T11:38:54.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc698f64700 1 -- 172.21.15.161:0/1502208879 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c009910 con 0x7fc69413c3f0 2020-11-20T11:38:54.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc698f64700 1 -- 172.21.15.161:0/1502208879 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c009c90 con 0x7fc69413c3f0 2020-11-20T11:38:54.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 -- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69413c3f0 msgr2=0x7fc6940a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 --2- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69413c3f0 0x7fc6940a7e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fc68c00b9a0 tx=0x7fc68c006df0).stop 2020-11-20T11:38:54.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 -- 172.21.15.161:0/1502208879 shutdown_connections 2020-11-20T11:38:54.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 --2- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc69413c3f0 0x7fc6940a7e90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 --2- 172.21.15.161:0/1502208879 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc6940ad560 0x7fc6940a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 -- 172.21.15.161:0/1502208879 >> 172.21.15.161:0/1502208879 conn(0x7fc694060b90 msgr2=0x7fc6940accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:54.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 -- 172.21.15.161:0/1502208879 shutdown_connections 2020-11-20T11:38:54.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.719+0000 7fc69af68700 1 -- 172.21.15.161:0/1502208879 wait complete. 2020-11-20T11:38:54.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 Processor -- start 2020-11-20T11:38:54.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 -- start start 2020-11-20T11:38:54.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6940ad560 0x7fc694064dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69413f4b0 0x7fc69413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694065b10 con 0x7fc69413c3f0 2020-11-20T11:38:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694067260 con 0x7fc6940ad560 2020-11-20T11:38:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69af68700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc694067500 con 0x7fc69413f4b0 2020-11-20T11:38:54.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699f66700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6940ad560 0x7fc694064dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36822/0 (socket says 172.21.15.161:36822) 2020-11-20T11:38:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 -- 172.21.15.161:0/1571523025 learned_addr learned my addr 172.21.15.161:0/1571523025 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc69a767700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69413f4b0 0x7fc69413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 -- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69413f4b0 msgr2=0x7fc69413f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69413f4b0 0x7fc69413f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 -- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6940ad560 msgr2=0x7fc694064dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:54.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6940ad560 0x7fc694064dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:54.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.723+0000 7fc699765700 1 -- 172.21.15.161:0/1571523025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69413e650 con 0x7fc69413c3f0 2020-11-20T11:38:54.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc699765700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc68400cab0 tx=0x7fc684001320).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68400ce80 con 0x7fc69413c3f0 2020-11-20T11:38:54.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684005b80 con 0x7fc69413c3f0 2020-11-20T11:38:54.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69414db80 con 0x7fc69413c3f0 2020-11-20T11:38:54.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684007110 con 0x7fc69413c3f0 2020-11-20T11:38:54.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69414e020 con 0x7fc69413c3f0 2020-11-20T11:38:54.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6940676c0 con 0x7fc69413c3f0 2020-11-20T11:38:54.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fc684010030 con 0x7fc69413c3f0 2020-11-20T11:38:54.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 0x7fc66c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:54.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc68406e700 con 0x7fc69413c3f0 2020-11-20T11:38:54.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.727+0000 7fc699f66700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 0x7fc66c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:54.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.731+0000 7fc699f66700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 0x7fc66c057c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc688006fd0 tx=0x7fc688008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:54.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.735+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc684044330 con 0x7fc69413c3f0 2020-11-20T11:38:54.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:54.939+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc694044f60 con 0x7fc69413c3f0 2020-11-20T11:38:55.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc691ffb700 1 -- 172.21.15.161:0/1571523025 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc684047950 con 0x7fc69413c3f0 2020-11-20T11:38:55.648 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 msgr2=0x7fc66c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.648 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 0x7fc66c057c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc688006fd0 tx=0x7fc688008040).stop 2020-11-20T11:38:55.649 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 msgr2=0x7fc694065620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.649 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc68400cab0 tx=0x7fc684001320).stop 2020-11-20T11:38:55.649 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 shutdown_connections 2020-11-20T11:38:55.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc66c0557c0 0x7fc66c057c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc69413f4b0 0x7fc69413f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc6940ad560 0x7fc694064dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 --2- 172.21.15.161:0/1571523025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc69413c3f0 0x7fc694065620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 >> 172.21.15.161:0/1571523025 conn(0x7fc694060b90 msgr2=0x7fc694068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:55.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 shutdown_connections 2020-11-20T11:38:55.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.643+0000 7fc69af68700 1 -- 172.21.15.161:0/1571523025 wait complete. 2020-11-20T11:38:55.666 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:38:55.797 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 Processor -- start 2020-11-20T11:38:55.797 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 -- start start 2020-11-20T11:38:55.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc90005be80 0x7fc9000a9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc9000a4eb0 0x7fc90013b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9000a5670 con 0x7fc9000a7550 2020-11-20T11:38:55.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9000a5910 con 0x7fc90005be80 2020-11-20T11:38:55.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc90498b700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9000a5bb0 con 0x7fc9000a4eb0 2020-11-20T11:38:55.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc90005be80 0x7fc9000a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc90005be80 0x7fc9000a9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36828/0 (socket says 172.21.15.161:36828) 2020-11-20T11:38:55.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 -- 172.21.15.161:0/2863265313 learned_addr learned my addr 172.21.15.161:0/2863265313 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:55.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fe59c700 1 --2- 172.21.15.161:0/2863265313 >> v2:172.21.15.186:3300/0 conn(0x7fc9000a4eb0 0x7fc90013b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 -- 172.21.15.161:0/2863265313 >> v2:172.21.15.186:3300/0 conn(0x7fc9000a4eb0 msgr2=0x7fc90013b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:55.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 --2- 172.21.15.161:0/2863265313 >> v2:172.21.15.186:3300/0 conn(0x7fc9000a4eb0 0x7fc90013b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 -- 172.21.15.161:0/2863265313 >> v1:172.21.15.186:6789/0 conn(0x7fc9000a7550 legacy=0x7fc9001375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 -- 172.21.15.161:0/2863265313 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90005c260 con 0x7fc90005be80 2020-11-20T11:38:55.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fed9d700 1 --2- 172.21.15.161:0/2863265313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90005be80 0x7fc9000a9810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc900064a70 tx=0x7fc8f0009290).ready entity=mon.0 client_cookie=92bc83e9e20141b3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:55.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.795+0000 7fc8fdd9b700 1 -- 172.21.15.161:0/2863265313 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f000bbc0 con 0x7fc90005be80 2020-11-20T11:38:55.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc8fdd9b700 1 -- 172.21.15.161:0/2863265313 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000bd20 con 0x7fc90005be80 2020-11-20T11:38:55.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc8fdd9b700 1 -- 172.21.15.161:0/2863265313 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0011610 con 0x7fc90005be80 2020-11-20T11:38:55.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- 172.21.15.161:0/2863265313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90005be80 msgr2=0x7fc9000a9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 --2- 172.21.15.161:0/2863265313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90005be80 0x7fc9000a9810 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fc900064a70 tx=0x7fc8f0009290).stop 2020-11-20T11:38:55.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- 172.21.15.161:0/2863265313 shutdown_connections 2020-11-20T11:38:55.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 --2- 172.21.15.161:0/2863265313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc90005be80 0x7fc9000a9810 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 --2- 172.21.15.161:0/2863265313 >> v2:172.21.15.186:3300/0 conn(0x7fc9000a4eb0 0x7fc90013b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- 172.21.15.161:0/2863265313 >> 172.21.15.161:0/2863265313 conn(0x7fc9000ad630 msgr2=0x7fc9000ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:55.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- 172.21.15.161:0/2863265313 shutdown_connections 2020-11-20T11:38:55.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- 172.21.15.161:0/2863265313 wait complete. 2020-11-20T11:38:55.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 Processor -- start 2020-11-20T11:38:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.799+0000 7fc90498b700 1 -- start start 2020-11-20T11:38:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc90005be80 0x7fc900134e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 0x7fc9000a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900066fe0 con 0x7fc9000a7550 2020-11-20T11:38:55.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc900138770 con 0x7fc9000a4eb0 2020-11-20T11:38:55.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000a1500 con 0x7fc90005be80 2020-11-20T11:38:55.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8fe59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 0x7fc9000a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8fe59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 0x7fc9000a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42304/0 (socket says 172.21.15.161:42304) 2020-11-20T11:38:55.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8fe59c700 1 -- 172.21.15.161:0/2297786907 learned_addr learned my addr 172.21.15.161:0/2297786907 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:55.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8fed9d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc90005be80 0x7fc900134e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36838/0 (socket says 172.21.15.161:36838) 2020-11-20T11:38:55.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 -- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc90005be80 msgr2=0x7fc900134e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc90005be80 0x7fc900134e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 -- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 msgr2=0x7fc9000a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 0x7fc9000a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 -- 172.21.15.161:0/2297786907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000a17a0 con 0x7fc9000a7550 2020-11-20T11:38:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8ff59e700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc8f800c6e0 tx=0x7fc8f8007b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800e490 con 0x7fc9000a7550 2020-11-20T11:38:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f800e5f0 con 0x7fc9000a7550 2020-11-20T11:38:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800e970 con 0x7fc9000a7550 2020-11-20T11:38:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9000a3dc0 con 0x7fc9000a7550 2020-11-20T11:38:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc900133d40 con 0x7fc9000a7550 2020-11-20T11:38:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9000a1930 con 0x7fc9000a7550 2020-11-20T11:38:55.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.803+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fc8f8010030 con 0x7fc9000a7550 2020-11-20T11:38:55.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.807+0000 7fc8f6ffd700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 0x7fc8dc057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.807+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc8f8001e40 con 0x7fc9000a7550 2020-11-20T11:38:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.807+0000 7fc8fed9d700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 0x7fc8dc057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.807+0000 7fc8fed9d700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 0x7fc8dc057cb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc8f00092d0 tx=0x7fc8f0016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:55.811+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc8f8044250 con 0x7fc9000a7550 2020-11-20T11:38:56.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.011+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc900069250 con 0x7fc9000a7550 2020-11-20T11:38:56.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.011+0000 7fc8f6ffd700 1 -- 172.21.15.161:0/2297786907 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2136 (secure 0 0 0) 0x7fc8f8047870 con 0x7fc9000a7550 2020-11-20T11:38:56.016 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:56.016 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.186:6833/2262024112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2262024112},{"type":"v1","addr":"172.21.15.186:6833","nonce":2262024112}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:38:53.953828+0000","modified":"2020-11-20T11:38:55.630027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4197892368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4197892368},{"type":"v1","addr":"172.21.15.161:6835","nonce":4197892368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:38:56.018 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 msgr2=0x7fc8dc057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.018 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 0x7fc8dc057cb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc8f00092d0 tx=0x7fc8f0016000).stop 2020-11-20T11:38:56.018 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 msgr2=0x7fc9000a2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.018 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fc8f800c6e0 tx=0x7fc8f8007b30).stop 2020-11-20T11:38:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 shutdown_connections 2020-11-20T11:38:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc8dc0557f0 0x7fc8dc057cb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9000a7550 0x7fc9000a2130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc90005be80 0x7fc900134e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.019 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 --2- 172.21.15.161:0/2297786907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc9000a4eb0 0x7fc9000a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.020 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 >> 172.21.15.161:0/2297786907 conn(0x7fc9000ad630 msgr2=0x7fc9000a7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.020 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 shutdown_connections 2020-11-20T11:38:56.020 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.015+0000 7fc90498b700 1 -- 172.21.15.161:0/2297786907 wait complete. 2020-11-20T11:38:56.021 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 6 2020-11-20T11:38:56.031 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:56.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 Processor -- start 2020-11-20T11:38:56.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 -- start start 2020-11-20T11:38:56.159 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 0x7f20c8142a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.159 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80a5da0 con 0x7f20c8060be0 2020-11-20T11:38:56.159 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80a6040 con 0x7f20c80a4c00 2020-11-20T11:38:56.160 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd9d5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80a6820 con 0x7f20c813abd0 2020-11-20T11:38:56.160 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c7fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f20c8060be0 0x7f20c813a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47086/0 (socket says 172.21.15.161:47086) 2020-11-20T11:38:56.160 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c7fff700 1 -- 172.21.15.161:0/490910738 learned_addr learned my addr 172.21.15.161:0/490910738 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:56.160 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd1d4700 1 --2- 172.21.15.161:0/490910738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 0x7f20c8142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.160 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721320422 0 0) 0x7f20c80a5da0 con 0x7f20c8060be0 2020-11-20T11:38:56.161 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ac003240 con 0x7f20c8060be0 2020-11-20T11:38:56.161 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281091919 0 0) 0x7f20c80a6040 con 0x7f20c80a4c00 2020-11-20T11:38:56.161 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c80a5da0 con 0x7f20c80a4c00 2020-11-20T11:38:56.161 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3147201745 0 0) 0x7f20ac003240 con 0x7f20c8060be0 2020-11-20T11:38:56.161 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd1d4700 1 -- 172.21.15.161:0/490910738 >> v1:172.21.15.186:6789/0 conn(0x7f20c80a4c00 legacy=0x7f20c80604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.162 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd1d4700 1 -- 172.21.15.161:0/490910738 >> v1:172.21.15.161:6789/0 conn(0x7f20c8060be0 legacy=0x7f20c813a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.162 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd1d4700 1 -- 172.21.15.161:0/490910738 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80a6ac0 con 0x7f20c813abd0 2020-11-20T11:38:56.162 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20cd1d4700 1 --2- 172.21.15.161:0/490910738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 0x7f20c8142a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f20b000b9d0 tx=0x7f20b0006df0).ready entity=mon.2 client_cookie=f47c5e92505c1ac4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.165 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0014070 con 0x7f20c813abd0 2020-11-20T11:38:56.165 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b000e460 con 0x7f20c813abd0 2020-11-20T11:38:56.165 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.155+0000 7f20c77fe700 1 -- 172.21.15.161:0/490910738 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0001860 con 0x7f20c813abd0 2020-11-20T11:38:56.165 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/490910738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 msgr2=0x7f20c8142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.166 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/490910738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 0x7f20c8142a30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f20b000b9d0 tx=0x7f20b0006df0).stop 2020-11-20T11:38:56.166 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/490910738 shutdown_connections 2020-11-20T11:38:56.166 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/490910738 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c813abd0 0x7f20c8142a30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/490910738 >> 172.21.15.161:0/490910738 conn(0x7f20c80ad620 msgr2=0x7f20c80ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/490910738 shutdown_connections 2020-11-20T11:38:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/490910738 wait complete. 2020-11-20T11:38:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 Processor -- start 2020-11-20T11:38:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- start start 2020-11-20T11:38:56.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c8060be0 0x7f20c8137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c813abd0 0x7f20c8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80670c0 con 0x7f20c80a4c00 2020-11-20T11:38:56.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8067360 con 0x7f20c813abd0 2020-11-20T11:38:56.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c8067600 con 0x7f20c8060be0 2020-11-20T11:38:56.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36850/0 (socket says 172.21.15.161:36850) 2020-11-20T11:38:56.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 -- 172.21.15.161:0/1668631381 learned_addr learned my addr 172.21.15.161:0/1668631381 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:56.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cc9d3700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c8060be0 0x7f20c8137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd1d4700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c813abd0 0x7f20c8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 -- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c8060be0 msgr2=0x7f20c8137840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c8060be0 0x7f20c8137840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 -- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c813abd0 msgr2=0x7f20c8136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c813abd0 0x7f20c8136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 -- 172.21.15.161:0/1668631381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80686c0 con 0x7f20c80a4c00 2020-11-20T11:38:56.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c7fff700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f20c000ce60 tx=0x7f20c0002170).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0005b80 con 0x7f20c80a4c00 2020-11-20T11:38:56.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c8066b40 con 0x7f20c80a4c00 2020-11-20T11:38:56.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0005ce0 con 0x7f20c80a4c00 2020-11-20T11:38:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c8136f00 con 0x7f20c80a4c00 2020-11-20T11:38:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.159+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0005e50 con 0x7f20c80a4c00 2020-11-20T11:38:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c8069250 con 0x7f20c80a4c00 2020-11-20T11:38:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f20c0010030 con 0x7f20c80a4c00 2020-11-20T11:38:56.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20c4ff9700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 0x7f2098057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f20c006e830 con 0x7f20c80a4c00 2020-11-20T11:38:56.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20cc9d3700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 0x7f2098057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.163+0000 7f20cc9d3700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 0x7f2098057c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f20b8003770 tx=0x7f20b8007a10).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.167+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f20c0044510 con 0x7f20c80a4c00 2020-11-20T11:38:56.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20c805c9c0 con 0x7f20c80a4c00 2020-11-20T11:38:56.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20c4ff9700 1 -- 172.21.15.161:0/1668631381 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f20c0047b30 con 0x7f20c80a4c00 2020-11-20T11:38:56.327 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:56.327 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:56.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 msgr2=0x7f2098057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 0x7f2098057c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f20b8003770 tx=0x7f20b8007a10).stop 2020-11-20T11:38:56.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 msgr2=0x7f20c80681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.323+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f20c000ce60 tx=0x7f20c0002170).stop 2020-11-20T11:38:56.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 shutdown_connections 2020-11-20T11:38:56.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f20980557c0 0x7f2098057c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c813abd0 0x7f20c8136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c8060be0 0x7f20c8137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 --2- 172.21.15.161:0/1668631381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20c80a4c00 0x7f20c80681d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 >> 172.21.15.161:0/1668631381 conn(0x7f20c80ad620 msgr2=0x7f20c80a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 shutdown_connections 2020-11-20T11:38:56.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.327+0000 7f20cd9d5700 1 -- 172.21.15.161:0/1668631381 wait complete. 2020-11-20T11:38:56.341 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:56.342 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T11:38:56.458 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 Processor -- start 2020-11-20T11:38:56.459 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 -- start start 2020-11-20T11:38:56.461 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24900af220 0x7f24900aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.461 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2490067ef0 0x7f24900a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.461 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2490067820 con 0x7f24901386e0 2020-11-20T11:38:56.461 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900a6da0 con 0x7f2490067ef0 2020-11-20T11:38:56.462 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f249877b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900a6fc0 con 0x7f24900af220 2020-11-20T11:38:56.462 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f2495d16700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2490067ef0 0x7f24900a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.462 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f2496d18700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f24901386e0 0x7f24900a5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46616/0 (socket says 172.21.15.161:46616) 2020-11-20T11:38:56.462 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f2496d18700 1 -- 172.21.15.161:0/251493901 learned_addr learned my addr 172.21.15.161:0/251493901 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:56.463 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.455+0000 7f2496517700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24900af220 0x7f24900aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.463 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495d16700 1 -- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24900af220 msgr2=0x7f24900aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:56.463 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495d16700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24900af220 0x7f24900aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.463 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495d16700 1 -- 172.21.15.161:0/251493901 >> v1:172.21.15.186:6789/0 conn(0x7f24901386e0 legacy=0x7f24900a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.463 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495d16700 1 -- 172.21.15.161:0/251493901 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490067a50 con 0x7f2490067ef0 2020-11-20T11:38:56.464 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495d16700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2490067ef0 0x7f24900a68b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f248000b9a0 tx=0x7f2480006df0).ready entity=mon.1 client_cookie=a4059f6fca38da2a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.464 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495515700 1 -- 172.21.15.161:0/251493901 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24800097b0 con 0x7f2490067ef0 2020-11-20T11:38:56.464 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495515700 1 -- 172.21.15.161:0/251493901 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2480009910 con 0x7f2490067ef0 2020-11-20T11:38:56.464 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f2495515700 1 -- 172.21.15.161:0/251493901 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2480009c90 con 0x7f2490067ef0 2020-11-20T11:38:56.465 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 -- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2490067ef0 msgr2=0x7f24900a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.466 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2490067ef0 0x7f24900a68b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f248000b9a0 tx=0x7f2480006df0).stop 2020-11-20T11:38:56.466 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 -- 172.21.15.161:0/251493901 shutdown_connections 2020-11-20T11:38:56.466 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24900af220 0x7f24900aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.466 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 --2- 172.21.15.161:0/251493901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2490067ef0 0x7f24900a68b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.466 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 -- 172.21.15.161:0/251493901 >> 172.21.15.161:0/251493901 conn(0x7f2490064cf0 msgr2=0x7f24900650d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.467 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 -- 172.21.15.161:0/251493901 shutdown_connections 2020-11-20T11:38:56.467 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.459+0000 7f249877b700 1 -- 172.21.15.161:0/251493901 wait complete. 2020-11-20T11:38:56.467 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 Processor -- start 2020-11-20T11:38:56.467 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 -- start start 2020-11-20T11:38:56.471 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24900af220 0x7f249013dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24901386e0 0x7f24901477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249013dfb0 con 0x7f2490067ef0 2020-11-20T11:38:56.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249013ceb0 con 0x7f24900af220 2020-11-20T11:38:56.472 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f249877b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249013d150 con 0x7f24901386e0 2020-11-20T11:38:56.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36862/0 (socket says 172.21.15.161:36862) 2020-11-20T11:38:56.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 -- 172.21.15.161:0/4157110653 learned_addr learned my addr 172.21.15.161:0/4157110653 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:56.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2495d16700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24900af220 0x7f249013dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.473 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496d18700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24901386e0 0x7f24901477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.474 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 -- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24901386e0 msgr2=0x7f24901477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.474 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24901386e0 0x7f24901477e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.474 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 -- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24900af220 msgr2=0x7f249013dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.474 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24900af220 0x7f249013dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.475 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 -- 172.21.15.161:0/4157110653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249013d3f0 con 0x7f2490067ef0 2020-11-20T11:38:56.475 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.463+0000 7f2496517700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f248c00eba0 tx=0x7f248c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.475 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00c8e0 con 0x7f2490067ef0 2020-11-20T11:38:56.476 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00ca40 con 0x7f2490067ef0 2020-11-20T11:38:56.476 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249013c9a0 con 0x7f2490067ef0 2020-11-20T11:38:56.476 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00cdc0 con 0x7f2490067ef0 2020-11-20T11:38:56.476 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2490147ef0 con 0x7f2490067ef0 2020-11-20T11:38:56.477 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2490148140 con 0x7f2490067ef0 2020-11-20T11:38:56.477 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f248c012600 con 0x7f2490067ef0 2020-11-20T11:38:56.477 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 0x7f2468057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.477 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f248c06ec30 con 0x7f2490067ef0 2020-11-20T11:38:56.477 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f2495d16700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 0x7f2468057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.478 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.467+0000 7f2495d16700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 0x7f2468057c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f248000b9a0 tx=0x7f2480015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.478 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.475+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f248c044970 con 0x7f2490067ef0 2020-11-20T11:38:56.636 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f249013d580 con 0x7f2490067ef0 2020-11-20T11:38:56.638 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f247e7fc700 1 -- 172.21.15.161:0/4157110653 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f248c047f90 con 0x7f2490067ef0 2020-11-20T11:38:56.639 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:56.640 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:56.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 msgr2=0x7f2468057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 0x7f2468057c80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f248000b9a0 tx=0x7f2480015000).stop 2020-11-20T11:38:56.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 msgr2=0x7f24900a8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f248c00eba0 tx=0x7f248c006df0).stop 2020-11-20T11:38:56.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 shutdown_connections 2020-11-20T11:38:56.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24680557c0 0x7f2468057c80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24901386e0 0x7f24901477e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2490067ef0 0x7f24900a8630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 --2- 172.21.15.161:0/4157110653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24900af220 0x7f249013dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 >> 172.21.15.161:0/4157110653 conn(0x7f2490064cf0 msgr2=0x7f24900aa210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.635+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 shutdown_connections 2020-11-20T11:38:56.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.639+0000 7f249877b700 1 -- 172.21.15.161:0/4157110653 wait complete. 2020-11-20T11:38:56.655 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:38:38.321980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:38:45.546076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:38:49.160214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:38:51.610748+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:38:56.656 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:38:56.779 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.775+0000 7fb8fae7f700 1 Processor -- start 2020-11-20T11:38:56.780 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.775+0000 7fb8fae7f700 1 -- start start 2020-11-20T11:38:56.781 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.775+0000 7fb8fae7f700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb8f40ad560 0x7fb8f40a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.782 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.775+0000 7fb8fae7f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8f40a1440 0x7fb8f413c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.782 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f413bcb0 con 0x7fb8f413c5d0 2020-11-20T11:38:56.782 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40a08f0 con 0x7fb8f40a1440 2020-11-20T11:38:56.782 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f413ca60 con 0x7fb8f40ad560 2020-11-20T11:38:56.782 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8f40a1440 0x7fb8f413c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.783 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8f40a1440 0x7fb8f413c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36870/0 (socket says 172.21.15.161:36870) 2020-11-20T11:38:56.783 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 -- 172.21.15.161:0/1936382653 learned_addr learned my addr 172.21.15.161:0/1936382653 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:56.783 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 --2- 172.21.15.161:0/1936382653 >> v2:172.21.15.186:3300/0 conn(0x7fb8f40ad560 0x7fb8f40a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.783 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 -- 172.21.15.161:0/1936382653 >> v2:172.21.15.186:3300/0 conn(0x7fb8f40ad560 msgr2=0x7fb8f40a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:56.783 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 --2- 172.21.15.161:0/1936382653 >> v2:172.21.15.186:3300/0 conn(0x7fb8f40ad560 0x7fb8f40a6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.784 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 -- 172.21.15.161:0/1936382653 >> v1:172.21.15.186:6789/0 conn(0x7fb8f413c5d0 legacy=0x7fb8f41356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.784 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 -- 172.21.15.161:0/1936382653 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40a6cf0 con 0x7fb8f40a1440 2020-11-20T11:38:56.784 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 --2- 172.21.15.161:0/1936382653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f413c0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb8f4062440 tx=0x7fb8e4006eb0).ready entity=mon.0 client_cookie=16ce1f7d91b2abd2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.784 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f8e7b700 1 -- 172.21.15.161:0/1936382653 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4009810 con 0x7fb8f40a1440 2020-11-20T11:38:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f8e7b700 1 -- 172.21.15.161:0/1936382653 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e4009970 con 0x7fb8f40a1440 2020-11-20T11:38:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f8e7b700 1 -- 172.21.15.161:0/1936382653 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4009cf0 con 0x7fb8f40a1440 2020-11-20T11:38:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- 172.21.15.161:0/1936382653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 msgr2=0x7fb8f413c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.785 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/1936382653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f413c0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb8f4062440 tx=0x7fb8e4006eb0).stop 2020-11-20T11:38:56.786 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- 172.21.15.161:0/1936382653 shutdown_connections 2020-11-20T11:38:56.786 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/1936382653 >> v2:172.21.15.186:3300/0 conn(0x7fb8f40ad560 0x7fb8f40a6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.786 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/1936382653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f413c0e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.786 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- 172.21.15.161:0/1936382653 >> 172.21.15.161:0/1936382653 conn(0x7fb8f4060b90 msgr2=0x7fb8f40accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.786 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- 172.21.15.161:0/1936382653 shutdown_connections 2020-11-20T11:38:56.787 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- 172.21.15.161:0/1936382653 wait complete. 2020-11-20T11:38:56.789 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 Processor -- start 2020-11-20T11:38:56.789 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- start start 2020-11-20T11:38:56.789 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40ad560 0x7fb8f40663a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 0x7fb8f40a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40a3590 con 0x7fb8f40a1440 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4134cd0 con 0x7fb8f413c5d0 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fae7f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4134f70 con 0x7fb8f40ad560 2020-11-20T11:38:56.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36876/0 (socket says 172.21.15.161:36876) 2020-11-20T11:38:56.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 -- 172.21.15.161:0/3939480833 learned_addr learned my addr 172.21.15.161:0/3939480833 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:56.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f967c700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40ad560 0x7fb8f40663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fa67e700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 0x7fb8f40a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 -- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40ad560 msgr2=0x7fb8f40663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40ad560 0x7fb8f40663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 -- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 msgr2=0x7fb8f40a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 0x7fb8f40a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8f9e7d700 1 -- 172.21.15.161:0/3939480833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f41398b0 con 0x7fb8f40a1440 2020-11-20T11:38:56.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.779+0000 7fb8fa67e700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 0x7fb8f40a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:38:56.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8f9e7d700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8f000eba0 tx=0x7fb8f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000ca40 con 0x7fb8f40a1440 2020-11-20T11:38:56.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f000cba0 con 0x7fb8f40a1440 2020-11-20T11:38:56.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f40a2f50 con 0x7fb8f40a1440 2020-11-20T11:38:56.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00123f0 con 0x7fb8f40a1440 2020-11-20T11:38:56.794 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4133810 con 0x7fb8f40a1440 2020-11-20T11:38:56.794 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4135130 con 0x7fb8f40a1440 2020-11-20T11:38:56.794 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fb8f0022070 con 0x7fb8f40a1440 2020-11-20T11:38:56.794 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 0x7fb8cc057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:56.794 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb8f006ec90 con 0x7fb8f40a1440 2020-11-20T11:38:56.795 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8f967c700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 0x7fb8cc057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:56.795 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.783+0000 7fb8f967c700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 0x7fb8cc057c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb8e4006ef0 tx=0x7fb8e4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:56.795 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.791+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb8f00449d0 con 0x7fb8f40a1440 2020-11-20T11:38:56.944 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb8f4044f60 con 0x7fb8f40a1440 2020-11-20T11:38:56.945 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8e1ffb700 1 -- 172.21.15.161:0/3939480833 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb8f0016070 con 0x7fb8f40a1440 2020-11-20T11:38:56.945 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2020-11-20T11:38:56.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 msgr2=0x7fb8cc057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 0x7fb8cc057c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb8e4006ef0 tx=0x7fb8e4015000).stop 2020-11-20T11:38:56.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 msgr2=0x7fb8f40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:56.947 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8f000eba0 tx=0x7fb8f0008040).stop 2020-11-20T11:38:56.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 shutdown_connections 2020-11-20T11:38:56.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb8cc0557c0 0x7fb8cc057c80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.948 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb8f413c5d0 0x7fb8f40a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8f40a1440 0x7fb8f40a2a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 --2- 172.21.15.161:0/3939480833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb8f40ad560 0x7fb8f40663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:56.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 >> 172.21.15.161:0/3939480833 conn(0x7fb8f4060b90 msgr2=0x7fb8f40a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:56.949 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 shutdown_connections 2020-11-20T11:38:56.950 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:56.943+0000 7fb8fae7f700 1 -- 172.21.15.161:0/3939480833 wait complete. 2020-11-20T11:38:56.959 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:38:57.090 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.087+0000 7f7d5d22b700 1 Processor -- start 2020-11-20T11:38:57.091 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.087+0000 7f7d5d22b700 1 -- start start 2020-11-20T11:38:57.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5813e710 0x7f7d58137b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5813de60 con 0x7f7d580adf30 2020-11-20T11:38:57.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d580a87a0 con 0x7f7d5813e290 2020-11-20T11:38:57.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d57fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7d580adf30 0x7f7d58060200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47126/0 (socket says 172.21.15.161:47126) 2020-11-20T11:38:57.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58060910 con 0x7f7d5813e710 2020-11-20T11:38:57.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d57fff700 1 -- 172.21.15.161:0/1618857391 learned_addr learned my addr 172.21.15.161:0/1618857391 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:57.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626839360 0 0) 0x7f7d5813de60 con 0x7f7d580adf30 2020-11-20T11:38:57.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d38003240 con 0x7f7d580adf30 2020-11-20T11:38:57.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423835359 0 0) 0x7f7d580a87a0 con 0x7f7d5813e290 2020-11-20T11:38:57.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5813de60 con 0x7f7d5813e290 2020-11-20T11:38:57.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2267434966 0 0) 0x7f7d38003240 con 0x7f7d580adf30 2020-11-20T11:38:57.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5813e710 msgr2=0x7f7d58137b80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-11-20T11:38:57.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d5813e710 0x7f7d58137b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T11:38:57.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 >> v1:172.21.15.186:6789/0 conn(0x7f7d5813e290 legacy=0x7f7d58137470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58060b10 con 0x7f7d580adf30 2020-11-20T11:38:57.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f7d480014e0 con 0x7f7d580adf30 2020-11-20T11:38:57.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 >> v1:172.21.15.161:6789/0 conn(0x7f7d580adf30 legacy=0x7f7d58060200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d380038f0 0x7f7d38003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d380044e0 0x7f7d38004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d38004e50 0x7f7d3800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d58060910 con 0x7f7d380044e0 2020-11-20T11:38:57.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3800bc20 con 0x7f7d380038f0 2020-11-20T11:38:57.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3800bd60 con 0x7f7d38004e50 2020-11-20T11:38:57.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d380044e0 0x7f7d38004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d57fff700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d380038f0 0x7f7d38003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 -- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d38004e50 msgr2=0x7f7d3800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5ca2a700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d38004e50 0x7f7d3800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d38004e50 0x7f7d3800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 -- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d380038f0 msgr2=0x7f7d38003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d380038f0 0x7f7d38003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 -- 172.21.15.161:0/1618857391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38003240 con 0x7f7d380044e0 2020-11-20T11:38:57.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d57fff700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d380038f0 0x7f7d38003cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:57.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5ca2a700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d38004e50 0x7f7d3800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:38:57.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d577fe700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d380044e0 0x7f7d38004960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7d40001b00 tx=0x7f7d40007b50).ready entity=mon.0 client_cookie=a4bdfb2ed6761d1d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000c8b0 con 0x7f7d380044e0 2020-11-20T11:38:57.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000ca10 con 0x7f7d380044e0 2020-11-20T11:38:57.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d56ffd700 1 -- 172.21.15.161:0/1618857391 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000cdb0 con 0x7f7d380044e0 2020-11-20T11:38:57.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- 172.21.15.161:0/1618857391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d380044e0 msgr2=0x7f7d38004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/1618857391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d380044e0 0x7f7d38004960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f7d40001b00 tx=0x7f7d40007b50).stop 2020-11-20T11:38:57.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5ca2a700 1 -- 172.21.15.161:0/1618857391 reap_dead start 2020-11-20T11:38:57.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- 172.21.15.161:0/1618857391 shutdown_connections 2020-11-20T11:38:57.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- 172.21.15.161:0/1618857391 >> 172.21.15.161:0/1618857391 conn(0x7f7d580626c0 msgr2=0x7f7d58062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- 172.21.15.161:0/1618857391 shutdown_connections 2020-11-20T11:38:57.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.091+0000 7f7d5d22b700 1 -- 172.21.15.161:0/1618857391 wait complete. 2020-11-20T11:38:57.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 Processor -- start 2020-11-20T11:38:57.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- start start 2020-11-20T11:38:57.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d580a5310 0x7f7d581499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d581406c0 0x7f7d5813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5814a990 con 0x7f7d58066d60 2020-11-20T11:38:57.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d580a8510 con 0x7f7d580a5310 2020-11-20T11:38:57.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5813fce0 con 0x7f7d581406c0 2020-11-20T11:38:57.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36898/0 (socket says 172.21.15.161:36898) 2020-11-20T11:38:57.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 -- 172.21.15.161:0/2658522909 learned_addr learned my addr 172.21.15.161:0/2658522909 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:57.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d577fe700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d581406c0 0x7f7d5813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d57fff700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d580a5310 0x7f7d581499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 -- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d581406c0 msgr2=0x7f7d5813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d581406c0 0x7f7d5813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 -- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d580a5310 msgr2=0x7f7d581499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d580a5310 0x7f7d581499e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 -- 172.21.15.161:0/2658522909 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5813ff80 con 0x7f7d58066d60 2020-11-20T11:38:57.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5ca2a700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7d580aa6b0 tx=0x7f7d50008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000e500 con 0x7f7d58066d60 2020-11-20T11:38:57.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5000e660 con 0x7f7d58066d60 2020-11-20T11:38:57.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d58140220 con 0x7f7d58066d60 2020-11-20T11:38:57.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000ea00 con 0x7f7d58066d60 2020-11-20T11:38:57.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.095+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d58063340 con 0x7f7d58066d60 2020-11-20T11:38:57.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d581403b0 con 0x7f7d58066d60 2020-11-20T11:38:57.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7d50019030 con 0x7f7d58066d60 2020-11-20T11:38:57.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d4ffff700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 0x7f7d34057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7d5006e2b0 con 0x7f7d58066d60 2020-11-20T11:38:57.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d57fff700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 0x7f7d34057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.099+0000 7f7d57fff700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 0x7f7d34057cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7d48007950 tx=0x7f7d580a9940).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.107+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7d50043ee0 con 0x7f7d58066d60 2020-11-20T11:38:57.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.259+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d58044f60 con 0x7f7d58066d60 2020-11-20T11:38:57.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.259+0000 7f7d4ffff700 1 -- 172.21.15.161:0/2658522909 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d50047500 con 0x7f7d58066d60 2020-11-20T11:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:38:57.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 msgr2=0x7f7d34057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 0x7f7d34057cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7d48007950 tx=0x7f7d580a9940).stop 2020-11-20T11:38:57.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 msgr2=0x7f7d580671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f7d580aa6b0 tx=0x7f7d50008040).stop 2020-11-20T11:38:57.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 shutdown_connections 2020-11-20T11:38:57.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7d340557f0 0x7f7d34057cb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d58066d60 0x7f7d580671a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d580a5310 0x7f7d581499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 --2- 172.21.15.161:0/2658522909 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7d581406c0 0x7f7d5813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 >> 172.21.15.161:0/2658522909 conn(0x7f7d580626c0 msgr2=0x7f7d58068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 shutdown_connections 2020-11-20T11:38:57.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.263+0000 7f7d5d22b700 1 -- 172.21.15.161:0/2658522909 wait complete. 2020-11-20T11:38:57.279 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:38:57.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 Processor -- start 2020-11-20T11:38:57.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- start start 2020-11-20T11:38:57.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a540a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6a54138e00 0x7f6a540a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a54063aa0 con 0x7f6a541389a0 2020-11-20T11:38:57.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540aa960 con 0x7f6a54138e00 2020-11-20T11:38:57.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54063d40 con 0x7f6a540af7e0 2020-11-20T11:38:57.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a4bfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6a541389a0 0x7f6a540a4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47148/0 (socket says 172.21.15.161:47148) 2020-11-20T11:38:57.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a4bfff700 1 -- 172.21.15.161:0/3829871300 learned_addr learned my addr 172.21.15.161:0/3829871300 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:57.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a540a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a589e0700 1 --2- 172.21.15.161:0/3829871300 >> v2:172.21.15.186:3300/0 conn(0x7f6a54138e00 0x7f6a540a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459005223 0 0) 0x7f6a54063aa0 con 0x7f6a541389a0 2020-11-20T11:38:57.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a34003240 con 0x7f6a541389a0 2020-11-20T11:38:57.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 28932103 0 0) 0x7f6a34003240 con 0x7f6a541389a0 2020-11-20T11:38:57.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 msgr2=0x7f6a540a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a540a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 >> v2:172.21.15.186:3300/0 conn(0x7f6a54138e00 msgr2=0x7f6a540a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 --2- 172.21.15.161:0/3829871300 >> v2:172.21.15.186:3300/0 conn(0x7f6a54138e00 0x7f6a540a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54063fe0 con 0x7f6a541389a0 2020-11-20T11:38:57.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f6a3c0014e0 con 0x7f6a541389a0 2020-11-20T11:38:57.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a540a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:57.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 >> v1:172.21.15.161:6789/0 conn(0x7f6a541389a0 legacy=0x7f6a540a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a34003730 0x7f6a34003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a340044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a340049d0 0x7f6a34004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540aa960 con 0x7f6a34003730 2020-11-20T11:38:57.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54063d40 con 0x7f6a340049d0 2020-11-20T11:38:57.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a34004190 con 0x7f6a540af7e0 2020-11-20T11:38:57.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a34003730 0x7f6a34003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a589e0700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a340049d0 0x7f6a34004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a4bfff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a340044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 -- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 msgr2=0x7f6a340044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540af7e0 0x7f6a340044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 -- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a340049d0 msgr2=0x7f6a34004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a340049d0 0x7f6a34004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 -- 172.21.15.161:0/3829871300 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34003240 con 0x7f6a34003730 2020-11-20T11:38:57.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a53fff700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a34003730 0x7f6a34003b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6a4400be80 tx=0x7f6a44006df0).ready entity=mon.0 client_cookie=63fc77e21854fc22 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400b590 con 0x7f6a34003730 2020-11-20T11:38:57.433 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400ecf0 con 0x7f6a34003730 2020-11-20T11:38:57.433 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a537fe700 1 -- 172.21.15.161:0/3829871300 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44012600 con 0x7f6a34003730 2020-11-20T11:38:57.434 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- 172.21.15.161:0/3829871300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a34003730 msgr2=0x7f6a34003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.434 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 --2- 172.21.15.161:0/3829871300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a34003730 0x7f6a34003b50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6a4400be80 tx=0x7f6a44006df0).stop 2020-11-20T11:38:57.434 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a589e0700 1 -- 172.21.15.161:0/3829871300 reap_dead start 2020-11-20T11:38:57.434 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- 172.21.15.161:0/3829871300 shutdown_connections 2020-11-20T11:38:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- 172.21.15.161:0/3829871300 >> 172.21.15.161:0/3829871300 conn(0x7f6a54060c20 msgr2=0x7f6a540aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- 172.21.15.161:0/3829871300 shutdown_connections 2020-11-20T11:38:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.403+0000 7f6a591e1700 1 -- 172.21.15.161:0/3829871300 wait complete. 2020-11-20T11:38:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 Processor -- start 2020-11-20T11:38:57.435 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- start start 2020-11-20T11:38:57.436 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.436 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54126940 0x7f6a54125c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.436 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 0x7f6a540a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.436 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5405c2e0 con 0x7f6a54126560 2020-11-20T11:38:57.436 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540a9640 con 0x7f6a54126940 2020-11-20T11:38:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54125770 con 0x7f6a540a6500 2020-11-20T11:38:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36916/0 (socket says 172.21.15.161:36916) 2020-11-20T11:38:57.437 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 -- 172.21.15.161:0/1148360210 learned_addr learned my addr 172.21.15.161:0/1148360210 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a589e0700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 0x7f6a540a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a4bfff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54126940 0x7f6a54125c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 -- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 msgr2=0x7f6a540a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 0x7f6a540a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.438 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 -- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54126940 msgr2=0x7f6a54125c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54126940 0x7f6a54125c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 -- 172.21.15.161:0/1148360210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540a79e0 con 0x7f6a54126560 2020-11-20T11:38:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a589e0700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 0x7f6a540a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a53fff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6a34005400 tx=0x7f6a44019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44012600 con 0x7f6a54126560 2020-11-20T11:38:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4401b3f0 con 0x7f6a54126560 2020-11-20T11:38:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a540a8da0 con 0x7f6a54126560 2020-11-20T11:38:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4401b7b0 con 0x7f6a54126560 2020-11-20T11:38:57.440 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.407+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a540a6e50 con 0x7f6a54126560 2020-11-20T11:38:57.441 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540a8380 con 0x7f6a54126560 2020-11-20T11:38:57.441 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6a4402c070 con 0x7f6a54126560 2020-11-20T11:38:57.441 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a50ff9700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 0x7f6a30057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.441 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6a44070150 con 0x7f6a54126560 2020-11-20T11:38:57.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a4bfff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 0x7f6a30057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.411+0000 7f6a4bfff700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 0x7f6a30057c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6a3c001610 tx=0x7f6a3c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.415+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6a44045d80 con 0x7f6a54126560 2020-11-20T11:38:57.554 INFO:tasks.ceph.mds.a.smithi161.stderr:2020-11-20T11:38:57.551+0000 7f8751e3d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T11:38:57.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a54044f60 con 0x7f6a54126560 2020-11-20T11:38:57.573 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a50ff9700 1 -- 172.21.15.161:0/1148360210 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6a440493a0 con 0x7f6a54126560 2020-11-20T11:38:57.573 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:38:57.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 msgr2=0x7f6a30057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 0x7f6a30057c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f6a3c001610 tx=0x7f6a3c009040).stop 2020-11-20T11:38:57.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 msgr2=0x7f6a5413cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6a34005400 tx=0x7f6a44019000).stop 2020-11-20T11:38:57.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 shutdown_connections 2020-11-20T11:38:57.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6a300557c0 0x7f6a30057c80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a540a6500 0x7f6a540a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a54126560 0x7f6a5413cf70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 --2- 172.21.15.161:0/1148360210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a54126940 0x7f6a54125c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 >> 172.21.15.161:0/1148360210 conn(0x7f6a54060c20 msgr2=0x7f6a5413ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 shutdown_connections 2020-11-20T11:38:57.577 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.571+0000 7f6a591e1700 1 -- 172.21.15.161:0/1148360210 wait complete. 2020-11-20T11:38:57.588 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:38:57.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.711+0000 7ff6b0891700 1 Processor -- start 2020-11-20T11:38:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.711+0000 7ff6b0891700 1 -- start start 2020-11-20T11:38:57.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff6ac061300 0x7ff6ac0a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 0x7ff6ac13a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0aabf0 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0a7280 con 0x7ff6ac061300 2020-11-20T11:38:57.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0a9600 con 0x7ff6ac13a480 2020-11-20T11:38:57.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36926/0 (socket says 172.21.15.161:36926) 2020-11-20T11:38:57.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 -- 172.21.15.161:0/3602680025 learned_addr learned my addr 172.21.15.161:0/3602680025 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:57.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6ab59e700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 0x7ff6ac13a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6aad9d700 1 --2- 172.21.15.161:0/3602680025 >> v2:172.21.15.186:3300/0 conn(0x7ff6ac061300 0x7ff6ac0a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 -- 172.21.15.161:0/3602680025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 msgr2=0x7ff6ac13a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 0x7ff6ac13a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 -- 172.21.15.161:0/3602680025 >> v2:172.21.15.186:3300/0 conn(0x7ff6ac061300 msgr2=0x7ff6ac0a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:57.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/3602680025 >> v2:172.21.15.186:3300/0 conn(0x7ff6ac061300 0x7ff6ac0a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 -- 172.21.15.161:0/3602680025 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0a98a0 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6ab59e700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 0x7ff6ac13a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:38:57.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff6ac064510 tx=0x7ff694006eb0).ready entity=mon.0 client_cookie=232e15e2c088314 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6aa59c700 1 -- 172.21.15.161:0/3602680025 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694009720 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6aa59c700 1 -- 172.21.15.161:0/3602680025 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff694009880 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6aa59c700 1 -- 172.21.15.161:0/3602680025 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694009c00 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- 172.21.15.161:0/3602680025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac0a68e0 msgr2=0x7ff6ac0a6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff6ac064510 tx=0x7ff694006eb0).stop 2020-11-20T11:38:57.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- 172.21.15.161:0/3602680025 shutdown_connections 2020-11-20T11:38:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac13a480 0x7ff6ac13a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- 172.21.15.161:0/3602680025 >> v2:172.21.15.186:3300/0 conn(0x7ff6ac061300 0x7ff6ac0a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 --2- 172.21.15.161:0/3602680025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a6d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- 172.21.15.161:0/3602680025 >> 172.21.15.161:0/3602680025 conn(0x7ff6ac0adf90 msgr2=0x7ff6ac0a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- 172.21.15.161:0/3602680025 shutdown_connections 2020-11-20T11:38:57.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.715+0000 7ff6b0891700 1 -- 172.21.15.161:0/3602680025 wait complete. 2020-11-20T11:38:57.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 Processor -- start 2020-11-20T11:38:57.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 -- start start 2020-11-20T11:38:57.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac13a480 0x7ff6ac0a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0a4300 con 0x7ff6ac061300 2020-11-20T11:38:57.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0a1fa0 con 0x7ff6ac13a480 2020-11-20T11:38:57.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6b0891700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac0a3dc0 con 0x7ff6ac0a68e0 2020-11-20T11:38:57.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6aad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6aad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36930/0 (socket says 172.21.15.161:36930) 2020-11-20T11:38:57.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6aad9d700 1 -- 172.21.15.161:0/1694191510 learned_addr learned my addr 172.21.15.161:0/1694191510 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:57.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.719+0000 7ff6ab59e700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac13a480 0x7ff6ac0a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 -- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac0a68e0 msgr2=0x7ff6ac0a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 -- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac13a480 msgr2=0x7ff6ac0a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac13a480 0x7ff6ac0a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 -- 172.21.15.161:0/1694191510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0a4060 con 0x7ff6ac061300 2020-11-20T11:38:57.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6aad9d700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff69c00ebd0 tx=0x7ff69c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00c8f0 con 0x7ff6ac061300 2020-11-20T11:38:57.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00ca50 con 0x7ff6ac061300 2020-11-20T11:38:57.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac13e110 con 0x7ff6ac061300 2020-11-20T11:38:57.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00cdd0 con 0x7ff6ac061300 2020-11-20T11:38:57.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac066de0 con 0x7ff6ac061300 2020-11-20T11:38:57.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac067090 con 0x7ff6ac061300 2020-11-20T11:38:57.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7ff69c012600 con 0x7ff6ac061300 2020-11-20T11:38:57.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 0x7ff688057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:57.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff69c06eb70 con 0x7ff6ac061300 2020-11-20T11:38:57.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.723+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 0x7ff688057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:57.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.727+0000 7ff6a3fff700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 0x7ff688057c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff694006ef0 tx=0x7ff694015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:57.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.731+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff69c044850 con 0x7ff6ac061300 2020-11-20T11:38:57.884 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6ac0a3bb0 con 0x7ff6ac061300 2020-11-20T11:38:57.885 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6a2ffd700 1 -- 172.21.15.161:0/1694191510 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff69c047e70 con 0x7ff6ac061300 2020-11-20T11:38:57.885 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:38:57.887 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 msgr2=0x7ff688057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.887 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 0x7ff688057c80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff694006ef0 tx=0x7ff694015000).stop 2020-11-20T11:38:57.887 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 msgr2=0x7ff6ac05be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:57.888 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7ff69c00ebd0 tx=0x7ff69c006df0).stop 2020-11-20T11:38:57.888 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 shutdown_connections 2020-11-20T11:38:57.888 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff6880557c0 0x7ff688057c80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.888 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6ac13a480 0x7ff6ac0a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.889 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6ac061300 0x7ff6ac05be80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.889 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 --2- 172.21.15.161:0/1694191510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6ac0a68e0 0x7ff6ac0a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:57.889 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 >> 172.21.15.161:0/1694191510 conn(0x7ff6ac0adf90 msgr2=0x7ff6ac0609f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:57.889 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 shutdown_connections 2020-11-20T11:38:57.889 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:57.883+0000 7ff6b0891700 1 -- 172.21.15.161:0/1694191510 wait complete. 2020-11-20T11:38:57.899 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T11:38:57.900 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T11:38:57.900 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T11:38:58.026 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 Processor -- start 2020-11-20T11:38:58.026 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 -- start start 2020-11-20T11:38:58.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0a58e0 0x7feeac0a6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feeac0a5d60 0x7feeac0a6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0a8bc0 con 0x7feeac0ad620 2020-11-20T11:38:58.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac060860 con 0x7feeac0a5d60 2020-11-20T11:38:58.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb30b6700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac061050 con 0x7feeac0a58e0 2020-11-20T11:38:58.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feeac0a5d60 0x7feeac0a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feeac0a5d60 0x7feeac0a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36942/0 (socket says 172.21.15.161:36942) 2020-11-20T11:38:58.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 -- 172.21.15.161:0/2400874214 learned_addr learned my addr 172.21.15.161:0/2400874214 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:58.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb18b3700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0a58e0 0x7feeac0a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 -- 172.21.15.161:0/2400874214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0a58e0 msgr2=0x7feeac0a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:58.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0a58e0 0x7feeac0a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 -- 172.21.15.161:0/2400874214 >> v1:172.21.15.186:6789/0 conn(0x7feeac0ad620 legacy=0x7feeac060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 -- 172.21.15.161:0/2400874214 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0a8df0 con 0x7feeac0a5d60 2020-11-20T11:38:58.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb28b5700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac0a6810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7feea4009d50 tx=0x7feea4009290).ready entity=mon.0 client_cookie=92d22a6afc776613 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb10b2700 1 -- 172.21.15.161:0/2400874214 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400bc80 con 0x7feeac0a5d60 2020-11-20T11:38:58.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb10b2700 1 -- 172.21.15.161:0/2400874214 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400bde0 con 0x7feeac0a5d60 2020-11-20T11:38:58.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.023+0000 7feeb10b2700 1 -- 172.21.15.161:0/2400874214 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4011610 con 0x7feeac0a5d60 2020-11-20T11:38:58.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/2400874214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 msgr2=0x7feeac0a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac0a6810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7feea4009d50 tx=0x7feea4009290).stop 2020-11-20T11:38:58.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/2400874214 shutdown_connections 2020-11-20T11:38:58.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac0a6810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- 172.21.15.161:0/2400874214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0a58e0 0x7feeac0a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/2400874214 >> 172.21.15.161:0/2400874214 conn(0x7feeac0621d0 msgr2=0x7feeac0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/2400874214 shutdown_connections 2020-11-20T11:38:58.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/2400874214 wait complete. 2020-11-20T11:38:58.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 Processor -- start 2020-11-20T11:38:58.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- start start 2020-11-20T11:38:58.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeac0a58e0 0x7feeac116c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0ad620 0x7feeac115880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1174d0 con 0x7feeac0a5d60 2020-11-20T11:38:58.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac14e870 con 0x7feeac0a58e0 2020-11-20T11:38:58.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac14eb10 con 0x7feeac0ad620 2020-11-20T11:38:58.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36948/0 (socket says 172.21.15.161:36948) 2020-11-20T11:38:58.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 -- 172.21.15.161:0/4191787773 learned_addr learned my addr 172.21.15.161:0/4191787773 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:58.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb28b5700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0ad620 0x7feeac115880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb20b4700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeac0a58e0 0x7feeac116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 -- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0ad620 msgr2=0x7feeac115880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0ad620 0x7feeac115880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 -- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeac0a58e0 msgr2=0x7feeac116c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeac0a58e0 0x7feeac116c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 -- 172.21.15.161:0/4191787773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac14edb0 con 0x7feeac0a5d60 2020-11-20T11:38:58.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb18b3700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7feea800d840 tx=0x7feea8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80125f0 con 0x7feeac0a5d60 2020-11-20T11:38:58.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8012750 con 0x7feeac0a5d60 2020-11-20T11:38:58.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac14e4c0 con 0x7feeac0a5d60 2020-11-20T11:38:58.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8012af0 con 0x7feeac0a5d60 2020-11-20T11:38:58.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.027+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac114cd0 con 0x7feeac0a5d60 2020-11-20T11:38:58.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac1156f0 con 0x7feeac0a5d60 2020-11-20T11:38:58.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7feea8013480 con 0x7feeac0a5d60 2020-11-20T11:38:58.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7fee9e7fc700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 0x7fee84057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7feea806e9c0 con 0x7feeac0a5d60 2020-11-20T11:38:58.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7feeb20b4700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 0x7fee84057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.031+0000 7feeb20b4700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 0x7fee84057c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feea00035f0 tx=0x7feea0007b90).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.035+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7feea80446a0 con 0x7feeac0a5d60 2020-11-20T11:38:58.224 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.223+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7feeac14e6b0 con 0x7feeac0a5d60 2020-11-20T11:38:58.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.227+0000 7fee9e7fc700 1 -- 172.21.15.161:0/4191787773 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+133247 (secure 0 0 0) 0x7feea8012e60 con 0x7feeac0a5d60 2020-11-20T11:38:58.234 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:58.235 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 msgr2=0x7fee84057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.236 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 0x7fee84057c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7feea00035f0 tx=0x7feea0007b90).stop 2020-11-20T11:38:58.236 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 msgr2=0x7feeac14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.236 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7feea800d840 tx=0x7feea8008040).stop 2020-11-20T11:38:58.236 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 shutdown_connections 2020-11-20T11:38:58.237 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fee840557c0 0x7fee84057c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.237 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feeac0ad620 0x7feeac115880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.237 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feeac0a58e0 0x7feeac116c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.238 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 --2- 172.21.15.161:0/4191787773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feeac0a5d60 0x7feeac14dfd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.238 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 >> 172.21.15.161:0/4191787773 conn(0x7feeac0621d0 msgr2=0x7feeac0a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.238 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 shutdown_connections 2020-11-20T11:38:58.239 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.231+0000 7feeb30b6700 1 -- 172.21.15.161:0/4191787773 wait complete. 2020-11-20T11:38:58.249 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":14582},{"type":"v1","addr":"172.21.15.161:6833","nonce":14582}]},"active_addr":"172.21.15.161:6833/14582","active_change":"2020-11-20T11:38:38.261922+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3589109590}]},{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":408377633}]},{"addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":303816470}]}]}} 2020-11-20T11:38:58.253 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T11:38:58.253 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T11:38:58.254 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:58.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 Processor -- start 2020-11-20T11:38:58.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 -- start start 2020-11-20T11:38:58.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f7809d790 0x7f7f78060c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7809ddc0 con 0x7f7f7813b420 2020-11-20T11:38:58.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7809e060 con 0x7f7f780ae0a0 2020-11-20T11:38:58.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f805dd700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f780a8c60 con 0x7f7f7809d790 2020-11-20T11:38:58.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f7db78700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7f7813b420 0x7f7f78137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47196/0 (socket says 172.21.15.161:47196) 2020-11-20T11:38:58.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f7db78700 1 -- 172.21.15.161:0/1088487157 learned_addr learned my addr 172.21.15.161:0/1088487157 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:58.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.371+0000 7f7f7eb7a700 1 --2- 172.21.15.161:0/1088487157 >> v2:172.21.15.186:3300/0 conn(0x7f7f7809d790 0x7f7f78060c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966929971 0 0) 0x7f7f7809e060 con 0x7f7f780ae0a0 2020-11-20T11:38:58.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f60003240 con 0x7f7f780ae0a0 2020-11-20T11:38:58.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438629966 0 0) 0x7f7f7809ddc0 con 0x7f7f7813b420 2020-11-20T11:38:58.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f7809e060 con 0x7f7f7813b420 2020-11-20T11:38:58.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7eb7a700 1 -- 172.21.15.161:0/1088487157 >> v1:172.21.15.186:6789/0 conn(0x7f7f780ae0a0 legacy=0x7f7f7813ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7eb7a700 1 -- 172.21.15.161:0/1088487157 >> v1:172.21.15.161:6789/0 conn(0x7f7f7813b420 legacy=0x7f7f78137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7eb7a700 1 -- 172.21.15.161:0/1088487157 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7809e300 con 0x7f7f7809d790 2020-11-20T11:38:58.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7eb7a700 1 --2- 172.21.15.161:0/1088487157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7809d790 0x7f7f78060c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7f70009cc0 tx=0x7f7f700091d0).ready entity=mon.1 client_cookie=a843ba134bcebfa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.385 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000b9e0 con 0x7f7f7809d790 2020-11-20T11:38:58.386 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000bb40 con 0x7f7f7809d790 2020-11-20T11:38:58.386 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f7d377700 1 -- 172.21.15.161:0/1088487157 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70011400 con 0x7f7f7809d790 2020-11-20T11:38:58.387 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- 172.21.15.161:0/1088487157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7809d790 msgr2=0x7f7f78060c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.387 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 --2- 172.21.15.161:0/1088487157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7809d790 0x7f7f78060c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7f70009cc0 tx=0x7f7f700091d0).stop 2020-11-20T11:38:58.387 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- 172.21.15.161:0/1088487157 shutdown_connections 2020-11-20T11:38:58.387 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 --2- 172.21.15.161:0/1088487157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7809d790 0x7f7f78060c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.388 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- 172.21.15.161:0/1088487157 >> 172.21.15.161:0/1088487157 conn(0x7f7f78062b10 msgr2=0x7f7f78062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.388 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- 172.21.15.161:0/1088487157 shutdown_connections 2020-11-20T11:38:58.388 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- 172.21.15.161:0/1088487157 wait complete. 2020-11-20T11:38:58.388 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 Processor -- start 2020-11-20T11:38:58.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.375+0000 7f7f805dd700 1 -- start start 2020-11-20T11:38:58.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f780ae0a0 0x7f7f7814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7813b420 0x7f7f780a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780a3760 con 0x7f7f7809d790 2020-11-20T11:38:58.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78149ac0 con 0x7f7f7813b420 2020-11-20T11:38:58.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f78149d60 con 0x7f7f780ae0a0 2020-11-20T11:38:58.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7db78700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f780ae0a0 0x7f7f7814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36958/0 (socket says 172.21.15.161:36958) 2020-11-20T11:38:58.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 -- 172.21.15.161:0/841096782 learned_addr learned my addr 172.21.15.161:0/841096782 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:58.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7eb7a700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7813b420 0x7f7f780a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 -- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f780ae0a0 msgr2=0x7f7f7814a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f780ae0a0 0x7f7f7814a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 -- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7813b420 msgr2=0x7f7f780a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7813b420 0x7f7f780a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 -- 172.21.15.161:0/841096782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7814a000 con 0x7f7f7809d790 2020-11-20T11:38:58.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f7e379700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7f7400c6d0 tx=0x7f7f74007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400e490 con 0x7f7f7809d790 2020-11-20T11:38:58.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400e5f0 con 0x7f7f7809d790 2020-11-20T11:38:58.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7813da00 con 0x7f7f7809d790 2020-11-20T11:38:58.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400e990 con 0x7f7f7809d790 2020-11-20T11:38:58.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7813ec20 con 0x7f7f7809d790 2020-11-20T11:38:58.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7814a190 con 0x7f7f7809d790 2020-11-20T11:38:58.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.379+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7f74019030 con 0x7f7f7809d790 2020-11-20T11:38:58.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.383+0000 7f7f667fc700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 0x7f7f50057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.383+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7f7406dbc0 con 0x7f7f7809d790 2020-11-20T11:38:58.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.383+0000 7f7f7db78700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 0x7f7f50057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.383+0000 7f7f7db78700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 0x7f7f50057c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7f780a50b0 tx=0x7f7f68009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.387+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7f740439b0 con 0x7f7f7809d790 2020-11-20T11:38:58.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.543+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f78069250 con 0x7f7f7809d790 2020-11-20T11:38:58.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.543+0000 7f7f667fc700 1 -- 172.21.15.161:0/841096782 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f7f74025300 con 0x7f7f7809d790 2020-11-20T11:38:58.548 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:58.549 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:58.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 msgr2=0x7f7f50057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 0x7f7f50057c80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f7f780a50b0 tx=0x7f7f68009040).stop 2020-11-20T11:38:58.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 msgr2=0x7f7f780a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f7f7400c6d0 tx=0x7f7f74007b00).stop 2020-11-20T11:38:58.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 shutdown_connections 2020-11-20T11:38:58.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f500557c0 0x7f7f50057c80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f7813b420 0x7f7f780a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f7809d790 0x7f7f780a1d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 --2- 172.21.15.161:0/841096782 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f780ae0a0 0x7f7f7814a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 >> 172.21.15.161:0/841096782 conn(0x7f7f78062b10 msgr2=0x7f7f78136280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 shutdown_connections 2020-11-20T11:38:58.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.547+0000 7f7f805dd700 1 -- 172.21.15.161:0/841096782 wait complete. 2020-11-20T11:38:58.563 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T11:38:58.563 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:38:58.681 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 Processor -- start 2020-11-20T11:38:58.682 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 -- start start 2020-11-20T11:38:58.683 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3af00ad620 0x7f3af00a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.683 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00a7f40 0x7f3af0060860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.684 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af00a17b0 con 0x7f3af00a7a90 2020-11-20T11:38:58.684 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00a1a50 con 0x7f3af00ad620 2020-11-20T11:38:58.684 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3af4d57700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00a83d0 con 0x7f3af00a7f40 2020-11-20T11:38:58.684 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aeeffd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3af00a7a90 0x7f3af0060150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47208/0 (socket says 172.21.15.161:47208) 2020-11-20T11:38:58.685 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aeeffd700 1 -- 172.21.15.161:0/3148288609 learned_addr learned my addr 172.21.15.161:0/3148288609 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:58.685 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/3148288609 >> v2:172.21.15.186:3300/0 conn(0x7f3af00ad620 0x7f3af00a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.685 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aeffff700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00a7f40 0x7f3af0060860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.685 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078184155 0 0) 0x7f3af00a17b0 con 0x7f3af00a7a90 2020-11-20T11:38:58.686 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3adc003240 con 0x7f3af00a7a90 2020-11-20T11:38:58.686 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 -- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00a7f40 msgr2=0x7f3af0060860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:58.686 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00a7f40 0x7f3af0060860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.686 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2458599245 0 0) 0x7f3adc003240 con 0x7f3af00a7a90 2020-11-20T11:38:58.687 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 -- 172.21.15.161:0/3148288609 >> v1:172.21.15.161:6789/0 conn(0x7f3af00a7a90 legacy=0x7f3af0060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.687 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 -- 172.21.15.161:0/3148288609 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00ada00 con 0x7f3af00ad620 2020-11-20T11:38:58.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.679+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00ad620 0x7f3af00a6b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3ae400b9a0 tx=0x7f3ae4006df0).ready entity=mon.1 client_cookie=f18dcd45e30bf225 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4009680 con 0x7f3af00ad620 2020-11-20T11:38:58.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40097e0 con 0x7f3af00ad620 2020-11-20T11:38:58.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aee7fc700 1 -- 172.21.15.161:0/3148288609 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4009b60 con 0x7f3af00ad620 2020-11-20T11:38:58.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00ad620 msgr2=0x7f3af00a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00ad620 0x7f3af00a6b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3ae400b9a0 tx=0x7f3ae4006df0).stop 2020-11-20T11:38:58.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- 172.21.15.161:0/3148288609 shutdown_connections 2020-11-20T11:38:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00ad620 0x7f3af00a6b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- 172.21.15.161:0/3148288609 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00a7f40 0x7f3af0060860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- 172.21.15.161:0/3148288609 >> 172.21.15.161:0/3148288609 conn(0x7f3af00621d0 msgr2=0x7f3af00acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- 172.21.15.161:0/3148288609 shutdown_connections 2020-11-20T11:38:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- 172.21.15.161:0/3148288609 wait complete. 2020-11-20T11:38:58.693 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 Processor -- start 2020-11-20T11:38:58.693 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- start start 2020-11-20T11:38:58.693 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.693 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00a7f40 0x7f3af01307c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.693 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00ad620 0x7f3af0130cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.694 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00a00b0 con 0x7f3af00a7a90 2020-11-20T11:38:58.694 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00a02e0 con 0x7f3af00a7f40 2020-11-20T11:38:58.694 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3af4d57700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af009d580 con 0x7f3af00ad620 2020-11-20T11:38:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36972/0 (socket says 172.21.15.161:36972) 2020-11-20T11:38:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 -- 172.21.15.161:0/2284407931 learned_addr learned my addr 172.21.15.161:0/2284407931 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aeffff700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00ad620 0x7f3af0130cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.695 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aeeffd700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00a7f40 0x7f3af01307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.696 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 -- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00ad620 msgr2=0x7f3af0130cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.696 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00ad620 0x7f3af0130cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.696 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 -- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00a7f40 msgr2=0x7f3af01307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.696 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00a7f40 0x7f3af01307c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.696 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.683+0000 7f3aef7fe700 1 -- 172.21.15.161:0/2284407931 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af009d820 con 0x7f3af00a7a90 2020-11-20T11:38:58.697 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3aef7fe700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3ae400b150 tx=0x7f3ae4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.697 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4011bc0 con 0x7f3af00a7a90 2020-11-20T11:38:58.697 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4011d20 con 0x7f3af00a7a90 2020-11-20T11:38:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af0067fb0 con 0x7f3af00a7a90 2020-11-20T11:38:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae401d660 con 0x7f3af00a7a90 2020-11-20T11:38:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af0134d00 con 0x7f3af00a7a90 2020-11-20T11:38:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f3ae4024030 con 0x7f3af00a7a90 2020-11-20T11:38:58.699 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 0x7f3ac8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:58.699 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af0069250 con 0x7f3af00a7a90 2020-11-20T11:38:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3aeeffd700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 0x7f3ac8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3ae406fa80 con 0x7f3af00a7a90 2020-11-20T11:38:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.687+0000 7f3aeeffd700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 0x7f3ac8057c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3ae0001e90 tx=0x7f3ae0001740).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:58.700 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.691+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3ae40492a0 con 0x7f3af00a7a90 2020-11-20T11:38:58.851 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.847+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3af013ce40 con 0x7f3af00a7a90 2020-11-20T11:38:58.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3acf7fe700 1 -- 172.21.15.161:0/2284407931 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f3ae4051300 con 0x7f3af00a7a90 2020-11-20T11:38:58.853 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:38:58.854 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:38:58.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 msgr2=0x7f3ac8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 0x7f3ac8057c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3ae0001e90 tx=0x7f3ae0001740).stop 2020-11-20T11:38:58.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 msgr2=0x7f3af0135a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:58.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f3ae400b150 tx=0x7f3ae4015000).stop 2020-11-20T11:38:58.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 shutdown_connections 2020-11-20T11:38:58.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ac80557c0 0x7f3ac8057c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3af00ad620 0x7f3af0130cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3af00a7a90 0x7f3af0135a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 --2- 172.21.15.161:0/2284407931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3af00a7f40 0x7f3af01307c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:58.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 >> 172.21.15.161:0/2284407931 conn(0x7f3af00621d0 msgr2=0x7f3af00a85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:58.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 shutdown_connections 2020-11-20T11:38:58.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:58.851+0000 7f3af4d57700 1 -- 172.21.15.161:0/2284407931 wait complete. 2020-11-20T11:38:58.869 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T11:38:59.010 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 Processor -- start 2020-11-20T11:38:59.011 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 -- start start 2020-11-20T11:38:59.024 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29cc0aaaa0 0x7f29cc13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.024 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f29cc0a85a0 0x7f29cc0a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.024 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29cc13ddb0 con 0x7f29cc0aae80 2020-11-20T11:38:59.024 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc13dfe0 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.025 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d12dd700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc13e280 con 0x7f29cc0a85a0 2020-11-20T11:38:59.025 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29cc0aaaa0 0x7f29cc13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.025 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d0adc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f29cc0aae80 0x7f29cc0a7a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47224/0 (socket says 172.21.15.161:47224) 2020-11-20T11:38:59.025 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29d0adc700 1 -- 172.21.15.161:0/3085413864 learned_addr learned my addr 172.21.15.161:0/3085413864 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:59.026 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29c3fff700 1 --2- 172.21.15.161:0/3085413864 >> v2:172.21.15.186:3300/0 conn(0x7f29cc0a85a0 0x7f29cc0a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.026 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 -- 172.21.15.161:0/3085413864 >> v2:172.21.15.186:3300/0 conn(0x7f29cc0a85a0 msgr2=0x7f29cc0a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.026 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cb7fe700 1 -- 172.21.15.161:0/3085413864 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427653030 0 0) 0x7f29cc13ddb0 con 0x7f29cc0aae80 2020-11-20T11:38:59.027 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 --2- 172.21.15.161:0/3085413864 >> v2:172.21.15.186:3300/0 conn(0x7f29cc0a85a0 0x7f29cc0a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.027 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 -- 172.21.15.161:0/3085413864 >> v1:172.21.15.161:6789/0 conn(0x7f29cc0aae80 legacy=0x7f29cc0a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.027 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 -- 172.21.15.161:0/3085413864 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc13e520 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cbfff700 1 --2- 172.21.15.161:0/3085413864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aaaa0 0x7f29cc13a7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f29cc0630d0 tx=0x7f29b4006df0).ready entity=mon.0 client_cookie=523d3a6e9a9aca65 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cb7fe700 1 -- 172.21.15.161:0/3085413864 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40097b0 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cb7fe700 1 -- 172.21.15.161:0/3085413864 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4009910 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.028 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.007+0000 7f29cb7fe700 1 -- 172.21.15.161:0/3085413864 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4009c90 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- 172.21.15.161:0/3085413864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aaaa0 msgr2=0x7f29cc13a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- 172.21.15.161:0/3085413864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aaaa0 0x7f29cc13a7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f29cc0630d0 tx=0x7f29b4006df0).stop 2020-11-20T11:38:59.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- 172.21.15.161:0/3085413864 shutdown_connections 2020-11-20T11:38:59.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- 172.21.15.161:0/3085413864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aaaa0 0x7f29cc13a7e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- 172.21.15.161:0/3085413864 >> v2:172.21.15.186:3300/0 conn(0x7f29cc0a85a0 0x7f29cc0a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.030 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- 172.21.15.161:0/3085413864 >> 172.21.15.161:0/3085413864 conn(0x7f29cc061aa0 msgr2=0x7f29cc067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- 172.21.15.161:0/3085413864 shutdown_connections 2020-11-20T11:38:59.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- 172.21.15.161:0/3085413864 wait complete. 2020-11-20T11:38:59.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 Processor -- start 2020-11-20T11:38:59.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- start start 2020-11-20T11:38:59.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29cc0a85a0 0x7f29cc0a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29cc0aaaa0 0x7f29cc149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 0x7f29cc138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc138680 con 0x7f29cc0aae80 2020-11-20T11:38:59.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc14a510 con 0x7f29cc0a85a0 2020-11-20T11:38:59.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d12dd700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc1388b0 con 0x7f29cc0aaaa0 2020-11-20T11:38:59.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 0x7f29cc138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 0x7f29cc138d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36988/0 (socket says 172.21.15.161:36988) 2020-11-20T11:38:59.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 -- 172.21.15.161:0/647534592 learned_addr learned my addr 172.21.15.161:0/647534592 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29c3fff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29cc0aaaa0 0x7f29cc149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.035 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29cbfff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29cc0a85a0 0x7f29cc0a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.035 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 -- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29cc0aaaa0 msgr2=0x7f29cc149c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.035 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f29cc0aaaa0 0x7f29cc149c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.036 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 -- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29cc0a85a0 msgr2=0x7f29cc0a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.036 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29cc0a85a0 0x7f29cc0a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.036 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc13a110 con 0x7f29cc0aae80 2020-11-20T11:38:59.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.011+0000 7f29d0adc700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 0x7f29cc138d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f29c400cae0 tx=0x7f29c4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4005b80 con 0x7f29cc0aae80 2020-11-20T11:38:59.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4005ce0 con 0x7f29cc0aae80 2020-11-20T11:38:59.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc14a120 con 0x7f29cc0aae80 2020-11-20T11:38:59.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4007340 con 0x7f29cc0aae80 2020-11-20T11:38:59.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc1393e0 con 0x7f29cc0aae80 2020-11-20T11:38:59.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f29c4010030 con 0x7f29cc0aae80 2020-11-20T11:38:59.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29cc14a680 con 0x7f29cc0aae80 2020-11-20T11:38:59.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f29a80557c0 0x7f29a8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f29c406e730 con 0x7f29cc0aae80 2020-11-20T11:38:59.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29cbfff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f29a80557c0 0x7f29a8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7f29a805d3a0 0x7f29a805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29a805fe20 con 0x7f29a805d3a0 2020-11-20T11:38:59.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29c4070da0 con 0x7f29cc0aae80 2020-11-20T11:38:59.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29c3fff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7f29a805d3a0 0x7f29a805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.015+0000 7f29cbfff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f29a80557c0 0x7f29a8057c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f29b4006e30 tx=0x7f29b4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.019+0000 7f29c3fff700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7f29a805d3a0 0x7f29a805f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.019+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== osd.0 v2:172.21.15.161:6815/14664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f29a805fe20 con 0x7f29a805d3a0 2020-11-20T11:38:59.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 --> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f29cc138a70 con 0x7f29a805d3a0 2020-11-20T11:38:59.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29c8ff9700 1 -- 172.21.15.161:0/647534592 <== osd.0 v2:172.21.15.161:6815/14664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f29cc138a70 con 0x7f29a805d3a0 2020-11-20T11:38:59.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7f29a805d3a0 msgr2=0x7f29a805f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7f29a805d3a0 0x7f29a805f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f29a80557c0 msgr2=0x7f29a8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f29a80557c0 0x7f29a8057c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f29b4006e30 tx=0x7f29b4015000).stop 2020-11-20T11:38:59.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 msgr2=0x7f29cc138d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 --2- 172.21.15.161:0/647534592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29cc0aae80 0x7f29cc138d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f29c400cae0 tx=0x7f29c4007f70).stop 2020-11-20T11:38:59.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d0adc700 1 -- 172.21.15.161:0/647534592 reap_dead start 2020-11-20T11:38:59.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 shutdown_connections 2020-11-20T11:38:59.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 >> 172.21.15.161:0/647534592 conn(0x7f29cc061aa0 msgr2=0x7f29cc067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 shutdown_connections 2020-11-20T11:38:59.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.039+0000 7f29d12dd700 1 -- 172.21.15.161:0/647534592 wait complete. 2020-11-20T11:38:59.054 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.055 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T11:38:59.185 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 Processor -- start 2020-11-20T11:38:59.185 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- start start 2020-11-20T11:38:59.186 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6f8c0aaaa0 0x7f6f8c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.186 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.186 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c13ddb0 con 0x7f6f8c0aae80 2020-11-20T11:38:59.186 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c13dfe0 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.187 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c13e280 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:43990/0 (socket says 172.21.15.161:43990) 2020-11-20T11:38:59.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 -- 172.21.15.161:0/2440854670 learned_addr learned my addr 172.21.15.161:0/2440854670 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91a57700 1 --2- 172.21.15.161:0/2440854670 >> v2:172.21.15.186:3300/0 conn(0x7f6f8c0aaaa0 0x7f6f8c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 -- 172.21.15.161:0/2440854670 >> v2:172.21.15.186:3300/0 conn(0x7f6f8c0aaaa0 msgr2=0x7f6f8c13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.192 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 --2- 172.21.15.161:0/2440854670 >> v2:172.21.15.186:3300/0 conn(0x7f6f8c0aaaa0 0x7f6f8c13a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.192 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 -- 172.21.15.161:0/2440854670 >> v1:172.21.15.186:6789/0 conn(0x7f6f8c0aae80 legacy=0x7f6f8c0a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.192 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 -- 172.21.15.161:0/2440854670 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c13e520 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.192 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f91256700 1 --2- 172.21.15.161:0/2440854670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6f7c006fd0 tx=0x7f6f7c006eb0).ready entity=mon.2 client_cookie=f18806766ca44ba4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f90a55700 1 -- 172.21.15.161:0/2440854670 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c009810 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f90a55700 1 -- 172.21.15.161:0/2440854670 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c009970 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f90a55700 1 -- 172.21.15.161:0/2440854670 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c009cf0 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- 172.21.15.161:0/2440854670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 msgr2=0x7f6f8c0a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2440854670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6f7c006fd0 tx=0x7f6f7c006eb0).stop 2020-11-20T11:38:59.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- 172.21.15.161:0/2440854670 shutdown_connections 2020-11-20T11:38:59.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2440854670 >> v2:172.21.15.186:3300/0 conn(0x7f6f8c0aaaa0 0x7f6f8c13a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2440854670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a7580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- 172.21.15.161:0/2440854670 >> 172.21.15.161:0/2440854670 conn(0x7f6f8c061aa0 msgr2=0x7f6f8c067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- 172.21.15.161:0/2440854670 shutdown_connections 2020-11-20T11:38:59.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.183+0000 7f6f92a59700 1 -- 172.21.15.161:0/2440854670 wait complete. 2020-11-20T11:38:59.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 Processor -- start 2020-11-20T11:38:59.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- start start 2020-11-20T11:38:59.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 0x7f6f8c1398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f8c0aae80 0x7f6f8c149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0a20e0 con 0x7f6f8c0aae80 2020-11-20T11:38:59.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0a1e40 con 0x7f6f8c0a85a0 2020-11-20T11:38:59.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c1499b0 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.197 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 0x7f6f8c1398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.197 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92258700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f8c0aae80 0x7f6f8c149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.199 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 0x7f6f8c1398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:43998/0 (socket says 172.21.15.161:43998) 2020-11-20T11:38:59.199 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 -- 172.21.15.161:0/2195848576 learned_addr learned my addr 172.21.15.161:0/2195848576 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.199 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91a57700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 -- 172.21.15.161:0/2195848576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f8c0a85a0 msgr2=0x7f6f8c0a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f8c0a85a0 0x7f6f8c0a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 -- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f8c0aae80 msgr2=0x7f6f8c149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f8c0aae80 0x7f6f8c149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c13a470 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f91256700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 0x7f6f8c1398c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6f8c0684a0 tx=0x7f6f7c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011d50 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c01e460 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c09fb40 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c01e7e0 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.187+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c14a560 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f8c14a780 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6f7c02f070 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6f640557c0 0x7f6f64057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6f7c070a20 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7f6f6405d320 0x7f6f6405f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f91a57700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6f640557c0 0x7f6f64057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f6405fda0 con 0x7f6f6405d320 2020-11-20T11:38:59.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f7c070e20 con 0x7f6f8c0aaaa0 2020-11-20T11:38:59.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f92258700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7f6f6405d320 0x7f6f6405f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.204 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f91a57700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6f640557c0 0x7f6f64057c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6f88006fd0 tx=0x7f6f88006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.204 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.191+0000 7f6f92258700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7f6f6405d320 0x7f6f6405f740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.204 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.195+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== osd.1 v2:172.21.15.161:6808/14673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f6f6405fda0 con 0x7f6f6405d320 2020-11-20T11:38:59.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.211+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 --> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f8c13d760 con 0x7f6f6405d320 2020-11-20T11:38:59.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f79ffb700 1 -- 172.21.15.161:0/2195848576 <== osd.1 v2:172.21.15.161:6808/14673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f8c13d760 con 0x7f6f6405d320 2020-11-20T11:38:59.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7f6f6405d320 msgr2=0x7f6f6405f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7f6f6405d320 0x7f6f6405f740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6f640557c0 msgr2=0x7f6f64057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6f640557c0 0x7f6f64057c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6f88006fd0 tx=0x7f6f88006df0).stop 2020-11-20T11:38:59.219 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 msgr2=0x7f6f8c1398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.219 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 --2- 172.21.15.161:0/2195848576 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6f8c0aaaa0 0x7f6f8c1398c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6f8c0684a0 tx=0x7f6f7c015000).stop 2020-11-20T11:38:59.219 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92258700 1 -- 172.21.15.161:0/2195848576 reap_dead start 2020-11-20T11:38:59.219 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 shutdown_connections 2020-11-20T11:38:59.219 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 >> 172.21.15.161:0/2195848576 conn(0x7f6f8c061aa0 msgr2=0x7f6f8c13c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 shutdown_connections 2020-11-20T11:38:59.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.215+0000 7f6f92a59700 1 -- 172.21.15.161:0/2195848576 wait complete. 2020-11-20T11:38:59.230 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.231 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T11:38:59.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 Processor -- start 2020-11-20T11:38:59.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- start start 2020-11-20T11:38:59.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100ad620 0x7f7310060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73100a58e0 0x7f73101427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f73100a5d60 0x7f7310142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73100a8bc0 con 0x7f73100a58e0 2020-11-20T11:38:59.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310061050 con 0x7f73100a5d60 2020-11-20T11:38:59.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73100a8df0 con 0x7f73100ad620 2020-11-20T11:38:59.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73100a58e0 0x7f73101427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73100a58e0 0x7f73101427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37014/0 (socket says 172.21.15.161:37014) 2020-11-20T11:38:59.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 -- 172.21.15.161:0/509925280 learned_addr learned my addr 172.21.15.161:0/509925280 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7314d59700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100ad620 0x7f7310060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f731555a700 1 --2- 172.21.15.161:0/509925280 >> v2:172.21.15.186:3300/0 conn(0x7f73100a5d60 0x7f7310142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 -- 172.21.15.161:0/509925280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100ad620 msgr2=0x7f7310060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100ad620 0x7f7310060150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 -- 172.21.15.161:0/509925280 >> v2:172.21.15.186:3300/0 conn(0x7f73100a5d60 msgr2=0x7f7310142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 --2- 172.21.15.161:0/509925280 >> v2:172.21.15.186:3300/0 conn(0x7f73100a5d60 0x7f7310142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 -- 172.21.15.161:0/509925280 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100a9090 con 0x7f73100a58e0 2020-11-20T11:38:59.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730ffff700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100a58e0 0x7f73101427f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7310064290 tx=0x7f72fc006eb0).ready entity=mon.0 client_cookie=34f33198c0ae5ad7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730f7fe700 1 -- 172.21.15.161:0/509925280 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc009810 con 0x7f73100a58e0 2020-11-20T11:38:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730f7fe700 1 -- 172.21.15.161:0/509925280 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc009970 con 0x7f73100a58e0 2020-11-20T11:38:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f730f7fe700 1 -- 172.21.15.161:0/509925280 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc009cf0 con 0x7f73100a58e0 2020-11-20T11:38:59.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- 172.21.15.161:0/509925280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100a58e0 msgr2=0x7f73101427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100a58e0 0x7f73101427f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f7310064290 tx=0x7f72fc006eb0).stop 2020-11-20T11:38:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- 172.21.15.161:0/509925280 shutdown_connections 2020-11-20T11:38:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- 172.21.15.161:0/509925280 >> v2:172.21.15.186:3300/0 conn(0x7f73100a5d60 0x7f7310142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100ad620 0x7f7310060150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 --2- 172.21.15.161:0/509925280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100a58e0 0x7f73101427f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- 172.21.15.161:0/509925280 >> 172.21.15.161:0/509925280 conn(0x7f73100621d0 msgr2=0x7f73100acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- 172.21.15.161:0/509925280 shutdown_connections 2020-11-20T11:38:59.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.359+0000 7f7315d5b700 1 -- 172.21.15.161:0/509925280 wait complete. 2020-11-20T11:38:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 Processor -- start 2020-11-20T11:38:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- start start 2020-11-20T11:38:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100a58e0 0x7f73101169e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73100a5d60 0x7f7310118760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 0x7f731014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310118c50 con 0x7f73100ad620 2020-11-20T11:38:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310115720 con 0x7f73100a5d60 2020-11-20T11:38:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7310115950 con 0x7f73100a58e0 2020-11-20T11:38:59.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 0x7f731014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 0x7f731014e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37020/0 (socket says 172.21.15.161:37020) 2020-11-20T11:38:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 -- 172.21.15.161:0/2053339263 learned_addr learned my addr 172.21.15.161:0/2053339263 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730ffff700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73100a5d60 0x7f7310118760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7314d59700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100a58e0 0x7f73101169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 -- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100a58e0 msgr2=0x7f73101169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100a58e0 0x7f73101169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 -- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73100a5d60 msgr2=0x7f7310118760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73100a5d60 0x7f7310118760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7310115bf0 con 0x7f73100ad620 2020-11-20T11:38:59.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7314d59700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f73100a58e0 0x7f73101169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f731555a700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 0x7f731014e050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f730800eb40 tx=0x7f7308008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800c740 con 0x7f73100ad620 2020-11-20T11:38:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730800c8a0 con 0x7f73100ad620 2020-11-20T11:38:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310115e90 con 0x7f73100ad620 2020-11-20T11:38:59.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730800cc40 con 0x7f73100ad620 2020-11-20T11:38:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73101215e0 con 0x7f73100ad620 2020-11-20T11:38:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7310069250 con 0x7f73100ad620 2020-11-20T11:38:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f730801d460 con 0x7f73100ad620 2020-11-20T11:38:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.363+0000 7f730cff9700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f72e80557f0 0x7f72e8057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f730806e770 con 0x7f73100ad620 2020-11-20T11:38:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f7314d59700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f72e80557f0 0x7f72e8057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730cff9700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f72e805d3d0 0x7f72e805f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72e805fe50 con 0x7f72e805d3d0 2020-11-20T11:38:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7308073220 con 0x7f73100ad620 2020-11-20T11:38:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730ffff700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f72e805d3d0 0x7f72e805f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f7314d59700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f72e80557f0 0x7f72e8057cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7304006fd0 tx=0x7f7304008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730ffff700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f72e805d3d0 0x7f72e805f7f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.367+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== osd.2 v2:172.21.15.161:6800/14663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f72e805fe50 con 0x7f72e805d3d0 2020-11-20T11:38:59.389 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 --> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7310116020 con 0x7f72e805d3d0 2020-11-20T11:38:59.390 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f730cff9700 1 -- 172.21.15.161:0/2053339263 <== osd.2 v2:172.21.15.161:6800/14663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7310116020 con 0x7f72e805d3d0 2020-11-20T11:38:59.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f72e805d3d0 msgr2=0x7f72e805f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f72e805d3d0 0x7f72e805f7f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f72e80557f0 msgr2=0x7f72e8057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f72e80557f0 0x7f72e8057cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f7304006fd0 tx=0x7f7304008040).stop 2020-11-20T11:38:59.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 msgr2=0x7f731014e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 --2- 172.21.15.161:0/2053339263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73100ad620 0x7f731014e050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f730800eb40 tx=0x7f7308008040).stop 2020-11-20T11:38:59.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f731555a700 1 -- 172.21.15.161:0/2053339263 reap_dead start 2020-11-20T11:38:59.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 shutdown_connections 2020-11-20T11:38:59.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 >> 172.21.15.161:0/2053339263 conn(0x7f73100621d0 msgr2=0x7f73100679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 shutdown_connections 2020-11-20T11:38:59.393 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.387+0000 7f7315d5b700 1 -- 172.21.15.161:0/2053339263 wait complete. 2020-11-20T11:38:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.406 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T11:38:59.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 Processor -- start 2020-11-20T11:38:59.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 -- start start 2020-11-20T11:38:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8e300b1b00 0x7f8e300ab340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300a96a0 con 0x7f8e300b1ee0 2020-11-20T11:38:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300a9940 con 0x7f8e300a9200 2020-11-20T11:38:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e35fbc700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300aaea0 con 0x7f8e300b1b00 2020-11-20T11:38:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e2effd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8e300b1ee0 0x7f8e3013abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47270/0 (socket says 172.21.15.161:47270) 2020-11-20T11:38:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e2effd700 1 -- 172.21.15.161:0/1207894961 learned_addr learned my addr 172.21.15.161:0/1207894961 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:38:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1207894961 >> v2:172.21.15.186:3300/0 conn(0x7f8e300b1b00 0x7f8e300ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990187308 0 0) 0x7f8e300a96a0 con 0x7f8e300b1ee0 2020-11-20T11:38:59.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.535+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e10003240 con 0x7f8e300b1ee0 2020-11-20T11:38:59.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319910328 0 0) 0x7f8e300a9940 con 0x7f8e300a9200 2020-11-20T11:38:59.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e300a96a0 con 0x7f8e300a9200 2020-11-20T11:38:59.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1623884579 0 0) 0x7f8e10003240 con 0x7f8e300b1ee0 2020-11-20T11:38:59.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 >> v2:172.21.15.186:3300/0 conn(0x7f8e300b1b00 msgr2=0x7f8e300ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 --2- 172.21.15.161:0/1207894961 >> v2:172.21.15.186:3300/0 conn(0x7f8e300b1b00 0x7f8e300ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 >> v1:172.21.15.186:6789/0 conn(0x7f8e300a9200 legacy=0x7f8e3013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300ab830 con 0x7f8e300b1ee0 2020-11-20T11:38:59.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f8e180014e0 con 0x7f8e300b1ee0 2020-11-20T11:38:59.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 >> v1:172.21.15.161:6789/0 conn(0x7f8e300b1ee0 legacy=0x7f8e3013abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 0x7f8e10003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e100044e0 0x7f8e10004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e10004e50 0x7f8e1000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300aaea0 con 0x7f8e100038c0 2020-11-20T11:38:59.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000bc20 con 0x7f8e100044e0 2020-11-20T11:38:59.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000bd60 con 0x7f8e10004e50 2020-11-20T11:38:59.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 0x7f8e10003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2effd700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e100044e0 0x7f8e10004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2ffff700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e10004e50 0x7f8e1000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e10004e50 msgr2=0x7f8e1000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e10004e50 0x7f8e1000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e100044e0 msgr2=0x7f8e10004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e100044e0 0x7f8e10004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2ffff700 1 -- 172.21.15.161:0/1207894961 reap_dead start 2020-11-20T11:38:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1207894961 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10003240 con 0x7f8e100038c0 2020-11-20T11:38:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2effd700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e100044e0 0x7f8e10004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 0x7f8e10003cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8e20006fd0 tx=0x7f8e20006df0).ready entity=mon.0 client_cookie=59d0248278dab7f2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000b310 con 0x7f8e100038c0 2020-11-20T11:38:59.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000ea90 con 0x7f8e100038c0 2020-11-20T11:38:59.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e2e7fc700 1 -- 172.21.15.161:0/1207894961 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000ee10 con 0x7f8e100038c0 2020-11-20T11:38:59.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 msgr2=0x7f8e10003cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 0x7f8e10003cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f8e20006fd0 tx=0x7f8e20006df0).stop 2020-11-20T11:38:59.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1207894961 shutdown_connections 2020-11-20T11:38:59.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 --2- 172.21.15.161:0/1207894961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e100038c0 0x7f8e10003cc0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0x7f8e20006fd0 tx=0x7f8e20006df0).stop 2020-11-20T11:38:59.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1207894961 >> 172.21.15.161:0/1207894961 conn(0x7f8e30068310 msgr2=0x7f8e300b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1207894961 shutdown_connections 2020-11-20T11:38:59.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.539+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1207894961 wait complete. 2020-11-20T11:38:59.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 Processor -- start 2020-11-20T11:38:59.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- start start 2020-11-20T11:38:59.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 0x7f8e300a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e3014d550 0x7f8e30137580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e3014d9d0 0x7f8e30137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300a7440 con 0x7f8e3013a630 2020-11-20T11:38:59.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300a81b0 con 0x7f8e3014d9d0 2020-11-20T11:38:59.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300a6640 con 0x7f8e3014d550 2020-11-20T11:38:59.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 0x7f8e300a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 0x7f8e300a7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37040/0 (socket says 172.21.15.161:37040) 2020-11-20T11:38:59.555 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1661223465 learned_addr learned my addr 172.21.15.161:0/1661223465 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2ffff700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e3014d9d0 0x7f8e30137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2effd700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e3014d550 0x7f8e30137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e3014d550 msgr2=0x7f8e30137580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e3014d550 0x7f8e30137580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.556 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e3014d9d0 msgr2=0x7f8e30137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e3014d9d0 0x7f8e30137a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300a68e0 con 0x7f8e3013a630 2020-11-20T11:38:59.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2ffff700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e3014d9d0 0x7f8e30137a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:59.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e2f7fe700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 0x7f8e300a7cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8e20013000 tx=0x7f8e20019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2001d410 con 0x7f8e3013a630 2020-11-20T11:38:59.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2001d570 con 0x7f8e3013a630 2020-11-20T11:38:59.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2001d720 con 0x7f8e3013a630 2020-11-20T11:38:59.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e300a6b80 con 0x7f8e3013a630 2020-11-20T11:38:59.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.543+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3013aa10 con 0x7f8e3013a630 2020-11-20T11:38:59.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e300a64c0 con 0x7f8e3013a630 2020-11-20T11:38:59.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f8e2002d070 con 0x7f8e3013a630 2020-11-20T11:38:59.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8e0c0557f0 0x7f8e0c057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8e20070570 con 0x7f8e3013a630 2020-11-20T11:38:59.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f8e0c05d3d0 0x7f8e0c05f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e0c05fe50 con 0x7f8e0c05d3d0 2020-11-20T11:38:59.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e20072be0 con 0x7f8e3013a630 2020-11-20T11:38:59.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e2effd700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8e0c0557f0 0x7f8e0c057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e2ffff700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f8e0c05d3d0 0x7f8e0c05f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e2effd700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8e0c0557f0 0x7f8e0c057cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8e18000bc0 tx=0x7f8e18007040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.547+0000 7f8e2ffff700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f8e0c05d3d0 0x7f8e0c05f7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.551+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== osd.3 v2:172.21.15.161:6816/14682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f8e0c05fe50 con 0x7f8e0c05d3d0 2020-11-20T11:38:59.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.567+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 --> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e300a6d10 con 0x7f8e0c05d3d0 2020-11-20T11:38:59.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e277fe700 1 -- 172.21.15.161:0/1661223465 <== osd.3 v2:172.21.15.161:6816/14682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e300a6d10 con 0x7f8e0c05d3d0 2020-11-20T11:38:59.573 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f8e0c05d3d0 msgr2=0x7f8e0c05f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.574 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f8e0c05d3d0 0x7f8e0c05f7f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.574 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8e0c0557f0 msgr2=0x7f8e0c057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.574 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8e0c0557f0 0x7f8e0c057cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8e18000bc0 tx=0x7f8e18007040).stop 2020-11-20T11:38:59.574 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 msgr2=0x7f8e300a7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 --2- 172.21.15.161:0/1661223465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e3013a630 0x7f8e300a7cc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f8e20013000 tx=0x7f8e20019000).stop 2020-11-20T11:38:59.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e2ffff700 1 -- 172.21.15.161:0/1661223465 reap_dead start 2020-11-20T11:38:59.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 shutdown_connections 2020-11-20T11:38:59.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 >> 172.21.15.161:0/1661223465 conn(0x7f8e30068310 msgr2=0x7f8e300abca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.575 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 shutdown_connections 2020-11-20T11:38:59.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.571+0000 7f8e35fbc700 1 -- 172.21.15.161:0/1661223465 wait complete. 2020-11-20T11:38:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.591 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T11:38:59.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 Processor -- start 2020-11-20T11:38:59.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- start start 2020-11-20T11:38:59.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f57f40ad620 0x7f57f4060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f41427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57f40a5d60 0x7f57f4142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40a8bc0 con 0x7f57f40a5d60 2020-11-20T11:38:59.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f4061050 con 0x7f57f40ad620 2020-11-20T11:38:59.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40a8df0 con 0x7f57f40a58e0 2020-11-20T11:38:59.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57f40a5d60 0x7f57f4142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57f40a5d60 0x7f57f4142ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37052/0 (socket says 172.21.15.161:37052) 2020-11-20T11:38:59.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 -- 172.21.15.161:0/4027769348 learned_addr learned my addr 172.21.15.161:0/4027769348 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57f9957700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f41427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa158700 1 --2- 172.21.15.161:0/4027769348 >> v2:172.21.15.186:3300/0 conn(0x7f57f40ad620 0x7f57f4060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 -- 172.21.15.161:0/4027769348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 msgr2=0x7f57f41427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f41427f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 -- 172.21.15.161:0/4027769348 >> v2:172.21.15.186:3300/0 conn(0x7f57f40ad620 msgr2=0x7f57f4060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 --2- 172.21.15.161:0/4027769348 >> v2:172.21.15.186:3300/0 conn(0x7f57f40ad620 0x7f57f4060150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 -- 172.21.15.161:0/4027769348 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40a9090 con 0x7f57f40a5d60 2020-11-20T11:38:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fa959700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40a5d60 0x7f57f4142ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f57f40aa820 tx=0x7f57ec009290).ready entity=mon.0 client_cookie=2f87c62137a2dc97 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57f9156700 1 -- 172.21.15.161:0/4027769348 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec00bb10 con 0x7f57f40a5d60 2020-11-20T11:38:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57f9156700 1 -- 172.21.15.161:0/4027769348 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec00bc70 con 0x7f57f40a5d60 2020-11-20T11:38:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57f9156700 1 -- 172.21.15.161:0/4027769348 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec011400 con 0x7f57f40a5d60 2020-11-20T11:38:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- 172.21.15.161:0/4027769348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40a5d60 msgr2=0x7f57f4142ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40a5d60 0x7f57f4142ce0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f57f40aa820 tx=0x7f57ec009290).stop 2020-11-20T11:38:59.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- 172.21.15.161:0/4027769348 shutdown_connections 2020-11-20T11:38:59.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40a5d60 0x7f57f4142ce0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- 172.21.15.161:0/4027769348 >> v2:172.21.15.186:3300/0 conn(0x7f57f40ad620 0x7f57f4060150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 --2- 172.21.15.161:0/4027769348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f41427f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- 172.21.15.161:0/4027769348 >> 172.21.15.161:0/4027769348 conn(0x7f57f40621d0 msgr2=0x7f57f40acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- 172.21.15.161:0/4027769348 shutdown_connections 2020-11-20T11:38:59.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.723+0000 7f57fb15a700 1 -- 172.21.15.161:0/4027769348 wait complete. 2020-11-20T11:38:59.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 Processor -- start 2020-11-20T11:38:59.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- start start 2020-11-20T11:38:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57f40a5d60 0x7f57f40a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 0x7f57f409e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f414b890 con 0x7f57f40ad620 2020-11-20T11:38:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f409eae0 con 0x7f57f40a5d60 2020-11-20T11:38:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f414dfa0 con 0x7f57f40a58e0 2020-11-20T11:38:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 0x7f57f409e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 0x7f57f409e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37060/0 (socket says 172.21.15.161:37060) 2020-11-20T11:38:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 -- 172.21.15.161:0/3169396969 learned_addr learned my addr 172.21.15.161:0/3169396969 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa158700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57f9957700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57f40a5d60 0x7f57f40a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 -- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 msgr2=0x7f57f414e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f57f40a58e0 0x7f57f414e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 -- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57f40a5d60 msgr2=0x7f57f40a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57f40a5d60 0x7f57f40a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f414e240 con 0x7f57f40ad620 2020-11-20T11:38:59.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57f9957700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f57f40a5d60 0x7f57f40a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:59.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fa959700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 0x7f57f409e5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f57ec011000 tx=0x7f57ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01b6b0 con 0x7f57f40ad620 2020-11-20T11:38:59.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec01b810 con 0x7f57f40ad620 2020-11-20T11:38:59.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f414e4e0 con 0x7f57f40ad620 2020-11-20T11:38:59.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec01bb90 con 0x7f57f40ad620 2020-11-20T11:38:59.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.727+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f41513f0 con 0x7f57f40ad620 2020-11-20T11:38:59.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57f4117b40 con 0x7f57f40ad620 2020-11-20T11:38:59.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f57ec02d070 con 0x7f57f40ad620 2020-11-20T11:38:59.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f57cc0557c0 0x7f57cc057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f57ec070910 con 0x7f57f40ad620 2020-11-20T11:38:59.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57fa158700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f57cc0557c0 0x7f57cc057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7f57cc05d3a0 0x7f57cc05f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57cc05fe20 con 0x7f57cc05d3a0 2020-11-20T11:38:59.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57ec070d10 con 0x7f57f40ad620 2020-11-20T11:38:59.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57f9957700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7f57cc05d3a0 0x7f57cc05f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.731+0000 7f57fa158700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f57cc0557c0 0x7f57cc057c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f57f0006fd0 tx=0x7f57f0006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.735+0000 7f57f9957700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7f57cc05d3a0 0x7f57cc05f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.735+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== osd.4 v2:172.21.15.186:6808/14935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f57cc05fe20 con 0x7f57cc05d3a0 2020-11-20T11:38:59.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 --> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57f4069250 con 0x7f57cc05d3a0 2020-11-20T11:38:59.760 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57e67fc700 1 -- 172.21.15.161:0/3169396969 <== osd.4 v2:172.21.15.186:6808/14935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57f4069250 con 0x7f57cc05d3a0 2020-11-20T11:38:59.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7f57cc05d3a0 msgr2=0x7f57cc05f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7f57cc05d3a0 0x7f57cc05f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f57cc0557c0 msgr2=0x7f57cc057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.762 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f57cc0557c0 0x7f57cc057c80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f57f0006fd0 tx=0x7f57f0006df0).stop 2020-11-20T11:38:59.762 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 msgr2=0x7f57f409e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.762 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 --2- 172.21.15.161:0/3169396969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57f40ad620 0x7f57f409e5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f57ec011000 tx=0x7f57ec016000).stop 2020-11-20T11:38:59.763 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fa959700 1 -- 172.21.15.161:0/3169396969 reap_dead start 2020-11-20T11:38:59.763 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 shutdown_connections 2020-11-20T11:38:59.764 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 >> 172.21.15.161:0/3169396969 conn(0x7f57f40621d0 msgr2=0x7f57f40ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.764 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 shutdown_connections 2020-11-20T11:38:59.764 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.755+0000 7f57fb15a700 1 -- 172.21.15.161:0/3169396969 wait complete. 2020-11-20T11:38:59.773 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.774 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T11:38:59.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 Processor -- start 2020-11-20T11:38:59.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 -- start start 2020-11-20T11:38:59.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f636c05be80 0x7f636c0a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f636c0a6130 0x7f636c0a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c0a98a0 con 0x7f636c0a89e0 2020-11-20T11:38:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0a1030 con 0x7f636c05be80 2020-11-20T11:38:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6372ed7700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0a8e70 con 0x7f636c0a6130 2020-11-20T11:38:59.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.903+0000 7f6371ed5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f636c05be80 0x7f636c0a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f636c05be80 0x7f636c0a9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37066/0 (socket says 172.21.15.161:37066) 2020-11-20T11:38:59.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 -- 172.21.15.161:0/1747592919 learned_addr learned my addr 172.21.15.161:0/1747592919 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f63716d4700 1 --2- 172.21.15.161:0/1747592919 >> v2:172.21.15.186:3300/0 conn(0x7f636c0a6130 0x7f636c0a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 -- 172.21.15.161:0/1747592919 >> v2:172.21.15.186:3300/0 conn(0x7f636c0a6130 msgr2=0x7f636c0a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:38:59.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 --2- 172.21.15.161:0/1747592919 >> v2:172.21.15.186:3300/0 conn(0x7f636c0a6130 0x7f636c0a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 -- 172.21.15.161:0/1747592919 >> v1:172.21.15.186:6789/0 conn(0x7f636c0a89e0 legacy=0x7f636c137d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 -- 172.21.15.161:0/1747592919 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0a9b40 con 0x7f636c05be80 2020-11-20T11:38:59.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6371ed5700 1 --2- 172.21.15.161:0/1747592919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c05be80 0x7f636c0a9270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f635c006fd0 tx=0x7f635c006e50).ready entity=mon.0 client_cookie=b27cd8d17b0ca555 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.913 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6370ed3700 1 -- 172.21.15.161:0/1747592919 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c006030 con 0x7f636c05be80 2020-11-20T11:38:59.914 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6370ed3700 1 -- 172.21.15.161:0/1747592919 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c006190 con 0x7f636c05be80 2020-11-20T11:38:59.914 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6370ed3700 1 -- 172.21.15.161:0/1747592919 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c006510 con 0x7f636c05be80 2020-11-20T11:38:59.914 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- 172.21.15.161:0/1747592919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c05be80 msgr2=0x7f636c0a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.914 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 --2- 172.21.15.161:0/1747592919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c05be80 0x7f636c0a9270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f635c006fd0 tx=0x7f635c006e50).stop 2020-11-20T11:38:59.915 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- 172.21.15.161:0/1747592919 shutdown_connections 2020-11-20T11:38:59.915 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 --2- 172.21.15.161:0/1747592919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c05be80 0x7f636c0a9270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.915 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 --2- 172.21.15.161:0/1747592919 >> v2:172.21.15.186:3300/0 conn(0x7f636c0a6130 0x7f636c0a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.915 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- 172.21.15.161:0/1747592919 >> 172.21.15.161:0/1747592919 conn(0x7f636c0ad620 msgr2=0x7f636c0ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.915 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- 172.21.15.161:0/1747592919 shutdown_connections 2020-11-20T11:38:59.916 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- 172.21.15.161:0/1747592919 wait complete. 2020-11-20T11:38:59.916 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 Processor -- start 2020-11-20T11:38:59.916 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.907+0000 7f6372ed7700 1 -- start start 2020-11-20T11:38:59.916 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636c05be80 0x7f636c0a6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.916 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 0x7f636c14db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.917 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636c0a89e0 0x7f636c066990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.917 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c065f50 con 0x7f636c0a6130 2020-11-20T11:38:59.917 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c14e090 con 0x7f636c05be80 2020-11-20T11:38:59.917 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c14d1c0 con 0x7f636c0a89e0 2020-11-20T11:38:59.918 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 0x7f636c14db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.918 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 0x7f636c14db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37076/0 (socket says 172.21.15.161:37076) 2020-11-20T11:38:59.918 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 -- 172.21.15.161:0/2251162214 learned_addr learned my addr 172.21.15.161:0/2251162214 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:38:59.918 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63726d6700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636c0a89e0 0x7f636c066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.918 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6371ed5700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636c05be80 0x7f636c0a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.919 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 -- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636c0a89e0 msgr2=0x7f636c066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.919 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f636c0a89e0 0x7f636c066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.919 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 -- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636c05be80 msgr2=0x7f636c0a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.919 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636c05be80 0x7f636c0a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.920 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c14d430 con 0x7f636c0a6130 2020-11-20T11:38:59.920 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6371ed5700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f636c05be80 0x7f636c0a6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:38:59.920 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f63716d4700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 0x7f636c14db70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f636000ef50 tx=0x7f63600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000cc60 con 0x7f636c0a6130 2020-11-20T11:38:59.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000cdc0 con 0x7f636c0a6130 2020-11-20T11:38:59.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c0a6fe0 con 0x7f636c0a6130 2020-11-20T11:38:59.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360012620 con 0x7f636c0a6130 2020-11-20T11:38:59.923 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c0670a0 con 0x7f636c0a6130 2020-11-20T11:38:59.923 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f636c069250 con 0x7f636c0a6130 2020-11-20T11:38:59.923 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.911+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6360022070 con 0x7f636c0a6130 2020-11-20T11:38:59.923 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63440557c0 0x7f6344057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f636006f0b0 con 0x7f636c0a6130 2020-11-20T11:38:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6371ed5700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63440557c0 0x7f6344057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f634405d3a0 0x7f634405f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:38:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f634405fe20 con 0x7f634405d3a0 2020-11-20T11:38:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6360071610 con 0x7f636c0a6130 2020-11-20T11:38:59.925 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f63726d6700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f634405d3a0 0x7f634405f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:38:59.925 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6371ed5700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63440557c0 0x7f6344057c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f635c00b1b0 tx=0x7f635c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.925 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f63726d6700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f634405d3a0 0x7f634405f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:38:59.925 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.915+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== osd.5 v2:172.21.15.186:6809/14934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f634405fe20 con 0x7f634405d3a0 2020-11-20T11:38:59.938 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 --> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f636c0a79e0 con 0x7f634405d3a0 2020-11-20T11:38:59.941 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6369ffb700 1 -- 172.21.15.161:0/2251162214 <== osd.5 v2:172.21.15.186:6809/14934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f636c0a79e0 con 0x7f634405d3a0 2020-11-20T11:38:59.941 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f634405d3a0 msgr2=0x7f634405f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.941 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f634405d3a0 0x7f634405f7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:38:59.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63440557c0 msgr2=0x7f6344057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63440557c0 0x7f6344057c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f635c00b1b0 tx=0x7f635c015000).stop 2020-11-20T11:38:59.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 msgr2=0x7f636c14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:38:59.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f6372ed7700 1 --2- 172.21.15.161:0/2251162214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f636c0a6130 0x7f636c14db70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f636000ef50 tx=0x7f63600091d0).stop 2020-11-20T11:38:59.942 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.935+0000 7f63726d6700 1 -- 172.21.15.161:0/2251162214 reap_dead start 2020-11-20T11:38:59.943 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.939+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 shutdown_connections 2020-11-20T11:38:59.943 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.939+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 >> 172.21.15.161:0/2251162214 conn(0x7f636c0ad620 msgr2=0x7f636c134ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:38:59.943 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.939+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 shutdown_connections 2020-11-20T11:38:59.943 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:38:59.939+0000 7f6372ed7700 1 -- 172.21.15.161:0/2251162214 wait complete. 2020-11-20T11:38:59.952 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:38:59.953 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T11:39:00.080 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 Processor -- start 2020-11-20T11:39:00.081 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 -- start start 2020-11-20T11:39:00.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d3413bc90 0x7f1d340a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340a1110 con 0x7f1d340a7610 2020-11-20T11:39:00.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340a6f10 con 0x7f1d3405be80 2020-11-20T11:39:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.075+0000 7f1d3359e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340a8c30 con 0x7f1d3413bc90 2020-11-20T11:39:00.098 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d3413bc90 0x7f1d340a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d3413bc90 0x7f1d340a0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37086/0 (socket says 172.21.15.161:37086) 2020-11-20T11:39:00.099 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 -- 172.21.15.161:0/115473585 learned_addr learned my addr 172.21.15.161:0/115473585 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 -- 172.21.15.161:0/115473585 >> v1:172.21.15.186:6789/0 conn(0x7f1d3405be80 legacy=0x7f1d340a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.100 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 -- 172.21.15.161:0/115473585 >> v1:172.21.15.161:6789/0 conn(0x7f1d340a7610 legacy=0x7f1d340a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 -- 172.21.15.161:0/115473585 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3413c0d0 con 0x7f1d3413bc90 2020-11-20T11:39:00.101 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d32d9d700 1 --2- 172.21.15.161:0/115473585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d3413bc90 0x7f1d340a0c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d2c009d50 tx=0x7f1d2c009290).ready entity=mon.0 client_cookie=419bbd13a8c6ec08 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3159a700 1 -- 172.21.15.161:0/115473585 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00bc80 con 0x7f1d3413bc90 2020-11-20T11:39:00.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3159a700 1 -- 172.21.15.161:0/115473585 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00bde0 con 0x7f1d3413bc90 2020-11-20T11:39:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3159a700 1 -- 172.21.15.161:0/115473585 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c011610 con 0x7f1d3413bc90 2020-11-20T11:39:00.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- 172.21.15.161:0/115473585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d3413bc90 msgr2=0x7f1d340a0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 --2- 172.21.15.161:0/115473585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d3413bc90 0x7f1d340a0c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1d2c009d50 tx=0x7f1d2c009290).stop 2020-11-20T11:39:00.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- 172.21.15.161:0/115473585 shutdown_connections 2020-11-20T11:39:00.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 --2- 172.21.15.161:0/115473585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d3413bc90 0x7f1d340a0c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- 172.21.15.161:0/115473585 >> 172.21.15.161:0/115473585 conn(0x7f1d340ad620 msgr2=0x7f1d340ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- 172.21.15.161:0/115473585 shutdown_connections 2020-11-20T11:39:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- 172.21.15.161:0/115473585 wait complete. 2020-11-20T11:39:00.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 Processor -- start 2020-11-20T11:39:00.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- start start 2020-11-20T11:39:00.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d3405be80 0x7f1d340a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 0x7f1d34066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d3413bc90 0x7f1d34066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34139890 con 0x7f1d340a7610 2020-11-20T11:39:00.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d34068320 con 0x7f1d3405be80 2020-11-20T11:39:00.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d3359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340a66d0 con 0x7f1d3413bc90 2020-11-20T11:39:00.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.079+0000 7f1d31d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 0x7f1d34066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d3405be80 0x7f1d340a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d32d9d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d3413bc90 0x7f1d34066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3259c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d3405be80 0x7f1d340a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42556/0 (socket says 172.21.15.161:42556) 2020-11-20T11:39:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3259c700 1 -- 172.21.15.161:0/1381551903 learned_addr learned my addr 172.21.15.161:0/1381551903 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:00.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 0x7f1d34066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37092/0 (socket says 172.21.15.161:37092) 2020-11-20T11:39:00.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 -- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d3413bc90 msgr2=0x7f1d34066570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d3413bc90 0x7f1d34066570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 -- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d3405be80 msgr2=0x7f1d340a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d3405be80 0x7f1d340a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d34067fa0 con 0x7f1d340a7610 2020-11-20T11:39:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d31d9b700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 0x7f1d34066080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1d2800c710 tx=0x7f1d28007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28007020 con 0x7f1d340a7610 2020-11-20T11:39:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28007180 con 0x7f1d340a7610 2020-11-20T11:39:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3409d4e0 con 0x7f1d340a7610 2020-11-20T11:39:00.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280064f0 con 0x7f1d340a7610 2020-11-20T11:39:00.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d34137a80 con 0x7f1d340a7610 2020-11-20T11:39:00.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d34068490 con 0x7f1d340a7610 2020-11-20T11:39:00.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f1d28010030 con 0x7f1d340a7610 2020-11-20T11:39:00.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f1d080557c0 0x7f1d08057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1d2806df00 con 0x7f1d340a7610 2020-11-20T11:39:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3259c700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f1d080557c0 0x7f1d08057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f1d0805d320 0x7f1d0805f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d0805fda0 con 0x7f1d0805d320 2020-11-20T11:39:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d28070570 con 0x7f1d340a7610 2020-11-20T11:39:00.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d3259c700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f1d080557c0 0x7f1d08057c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d24003810 tx=0x7f1d24007c40).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.083+0000 7f1d32d9d700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f1d0805d320 0x7f1d0805f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.087+0000 7f1d32d9d700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f1d0805d320 0x7f1d0805f740 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.087+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== osd.6 v2:172.21.15.186:6800/14936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f1d0805fda0 con 0x7f1d0805d320 2020-11-20T11:39:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.107+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 --> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d34069250 con 0x7f1d0805d320 2020-11-20T11:39:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d227fc700 1 -- 172.21.15.161:0/1381551903 <== osd.6 v2:172.21.15.186:6800/14936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d34069250 con 0x7f1d0805d320 2020-11-20T11:39:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f1d0805d320 msgr2=0x7f1d0805f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f1d0805d320 0x7f1d0805f740 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f1d080557c0 msgr2=0x7f1d08057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f1d080557c0 0x7f1d08057c80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1d24003810 tx=0x7f1d24007c40).stop 2020-11-20T11:39:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 msgr2=0x7f1d34066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 --2- 172.21.15.161:0/1381551903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d340a7610 0x7f1d34066080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f1d2800c710 tx=0x7f1d28007b90).stop 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d32d9d700 1 -- 172.21.15.161:0/1381551903 reap_dead start 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 shutdown_connections 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 >> 172.21.15.161:0/1381551903 conn(0x7f1d340ad620 msgr2=0x7f1d340abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 shutdown_connections 2020-11-20T11:39:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.111+0000 7f1d3359e700 1 -- 172.21.15.161:0/1381551903 wait complete. 2020-11-20T11:39:00.128 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:00.128 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T11:39:00.153 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:00.180 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:00.256 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 Processor -- start 2020-11-20T11:39:00.256 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- start start 2020-11-20T11:39:00.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340a4a50 0x7fa8340ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8340adab0 0x7fa834137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8340a8f40 con 0x7fa8340ab1b0 2020-11-20T11:39:00.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8340a91e0 con 0x7fa8340adab0 2020-11-20T11:39:00.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340a9480 con 0x7fa8340a4a50 2020-11-20T11:39:00.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8340adab0 0x7fa834137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8340adab0 0x7fa834137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37102/0 (socket says 172.21.15.161:37102) 2020-11-20T11:39:00.260 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83916f700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa8340ab1b0 0x7fa8341375e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47342/0 (socket says 172.21.15.161:47342) 2020-11-20T11:39:00.260 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 -- 172.21.15.161:0/3992510383 learned_addr learned my addr 172.21.15.161:0/3992510383 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:00.260 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa839970700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340a4a50 0x7fa8340ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.260 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 -- 172.21.15.161:0/3992510383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340a4a50 msgr2=0x7fa8340ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:00.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340a4a50 0x7fa8340ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 -- 172.21.15.161:0/3992510383 >> v1:172.21.15.161:6789/0 conn(0x7fa8340ab1b0 legacy=0x7fa8341375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83896e700 1 -- 172.21.15.161:0/3992510383 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361251743 0 0) 0x7fa8340a8f40 con 0x7fa8340ab1b0 2020-11-20T11:39:00.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 -- 172.21.15.161:0/3992510383 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8340a4e30 con 0x7fa8340adab0 2020-11-20T11:39:00.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83a171700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340adab0 0x7fa834137cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa82c009d50 tx=0x7fa82c009290).ready entity=mon.0 client_cookie=beea9ae53d1707dd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83896e700 1 -- 172.21.15.161:0/3992510383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c00bbc0 con 0x7fa8340adab0 2020-11-20T11:39:00.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83896e700 1 -- 172.21.15.161:0/3992510383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c00bd20 con 0x7fa8340adab0 2020-11-20T11:39:00.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83896e700 1 -- 172.21.15.161:0/3992510383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c011610 con 0x7fa8340adab0 2020-11-20T11:39:00.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- 172.21.15.161:0/3992510383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340adab0 msgr2=0x7fa834137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340adab0 0x7fa834137cf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa82c009d50 tx=0x7fa82c009290).stop 2020-11-20T11:39:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- 172.21.15.161:0/3992510383 shutdown_connections 2020-11-20T11:39:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340adab0 0x7fa834137cf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/3992510383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340a4a50 0x7fa8340ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- 172.21.15.161:0/3992510383 >> 172.21.15.161:0/3992510383 conn(0x7fa834067880 msgr2=0x7fa834067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- 172.21.15.161:0/3992510383 shutdown_connections 2020-11-20T11:39:00.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.255+0000 7fa83bbd4700 1 -- 172.21.15.161:0/3992510383 wait complete. 2020-11-20T11:39:00.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 Processor -- start 2020-11-20T11:39:00.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- start start 2020-11-20T11:39:00.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 0x7fa83413b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8340ab1b0 0x7fa83413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340adab0 0x7fa8340a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83413c1e0 con 0x7fa8340a4a50 2020-11-20T11:39:00.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83413c480 con 0x7fa8340ab1b0 2020-11-20T11:39:00.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83413c720 con 0x7fa8340adab0 2020-11-20T11:39:00.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 0x7fa83413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 0x7fa83413b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37104/0 (socket says 172.21.15.161:37104) 2020-11-20T11:39:00.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 -- 172.21.15.161:0/481133750 learned_addr learned my addr 172.21.15.161:0/481133750 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:00.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83a171700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340adab0 0x7fa8340a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83916f700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8340ab1b0 0x7fa83413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 -- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340adab0 msgr2=0x7fa8340a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8340adab0 0x7fa8340a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 -- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8340ab1b0 msgr2=0x7fa83413dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8340ab1b0 0x7fa83413dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83413bf10 con 0x7fa8340a4a50 2020-11-20T11:39:00.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa839970700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 0x7fa83413b350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa82800eba0 tx=0x7fa828006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82800c8e0 con 0x7fa8340a4a50 2020-11-20T11:39:00.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83413e130 con 0x7fa8340a4a50 2020-11-20T11:39:00.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8340a7860 con 0x7fa8340a4a50 2020-11-20T11:39:00.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82800ca40 con 0x7fa8340a4a50 2020-11-20T11:39:00.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.259+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82800cdc0 con 0x7fa8340a4a50 2020-11-20T11:39:00.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8340a7b10 con 0x7fa8340a4a50 2020-11-20T11:39:00.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fa828012600 con 0x7fa8340a4a50 2020-11-20T11:39:00.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fa80c0557c0 0x7fa80c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa82806ebf0 con 0x7fa8340a4a50 2020-11-20T11:39:00.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa83916f700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fa80c0557c0 0x7fa80c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7fa80c05d320 0x7fa80c05f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa80c05fda0 con 0x7fa80c05d320 2020-11-20T11:39:00.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa828071260 con 0x7fa8340a4a50 2020-11-20T11:39:00.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa83a171700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7fa80c05d320 0x7fa80c05f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa83916f700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fa80c0557c0 0x7fa80c057c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa83413b990 tx=0x7fa830007a20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.263+0000 7fa83a171700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7fa80c05d320 0x7fa80c05f740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.267+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== osd.7 v2:172.21.15.186:6824/14945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa80c05fda0 con 0x7fa80c05d320 2020-11-20T11:39:00.290 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 --> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa834069250 con 0x7fa80c05d320 2020-11-20T11:39:00.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa825ffb700 1 -- 172.21.15.161:0/481133750 <== osd.7 v2:172.21.15.186:6824/14945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa834069250 con 0x7fa80c05d320 2020-11-20T11:39:00.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7fa80c05d320 msgr2=0x7fa80c05f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7fa80c05d320 0x7fa80c05f740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fa80c0557c0 msgr2=0x7fa80c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fa80c0557c0 0x7fa80c057c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa83413b990 tx=0x7fa830007a20).stop 2020-11-20T11:39:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 msgr2=0x7fa83413b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.287+0000 7fa83bbd4700 1 --2- 172.21.15.161:0/481133750 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8340a4a50 0x7fa83413b350 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fa82800eba0 tx=0x7fa828006df0).stop 2020-11-20T11:39:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.291+0000 7fa83a171700 1 -- 172.21.15.161:0/481133750 reap_dead start 2020-11-20T11:39:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.291+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 shutdown_connections 2020-11-20T11:39:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.291+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 >> 172.21.15.161:0/481133750 conn(0x7fa834067880 msgr2=0x7fa8340ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.291+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 shutdown_connections 2020-11-20T11:39:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.291+0000 7fa83bbd4700 1 -- 172.21.15.161:0/481133750 wait complete. 2020-11-20T11:39:00.305 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:00.305 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:39:00.481 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 Processor -- start 2020-11-20T11:39:00.481 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 -- start start 2020-11-20T11:39:00.482 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.482 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 0x7f7e740a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.483 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7413ddb0 con 0x7f7e740aaaa0 2020-11-20T11:39:00.483 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7413dfe0 con 0x7f7e740aae80 2020-11-20T11:39:00.483 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7413e280 con 0x7f7e740a85a0 2020-11-20T11:39:00.483 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.484 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e72d9d700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 0x7f7e740a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.484 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7259c700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f7e740aaaa0 0x7f7e7413a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46870/0 (socket says 172.21.15.161:46870) 2020-11-20T11:39:00.484 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/2830155690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44112/0 (socket says 172.21.15.161:44112) 2020-11-20T11:39:00.484 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7259c700 1 -- 172.21.15.161:0/2830155690 learned_addr learned my addr 172.21.15.161:0/2830155690 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:00.486 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 -- 172.21.15.161:0/2830155690 >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 msgr2=0x7f7e740a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:00.486 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/2830155690 >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 0x7f7e740a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.486 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 -- 172.21.15.161:0/2830155690 >> v1:172.21.15.186:6789/0 conn(0x7f7e740aaaa0 legacy=0x7f7e7413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.487 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 -- 172.21.15.161:0/2830155690 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7413e520 con 0x7f7e740a85a0 2020-11-20T11:39:00.487 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e72d9d700 1 --2- 172.21.15.161:0/2830155690 >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 0x7f7e740a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:00.487 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/2830155690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7e6800b9a0 tx=0x7f7e68006df0).ready entity=mon.2 client_cookie=c9004347bc8467d5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.487 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7159a700 1 -- 172.21.15.161:0/2830155690 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680097b0 con 0x7f7e740a85a0 2020-11-20T11:39:00.487 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7159a700 1 -- 172.21.15.161:0/2830155690 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68009910 con 0x7f7e740a85a0 2020-11-20T11:39:00.488 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.479+0000 7f7e7159a700 1 -- 172.21.15.161:0/2830155690 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68009c90 con 0x7f7e740a85a0 2020-11-20T11:39:00.488 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- 172.21.15.161:0/2830155690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 msgr2=0x7f7e740a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.488 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- 172.21.15.161:0/2830155690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7e6800b9a0 tx=0x7f7e68006df0).stop 2020-11-20T11:39:00.488 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- 172.21.15.161:0/2830155690 shutdown_connections 2020-11-20T11:39:00.488 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- 172.21.15.161:0/2830155690 >> v2:172.21.15.186:3300/0 conn(0x7f7e740aae80 0x7f7e740a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.489 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- 172.21.15.161:0/2830155690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e740a7580 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.489 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- 172.21.15.161:0/2830155690 >> 172.21.15.161:0/2830155690 conn(0x7f7e74061aa0 msgr2=0x7f7e74067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.489 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- 172.21.15.161:0/2830155690 shutdown_connections 2020-11-20T11:39:00.489 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- 172.21.15.161:0/2830155690 wait complete. 2020-11-20T11:39:00.490 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 Processor -- start 2020-11-20T11:39:00.490 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- start start 2020-11-20T11:39:00.492 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e7414cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e740aae80 0x7f7e74149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7414d380 con 0x7f7e740aaaa0 2020-11-20T11:39:00.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7414d620 con 0x7f7e740aae80 2020-11-20T11:39:00.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7414d8c0 con 0x7f7e740a85a0 2020-11-20T11:39:00.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37122/0 (socket says 172.21.15.161:37122) 2020-11-20T11:39:00.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 -- 172.21.15.161:0/161309757 learned_addr learned my addr 172.21.15.161:0/161309757 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:00.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e7259c700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e7414cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e72d9d700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e740aae80 0x7f7e74149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 -- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 msgr2=0x7f7e7414cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e7414cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 -- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e740aae80 msgr2=0x7f7e74149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e740aae80 0x7f7e74149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 -- 172.21.15.161:0/161309757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740a1cb0 con 0x7f7e740aaaa0 2020-11-20T11:39:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.483+0000 7f7e71d9b700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7e6800c010 tx=0x7f7e68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011d50 con 0x7f7e740aaaa0 2020-11-20T11:39:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6801e460 con 0x7f7e740aaaa0 2020-11-20T11:39:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6801e800 con 0x7f7e740aaaa0 2020-11-20T11:39:00.497 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740a1f00 con 0x7f7e740aaaa0 2020-11-20T11:39:00.497 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e74149e20 con 0x7f7e740aaaa0 2020-11-20T11:39:00.497 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7414d1d0 con 0x7f7e740aaaa0 2020-11-20T11:39:00.497 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7e6801a040 con 0x7f7e740aaaa0 2020-11-20T11:39:00.497 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 0x7f7e48057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:00.498 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7e6806fdb0 con 0x7f7e740aaaa0 2020-11-20T11:39:00.498 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e7259c700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 0x7f7e48057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:00.498 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.487+0000 7f7e7259c700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 0x7f7e48057c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7e64000bc0 tx=0x7f7e64009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:00.499 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.491+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7e68045af0 con 0x7f7e740aaaa0 2020-11-20T11:39:00.647 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.643+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e74069250 con 0x7f7e740aaaa0 2020-11-20T11:39:00.648 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e627fc700 1 -- 172.21.15.161:0/161309757 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7e68023070 con 0x7f7e740aaaa0 2020-11-20T11:39:00.648 INFO:teuthology.orchestra.run.smithi161.stdout:55834574852 2020-11-20T11:39:00.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 msgr2=0x7f7e48057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 0x7f7e48057c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7e64000bc0 tx=0x7f7e64009040).stop 2020-11-20T11:39:00.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 msgr2=0x7f7e740ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:00.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7e6800c010 tx=0x7f7e68015000).stop 2020-11-20T11:39:00.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 shutdown_connections 2020-11-20T11:39:00.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7e480557c0 0x7f7e48057c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e740aae80 0x7f7e74149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e740a85a0 0x7f7e7414cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 --2- 172.21.15.161:0/161309757 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e740aaaa0 0x7f7e740ad550 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:00.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 >> 172.21.15.161:0/161309757 conn(0x7f7e74061aa0 msgr2=0x7f7e7413bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:00.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 shutdown_connections 2020-11-20T11:39:00.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:00.647+0000 7f7e7359e700 1 -- 172.21.15.161:0/161309757 wait complete. 2020-11-20T11:39:00.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2020-11-20T11:39:01.663 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T11:39:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.791+0000 7f764b59e700 1 Processor -- start 2020-11-20T11:39:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- start start 2020-11-20T11:39:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f764c0a5d60 0x7f764c0a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0a8bc0 con 0x7f764c0a58e0 2020-11-20T11:39:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c061050 con 0x7f764c0ad620 2020-11-20T11:39:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c060860 con 0x7f764c0a5d60 2020-11-20T11:39:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f764c0a5d60 0x7f764c0a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f764c0a5d60 0x7f764c0a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37132/0 (socket says 172.21.15.161:37132) 2020-11-20T11:39:01.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 -- 172.21.15.161:0/3801070603 learned_addr learned my addr 172.21.15.161:0/3801070603 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 -- 172.21.15.161:0/3801070603 >> v1:172.21.15.186:6789/0 conn(0x7f764c0ad620 legacy=0x7f764c060150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2020-11-20T11:39:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 -- 172.21.15.161:0/3801070603 >> v1:172.21.15.161:6789/0 conn(0x7f764c0a58e0 legacy=0x7f764c0a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 -- 172.21.15.161:0/3801070603 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0a8df0 con 0x7f764c0a5d60 2020-11-20T11:39:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764ad9d700 1 --2- 172.21.15.161:0/3801070603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0a5d60 0x7f764c0a6a30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7644009d50 tx=0x7f7644009290).ready entity=mon.0 client_cookie=7707ad5fd5f20017 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f7649d9b700 1 -- 172.21.15.161:0/3801070603 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400bc40 con 0x7f764c0a5d60 2020-11-20T11:39:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f7649d9b700 1 -- 172.21.15.161:0/3801070603 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764400bda0 con 0x7f764c0a5d60 2020-11-20T11:39:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f7649d9b700 1 -- 172.21.15.161:0/3801070603 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644011610 con 0x7f764c0a5d60 2020-11-20T11:39:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- 172.21.15.161:0/3801070603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0a5d60 msgr2=0x7f764c0a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 --2- 172.21.15.161:0/3801070603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0a5d60 0x7f764c0a6a30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7644009d50 tx=0x7f7644009290).stop 2020-11-20T11:39:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- 172.21.15.161:0/3801070603 shutdown_connections 2020-11-20T11:39:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 --2- 172.21.15.161:0/3801070603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0a5d60 0x7f764c0a6a30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- 172.21.15.161:0/3801070603 >> 172.21.15.161:0/3801070603 conn(0x7f764c0621d0 msgr2=0x7f764c0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- 172.21.15.161:0/3801070603 shutdown_connections 2020-11-20T11:39:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.795+0000 7f764b59e700 1 -- 172.21.15.161:0/3801070603 wait complete. 2020-11-20T11:39:01.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 Processor -- start 2020-11-20T11:39:01.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- start start 2020-11-20T11:39:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c0a58e0 0x7f764c115790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0a5d60 0x7f764c14e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c14ebd0 con 0x7f764c0ad620 2020-11-20T11:39:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c115dc0 con 0x7f764c0a5d60 2020-11-20T11:39:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c116060 con 0x7f764c0a58e0 2020-11-20T11:39:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37138/0 (socket says 172.21.15.161:37138) 2020-11-20T11:39:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 -- 172.21.15.161:0/2479642659 learned_addr learned my addr 172.21.15.161:0/2479642659 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764a59c700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c0a58e0 0x7f764c115790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f7641d9b700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0a5d60 0x7f764c14e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 -- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c0a58e0 msgr2=0x7f764c115790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c0a58e0 0x7f764c115790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 -- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0a5d60 msgr2=0x7f764c14e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0a5d60 0x7f764c14e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 -- 172.21.15.161:0/2479642659 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c116300 con 0x7f764c0ad620 2020-11-20T11:39:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764ad9d700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7644011000 tx=0x7f7644016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764400bc40 con 0x7f764c0ad620 2020-11-20T11:39:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7644011e60 con 0x7f764c0ad620 2020-11-20T11:39:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c116a50 con 0x7f764c0ad620 2020-11-20T11:39:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7644010d10 con 0x7f764c0ad620 2020-11-20T11:39:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.799+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c116f50 con 0x7f764c0ad620 2020-11-20T11:39:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c116490 con 0x7f764c0ad620 2020-11-20T11:39:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7644017070 con 0x7f764c0ad620 2020-11-20T11:39:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f7642ffd700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 0x7f7628057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:01.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7644070b40 con 0x7f764c0ad620 2020-11-20T11:39:01.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f764a59c700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 0x7f7628057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:01.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.803+0000 7f764a59c700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 0x7f7628057c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f763c006fd0 tx=0x7f763c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:01.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.807+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7644046770 con 0x7f764c0ad620 2020-11-20T11:39:01.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.959+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f764c069250 con 0x7f764c0ad620 2020-11-20T11:39:01.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f7642ffd700 1 -- 172.21.15.161:0/2479642659 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7644015030 con 0x7f764c0ad620 2020-11-20T11:39:01.964 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 msgr2=0x7f7628057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 0x7f7628057c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f763c006fd0 tx=0x7f763c008040).stop 2020-11-20T11:39:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 msgr2=0x7f764c14e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7644011000 tx=0x7f7644016000).stop 2020-11-20T11:39:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 shutdown_connections 2020-11-20T11:39:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f76280557c0 0x7f7628057c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f764c0ad620 0x7f764c14e6e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f764c0a58e0 0x7f764c115790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 --2- 172.21.15.161:0/2479642659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f764c0a5d60 0x7f764c14e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 >> 172.21.15.161:0/2479642659 conn(0x7f764c0621d0 msgr2=0x7f764c0a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 shutdown_connections 2020-11-20T11:39:01.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:01.963+0000 7f764b59e700 1 -- 172.21.15.161:0/2479642659 wait complete. 2020-11-20T11:39:01.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2020-11-20T11:39:01.979 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T11:39:02.102 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.099+0000 7f7f57fff700 1 Processor -- start 2020-11-20T11:39:02.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.099+0000 7f7f57fff700 1 -- start start 2020-11-20T11:39:02.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 0x7f7f580a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7f580671d0 0x7f7f58067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f58061160 con 0x7f7f5813a7f0 2020-11-20T11:39:02.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f58061390 con 0x7f7f580671d0 2020-11-20T11:39:02.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58061630 con 0x7f7f580a0990 2020-11-20T11:39:02.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f577fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7f5813a7f0 0x7f7f5813aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47388/0 (socket says 172.21.15.161:47388) 2020-11-20T11:39:02.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f577fe700 1 -- 172.21.15.161:0/2886693252 learned_addr learned my addr 172.21.15.161:0/2886693252 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:02.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/2886693252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 0x7f7f580a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f4e7fc700 1 --2- 172.21.15.161:0/2886693252 >> v2:172.21.15.186:3300/0 conn(0x7f7f580671d0 0x7f7f58067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f567fc700 1 -- 172.21.15.161:0/2886693252 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554733841 0 0) 0x7f7f58061160 con 0x7f7f5813a7f0 2020-11-20T11:39:02.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f567fc700 1 -- 172.21.15.161:0/2886693252 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38003240 con 0x7f7f5813a7f0 2020-11-20T11:39:02.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 -- 172.21.15.161:0/2886693252 >> v2:172.21.15.186:3300/0 conn(0x7f7f580671d0 msgr2=0x7f7f58067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:02.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/2886693252 >> v2:172.21.15.186:3300/0 conn(0x7f7f580671d0 0x7f7f58067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 -- 172.21.15.161:0/2886693252 >> v1:172.21.15.161:6789/0 conn(0x7f7f5813a7f0 legacy=0x7f7f5813aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 -- 172.21.15.161:0/2886693252 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58067b20 con 0x7f7f580a0990 2020-11-20T11:39:02.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/2886693252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 0x7f7f580a0d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7f4800b9a0 tx=0x7f7f48006df0).ready entity=mon.2 client_cookie=54c1c80e29645b95 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f567fc700 1 -- 172.21.15.161:0/2886693252 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48009680 con 0x7f7f580a0990 2020-11-20T11:39:02.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f567fc700 1 -- 172.21.15.161:0/2886693252 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f480097e0 con 0x7f7f580a0990 2020-11-20T11:39:02.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f567fc700 1 -- 172.21.15.161:0/2886693252 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48009b60 con 0x7f7f580a0990 2020-11-20T11:39:02.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- 172.21.15.161:0/2886693252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 msgr2=0x7f7f580a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 --2- 172.21.15.161:0/2886693252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 0x7f7f580a0d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7f4800b9a0 tx=0x7f7f48006df0).stop 2020-11-20T11:39:02.110 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- 172.21.15.161:0/2886693252 shutdown_connections 2020-11-20T11:39:02.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 --2- 172.21.15.161:0/2886693252 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580a0990 0x7f7f580a0d70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 --2- 172.21.15.161:0/2886693252 >> v2:172.21.15.186:3300/0 conn(0x7f7f580671d0 0x7f7f58067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- 172.21.15.161:0/2886693252 >> 172.21.15.161:0/2886693252 conn(0x7f7f580ad5f0 msgr2=0x7f7f580ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- 172.21.15.161:0/2886693252 shutdown_connections 2020-11-20T11:39:02.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.103+0000 7f7f57fff700 1 -- 172.21.15.161:0/2886693252 wait complete. 2020-11-20T11:39:02.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 Processor -- start 2020-11-20T11:39:02.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 -- start start 2020-11-20T11:39:02.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f580a0990 0x7f7f58141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 0x7f7f58138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.114 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580a1660 con 0x7f7f5813a7f0 2020-11-20T11:39:02.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580a37a0 con 0x7f7f580a0990 2020-11-20T11:39:02.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f57fff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580a3a40 con 0x7f7f580671d0 2020-11-20T11:39:02.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f577fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 0x7f7f58138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f577fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 0x7f7f58138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37150/0 (socket says 172.21.15.161:37150) 2020-11-20T11:39:02.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44142/0 (socket says 172.21.15.161:44142) 2020-11-20T11:39:02.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f577fe700 1 -- 172.21.15.161:0/3101030175 learned_addr learned my addr 172.21.15.161:0/3101030175 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:02.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f4e7fc700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f580a0990 0x7f7f58141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 -- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f580a0990 msgr2=0x7f7f58141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f580a0990 0x7f7f58141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 -- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 msgr2=0x7f7f58138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 0x7f7f58138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 -- 172.21.15.161:0/3101030175 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5813bb60 con 0x7f7f580671d0 2020-11-20T11:39:02.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.107+0000 7f7f56ffd700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7f580a9ce0 tx=0x7f7f48015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f48011bc0 con 0x7f7f580671d0 2020-11-20T11:39:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48011d20 con 0x7f7f580671d0 2020-11-20T11:39:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5813bcf0 con 0x7f7f580671d0 2020-11-20T11:39:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4801e670 con 0x7f7f580671d0 2020-11-20T11:39:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581395e0 con 0x7f7f580671d0 2020-11-20T11:39:02.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f581397d0 con 0x7f7f580671d0 2020-11-20T11:39:02.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f7f48025030 con 0x7f7f580671d0 2020-11-20T11:39:02.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 0x7f7f2c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7f4806fde0 con 0x7f7f580671d0 2020-11-20T11:39:02.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4e7fc700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 0x7f7f2c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.111+0000 7f7f4e7fc700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 0x7f7f2c057c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7f580ac3b0 tx=0x7f7f40006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.119+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7f48045ba0 con 0x7f7f580671d0 2020-11-20T11:39:02.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.271+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7f580a35f0 con 0x7f7f580671d0 2020-11-20T11:39:02.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f4f7fe700 1 -- 172.21.15.161:0/3101030175 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f48023020 con 0x7f7f580671d0 2020-11-20T11:39:02.276 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:02.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 msgr2=0x7f7f2c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 0x7f7f2c057c80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7f580ac3b0 tx=0x7f7f40006df0).stop 2020-11-20T11:39:02.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 msgr2=0x7f7f580a3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7f580a9ce0 tx=0x7f7f48015000).stop 2020-11-20T11:39:02.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 shutdown_connections 2020-11-20T11:39:02.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f7f2c0557c0 0x7f7f2c057c80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f5813a7f0 0x7f7f58138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7f580671d0 0x7f7f580a3100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 --2- 172.21.15.161:0/3101030175 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7f580a0990 0x7f7f58141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 >> 172.21.15.161:0/3101030175 conn(0x7f7f580ad5f0 msgr2=0x7f7f58068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 shutdown_connections 2020-11-20T11:39:02.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.275+0000 7f7f57fff700 1 -- 172.21.15.161:0/3101030175 wait complete. 2020-11-20T11:39:02.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2020-11-20T11:39:02.291 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T11:39:02.411 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.407+0000 7f208a259700 1 Processor -- start 2020-11-20T11:39:02.412 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.407+0000 7f208a259700 1 -- start start 2020-11-20T11:39:02.413 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f208413c060 0x7f208413c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.413 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840a8a50 con 0x7f208405bce0 2020-11-20T11:39:02.413 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840a8cb0 con 0x7f208405c0c0 2020-11-20T11:39:02.413 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20840a8f50 con 0x7f208413c060 2020-11-20T11:39:02.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f208413c060 0x7f208413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f208413c060 0x7f208413c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37160/0 (socket says 172.21.15.161:37160) 2020-11-20T11:39:02.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 -- 172.21.15.161:0/725083512 learned_addr learned my addr 172.21.15.161:0/725083512 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:02.415 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 -- 172.21.15.161:0/725083512 >> v1:172.21.15.186:6789/0 conn(0x7f208405c0c0 legacy=0x7f2084065c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 -- 172.21.15.161:0/725083512 >> v1:172.21.15.161:6789/0 conn(0x7f208405bce0 legacy=0x7f20840a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 -- 172.21.15.161:0/725083512 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840a7920 con 0x7f208413c060 2020-11-20T11:39:02.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2089a58700 1 --2- 172.21.15.161:0/725083512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208413c060 0x7f208413c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f207c009d80 tx=0x7f207c009290).ready entity=mon.0 client_cookie=59762967535950c8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2073fff700 1 -- 172.21.15.161:0/725083512 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c00bc40 con 0x7f208413c060 2020-11-20T11:39:02.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2073fff700 1 -- 172.21.15.161:0/725083512 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c00bda0 con 0x7f208413c060 2020-11-20T11:39:02.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f2073fff700 1 -- 172.21.15.161:0/725083512 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c011610 con 0x7f208413c060 2020-11-20T11:39:02.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- 172.21.15.161:0/725083512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208413c060 msgr2=0x7f208413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 --2- 172.21.15.161:0/725083512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208413c060 0x7f208413c510 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f207c009d80 tx=0x7f207c009290).stop 2020-11-20T11:39:02.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- 172.21.15.161:0/725083512 shutdown_connections 2020-11-20T11:39:02.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 --2- 172.21.15.161:0/725083512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208413c060 0x7f208413c510 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- 172.21.15.161:0/725083512 >> 172.21.15.161:0/725083512 conn(0x7f20840ad630 msgr2=0x7f20840ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- 172.21.15.161:0/725083512 shutdown_connections 2020-11-20T11:39:02.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.411+0000 7f208a259700 1 -- 172.21.15.161:0/725083512 wait complete. 2020-11-20T11:39:02.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 Processor -- start 2020-11-20T11:39:02.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- start start 2020-11-20T11:39:02.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f208405c0c0 0x7f2084147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 0x7f20840a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840a4080 con 0x7f208405bce0 2020-11-20T11:39:02.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20840a1640 con 0x7f208405c0c0 2020-11-20T11:39:02.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840a18e0 con 0x7f208413c060 2020-11-20T11:39:02.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37162/0 (socket says 172.21.15.161:37162) 2020-11-20T11:39:02.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 -- 172.21.15.161:0/1890208791 learned_addr learned my addr 172.21.15.161:0/1890208791 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:02.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089a58700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 0x7f20840a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2088a56700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f208405c0c0 0x7f2084147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 -- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 msgr2=0x7f20840a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 0x7f20840a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.423 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 -- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f208405c0c0 msgr2=0x7f2084147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f208405c0c0 0x7f2084147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 -- 172.21.15.161:0/1890208791 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20840a1b80 con 0x7f208405bce0 2020-11-20T11:39:02.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089a58700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 0x7f20840a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:02.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f2089257700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2080001e70 tx=0x7f2080007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080007020 con 0x7f208405bce0 2020-11-20T11:39:02.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080007180 con 0x7f208405bce0 2020-11-20T11:39:02.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084139970 con 0x7f208405bce0 2020-11-20T11:39:02.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000e560 con 0x7f208405bce0 2020-11-20T11:39:02.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208413f840 con 0x7f208405bce0 2020-11-20T11:39:02.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20840ad450 con 0x7f208405bce0 2020-11-20T11:39:02.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f2080010070 con 0x7f208405bce0 2020-11-20T11:39:02.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.415+0000 7f20717fa700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 0x7f205c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.419+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f208006e0d0 con 0x7f208405bce0 2020-11-20T11:39:02.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.419+0000 7f2088a56700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 0x7f205c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.419+0000 7f2088a56700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 0x7f205c057c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2084068950 tx=0x7f2074009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.423+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2080043e90 con 0x7f208405bce0 2020-11-20T11:39:02.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.579+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20840ad450 con 0x7f208405bce0 2020-11-20T11:39:02.583 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.579+0000 7f20717fa700 1 -- 172.21.15.161:0/1890208791 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20840ad450 con 0x7f208405bce0 2020-11-20T11:39:02.583 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:02.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 msgr2=0x7f205c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 0x7f205c057c80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2084068950 tx=0x7f2074009040).stop 2020-11-20T11:39:02.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 msgr2=0x7f20840a2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2080001e70 tx=0x7f2080007c50).stop 2020-11-20T11:39:02.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 shutdown_connections 2020-11-20T11:39:02.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f205c0557c0 0x7f205c057c80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f208413c060 0x7f20840a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208405bce0 0x7f20840a2020 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 --2- 172.21.15.161:0/1890208791 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f208405c0c0 0x7f2084147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 >> 172.21.15.161:0/1890208791 conn(0x7f20840ad630 msgr2=0x7f2084068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 shutdown_connections 2020-11-20T11:39:02.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.583+0000 7f208a259700 1 -- 172.21.15.161:0/1890208791 wait complete. 2020-11-20T11:39:02.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2020-11-20T11:39:02.604 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T11:39:02.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.727+0000 7fb4c352b700 1 Processor -- start 2020-11-20T11:39:02.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.727+0000 7fb4c352b700 1 -- start start 2020-11-20T11:39:02.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 0x7fb4bc0ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc138400 con 0x7fb4bc0adab0 2020-11-20T11:39:02.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0a8f40 con 0x7fb4bc0ab1b0 2020-11-20T11:39:02.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a91e0 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c1ac8700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb4bc0adab0 0x7fb4bc137cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47414/0 (socket says 172.21.15.161:47414) 2020-11-20T11:39:02.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c0ac6700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fb4bc0ab1b0 0x7fb4bc1375e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46928/0 (socket says 172.21.15.161:46928) 2020-11-20T11:39:02.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c1ac8700 1 -- 172.21.15.161:0/1476326374 learned_addr learned my addr 172.21.15.161:0/1476326374 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:02.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/1476326374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 0x7fb4bc0ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924272874 0 0) 0x7fb4bc0a8f40 con 0x7fb4bc0ab1b0 2020-11-20T11:39:02.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4a0003240 con 0x7fb4bc0ab1b0 2020-11-20T11:39:02.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447348088 0 0) 0x7fb4bc138400 con 0x7fb4bc0adab0 2020-11-20T11:39:02.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4bc0a8f40 con 0x7fb4bc0adab0 2020-11-20T11:39:02.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2607646541 0 0) 0x7fb4a0003240 con 0x7fb4bc0ab1b0 2020-11-20T11:39:02.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c12c7700 1 -- 172.21.15.161:0/1476326374 >> v1:172.21.15.186:6789/0 conn(0x7fb4bc0ab1b0 legacy=0x7fb4bc1375e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c12c7700 1 -- 172.21.15.161:0/1476326374 >> v1:172.21.15.161:6789/0 conn(0x7fb4bc0adab0 legacy=0x7fb4bc137cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c12c7700 1 -- 172.21.15.161:0/1476326374 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0a9480 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/1476326374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 0x7fb4bc0ad5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb4b000b950 tx=0x7fb4b0006df0).ready entity=mon.2 client_cookie=1efb0f8b6d874241 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b80014e0 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0011400 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4affff700 1 -- 172.21.15.161:0/1476326374 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011780 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 -- 172.21.15.161:0/1476326374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 msgr2=0x7fb4bc0ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.743 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.731+0000 7fb4c352b700 1 --2- 172.21.15.161:0/1476326374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 0x7fb4bc0ad5c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb4b000b950 tx=0x7fb4b0006df0).stop 2020-11-20T11:39:02.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/1476326374 shutdown_connections 2020-11-20T11:39:02.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 --2- 172.21.15.161:0/1476326374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0a4a50 0x7fb4bc0ad5c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/1476326374 >> 172.21.15.161:0/1476326374 conn(0x7fb4bc067880 msgr2=0x7fb4bc067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.744 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/1476326374 shutdown_connections 2020-11-20T11:39:02.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/1476326374 wait complete. 2020-11-20T11:39:02.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 Processor -- start 2020-11-20T11:39:02.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- start start 2020-11-20T11:39:02.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 0x7fb4bc13ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.745 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 0x7fb4bc14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a5690 con 0x7fb4bc0ab1b0 2020-11-20T11:39:02.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a5900 con 0x7fb4bc0a4a50 2020-11-20T11:39:02.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0a5ba0 con 0x7fb4bc0adab0 2020-11-20T11:39:02.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c0ac6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c0ac6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37178/0 (socket says 172.21.15.161:37178) 2020-11-20T11:39:02.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c0ac6700 1 -- 172.21.15.161:0/4107751001 learned_addr learned my addr 172.21.15.161:0/4107751001 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:02.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 0x7fb4bc14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 0x7fb4bc13ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 -- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 msgr2=0x7fb4bc13ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 0x7fb4bc13ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 -- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 msgr2=0x7fb4bc14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 -- 172.21.15.161:0/4107751001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc13f1f0 con 0x7fb4bc0adab0 2020-11-20T11:39:02.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c0ac6700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:02.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 0x7fb4bc13ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:02.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c1ac8700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 0x7fb4bc14a590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb4b400ca60 tx=0x7fb4b4007d60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400ce40 con 0x7fb4bc0adab0 2020-11-20T11:39:02.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b4005b80 con 0x7fb4bc0adab0 2020-11-20T11:39:02.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4007110 con 0x7fb4bc0adab0 2020-11-20T11:39:02.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0a6040 con 0x7fb4bc0adab0 2020-11-20T11:39:02.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.735+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0a6540 con 0x7fb4bc0adab0 2020-11-20T11:39:02.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fb4b4010030 con 0x7fb4bc0adab0 2020-11-20T11:39:02.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0a5d60 con 0x7fb4bc0adab0 2020-11-20T11:39:02.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4ad7fa700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 0x7fb494057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:02.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb4b406e780 con 0x7fb4bc0adab0 2020-11-20T11:39:02.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 0x7fb494057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:02.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.739+0000 7fb4c12c7700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 0x7fb494057c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb4b000b150 tx=0x7fb4b0015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:02.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.743+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb4b40443b0 con 0x7fb4bc0adab0 2020-11-20T11:39:02.896 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.891+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4bc069250 con 0x7fb4bc0adab0 2020-11-20T11:39:02.896 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4ad7fa700 1 -- 172.21.15.161:0/4107751001 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4b40479d0 con 0x7fb4bc0adab0 2020-11-20T11:39:02.897 INFO:teuthology.orchestra.run.smithi161.stdout:55834574853 2020-11-20T11:39:02.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 msgr2=0x7fb494057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 0x7fb494057c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb4b000b150 tx=0x7fb4b0015000).stop 2020-11-20T11:39:02.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 msgr2=0x7fb4bc14a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:02.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 0x7fb4bc14a590 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb4b400ca60 tx=0x7fb4b4007d60).stop 2020-11-20T11:39:02.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 shutdown_connections 2020-11-20T11:39:02.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fb4940557c0 0x7fb494057c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4bc0adab0 0x7fb4bc14a590 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4bc0a4a50 0x7fb4bc13ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 --2- 172.21.15.161:0/4107751001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4bc0ab1b0 0x7fb4bc14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:02.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 >> 172.21.15.161:0/4107751001 conn(0x7fb4bc067880 msgr2=0x7fb4bc137ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:02.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 shutdown_connections 2020-11-20T11:39:02.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:02.895+0000 7fb4c352b700 1 -- 172.21.15.161:0/4107751001 wait complete. 2020-11-20T11:39:02.911 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2020-11-20T11:39:02.911 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T11:39:03.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 Processor -- start 2020-11-20T11:39:03.041 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- start start 2020-11-20T11:39:03.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcec0b1ee0 0x7efcec13e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7efcec0a9200 0x7efcec13e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcec0a96a0 con 0x7efcec0b1b00 2020-11-20T11:39:03.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec0a9940 con 0x7efcec0b1ee0 2020-11-20T11:39:03.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcec0aaea0 con 0x7efcec0a9200 2020-11-20T11:39:03.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcec0b1ee0 0x7efcec13e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efcec0b1ee0 0x7efcec13e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37184/0 (socket says 172.21.15.161:37184) 2020-11-20T11:39:03.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf2443700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efcec0b1b00 0x7efcec0ab340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47428/0 (socket says 172.21.15.161:47428) 2020-11-20T11:39:03.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 -- 172.21.15.161:0/3252572171 learned_addr learned my addr 172.21.15.161:0/3252572171 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf2c44700 1 --2- 172.21.15.161:0/3252572171 >> v2:172.21.15.186:3300/0 conn(0x7efcec0a9200 0x7efcec13e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 -- 172.21.15.161:0/3252572171 >> v2:172.21.15.186:3300/0 conn(0x7efcec0a9200 msgr2=0x7efcec13e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:03.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 --2- 172.21.15.161:0/3252572171 >> v2:172.21.15.186:3300/0 conn(0x7efcec0a9200 0x7efcec13e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 -- 172.21.15.161:0/3252572171 >> v1:172.21.15.161:6789/0 conn(0x7efcec0b1b00 legacy=0x7efcec0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1441700 1 -- 172.21.15.161:0/3252572171 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413672513 0 0) 0x7efcec0a96a0 con 0x7efcec0b1b00 2020-11-20T11:39:03.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 -- 172.21.15.161:0/3252572171 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec0ad2c0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1c42700 1 --2- 172.21.15.161:0/3252572171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec13e140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcec0aa6c0 tx=0x7efcdc009290).ready entity=mon.0 client_cookie=37a71308150954b2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1441700 1 -- 172.21.15.161:0/3252572171 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00bbc0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1441700 1 -- 172.21.15.161:0/3252572171 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00bd20 con 0x7efcec0b1ee0 2020-11-20T11:39:03.047 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf1441700 1 -- 172.21.15.161:0/3252572171 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc011610 con 0x7efcec0b1ee0 2020-11-20T11:39:03.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- 172.21.15.161:0/3252572171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 msgr2=0x7efcec13e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 --2- 172.21.15.161:0/3252572171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec13e140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7efcec0aa6c0 tx=0x7efcdc009290).stop 2020-11-20T11:39:03.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- 172.21.15.161:0/3252572171 shutdown_connections 2020-11-20T11:39:03.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 --2- 172.21.15.161:0/3252572171 >> v2:172.21.15.186:3300/0 conn(0x7efcec0a9200 0x7efcec13e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 --2- 172.21.15.161:0/3252572171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec13e140 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- 172.21.15.161:0/3252572171 >> 172.21.15.161:0/3252572171 conn(0x7efcec068310 msgr2=0x7efcec0b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.039+0000 7efcf46a7700 1 -- 172.21.15.161:0/3252572171 shutdown_connections 2020-11-20T11:39:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- 172.21.15.161:0/3252572171 wait complete. 2020-11-20T11:39:03.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 Processor -- start 2020-11-20T11:39:03.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- start start 2020-11-20T11:39:03.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 0x7efcec09e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcec0b1b00 0x7efcec14d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec1404e0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcec14d140 con 0x7efcec0b1b00 2020-11-20T11:39:03.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcec14d3e0 con 0x7efcec0a9200 2020-11-20T11:39:03.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37194/0 (socket says 172.21.15.161:37194) 2020-11-20T11:39:03.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 -- 172.21.15.161:0/1974386085 learned_addr learned my addr 172.21.15.161:0/1974386085 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf1c42700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcec0b1b00 0x7efcec14d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2443700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 0x7efcec09e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 -- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 msgr2=0x7efcec09e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 0x7efcec09e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 -- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcec0b1b00 msgr2=0x7efcec14d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcec0b1b00 0x7efcec14d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 -- 172.21.15.161:0/1974386085 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcec13ddf0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2443700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 0x7efcec09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:39:03.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf2c44700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efce800eba0 tx=0x7efce8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800c980 con 0x7efcec0b1ee0 2020-11-20T11:39:03.056 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce800cae0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.056 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcec149ad0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.056 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800ce80 con 0x7efcec0b1ee0 2020-11-20T11:39:03.056 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.043+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcec14df90 con 0x7efcec0b1ee0 2020-11-20T11:39:03.056 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7efce8012600 con 0x7efcec0b1ee0 2020-11-20T11:39:03.057 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcec14d5a0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.057 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efce27fc700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 0x7efcc4057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.057 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efce806eca0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.057 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efcf2443700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 0x7efcc4057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.058 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.047+0000 7efcf2443700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 0x7efcc4057c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7efce4001550 tx=0x7efce4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.058 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.051+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efce8073070 con 0x7efcec0b1ee0 2020-11-20T11:39:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.203+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efcec069250 con 0x7efcec0b1ee0 2020-11-20T11:39:03.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.203+0000 7efce27fc700 1 -- 172.21.15.161:0/1974386085 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efce80449e0 con 0x7efcec0b1ee0 2020-11-20T11:39:03.208 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2020-11-20T11:39:03.211 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 msgr2=0x7efcc4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.211 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 0x7efcc4057c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7efce4001550 tx=0x7efce4009040).stop 2020-11-20T11:39:03.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 msgr2=0x7efcec14a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7efce800eba0 tx=0x7efce8006df0).stop 2020-11-20T11:39:03.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 shutdown_connections 2020-11-20T11:39:03.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efcc40557c0 0x7efcc4057c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efcec0b1ee0 0x7efcec14a010 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efcec0a9200 0x7efcec09e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 --2- 172.21.15.161:0/1974386085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efcec0b1b00 0x7efcec14d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 >> 172.21.15.161:0/1974386085 conn(0x7efcec068310 msgr2=0x7efcec0b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 shutdown_connections 2020-11-20T11:39:03.214 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.207+0000 7efcf46a7700 1 -- 172.21.15.161:0/1974386085 wait complete. 2020-11-20T11:39:03.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2020-11-20T11:39:03.230 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T11:39:03.352 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 Processor -- start 2020-11-20T11:39:03.353 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- start start 2020-11-20T11:39:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55880a4cc0 0x7f55880a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 0x7f558813a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55880a7550 con 0x7f55880a7080 2020-11-20T11:39:03.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880a9fe0 con 0x7f55880a4cc0 2020-11-20T11:39:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55880a58f0 con 0x7f55880a6c00 2020-11-20T11:39:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55880a4cc0 0x7f55880a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55880a4cc0 0x7f55880a8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37198/0 (socket says 172.21.15.161:37198) 2020-11-20T11:39:03.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 -- 172.21.15.161:0/311368773 learned_addr learned my addr 172.21.15.161:0/311368773 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 -- 172.21.15.161:0/311368773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 msgr2=0x7f558813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f5587fff700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 0x7f558813a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 0x7f558813a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.358 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 -- 172.21.15.161:0/311368773 >> v1:172.21.15.161:6789/0 conn(0x7f55880a7080 legacy=0x7f558813add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 -- 172.21.15.161:0/311368773 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880a6760 con 0x7f55880a4cc0 2020-11-20T11:39:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f5587fff700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 0x7f558813a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:39:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558cc9b700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f55880a8c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5578006fd0 tx=0x7f5578006eb0).ready entity=mon.0 client_cookie=a5b4209b92c3b69c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f55877fe700 1 -- 172.21.15.161:0/311368773 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780098d0 con 0x7f55880a4cc0 2020-11-20T11:39:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f55877fe700 1 -- 172.21.15.161:0/311368773 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578009a30 con 0x7f55880a4cc0 2020-11-20T11:39:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f55877fe700 1 -- 172.21.15.161:0/311368773 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578009db0 con 0x7f55880a4cc0 2020-11-20T11:39:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- 172.21.15.161:0/311368773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 msgr2=0x7f55880a8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f55880a8c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f5578006fd0 tx=0x7f5578006eb0).stop 2020-11-20T11:39:03.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- 172.21.15.161:0/311368773 shutdown_connections 2020-11-20T11:39:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f55880a8c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 --2- 172.21.15.161:0/311368773 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a6c00 0x7f558813a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- 172.21.15.161:0/311368773 >> 172.21.15.161:0/311368773 conn(0x7f55880ad6e0 msgr2=0x7f55880adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.361 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- 172.21.15.161:0/311368773 shutdown_connections 2020-11-20T11:39:03.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.351+0000 7f558eeff700 1 -- 172.21.15.161:0/311368773 wait complete. 2020-11-20T11:39:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 Processor -- start 2020-11-20T11:39:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- start start 2020-11-20T11:39:03.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 0x7f5588067580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 0x7f558812fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880a3630 con 0x7f55880a4cc0 2020-11-20T11:39:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880a30f0 con 0x7f55880a6c00 2020-11-20T11:39:03.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55880a3390 con 0x7f55880a7080 2020-11-20T11:39:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37204/0 (socket says 172.21.15.161:37204) 2020-11-20T11:39:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 -- 172.21.15.161:0/738284779 learned_addr learned my addr 172.21.15.161:0/738284779 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f5587fff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 0x7f5588067580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558d49c700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 0x7f558812fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 -- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 msgr2=0x7f558812fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 0x7f558812fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 -- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 msgr2=0x7f5588067580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 0x7f5588067580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 -- 172.21.15.161:0/738284779 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880a2de0 con 0x7f55880a4cc0 2020-11-20T11:39:03.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f5587fff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 0x7f5588067580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:03.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558d49c700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 0x7f558812fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:39:03.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558cc9b700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f557800b1b0 tx=0x7f5578015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557801e460 con 0x7f55880a4cc0 2020-11-20T11:39:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557801e5c0 con 0x7f55880a4cc0 2020-11-20T11:39:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55880a3820 con 0x7f55880a4cc0 2020-11-20T11:39:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557801e960 con 0x7f55880a4cc0 2020-11-20T11:39:03.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.355+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588068240 con 0x7f55880a4cc0 2020-11-20T11:39:03.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f5578025030 con 0x7f55880a4cc0 2020-11-20T11:39:03.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f5584ff9700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 0x7f5560057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f55780700b0 con 0x7f55880a4cc0 2020-11-20T11:39:03.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f5587fff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 0x7f5560057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55880a6960 con 0x7f55880a4cc0 2020-11-20T11:39:03.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.359+0000 7f5587fff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 0x7f5560057c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f557c006fd0 tx=0x7f557c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.363+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f55880a6960 con 0x7f55880a4cc0 2020-11-20T11:39:03.521 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f55880a6960 con 0x7f55880a4cc0 2020-11-20T11:39:03.521 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f5584ff9700 1 -- 172.21.15.161:0/738284779 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f55880a6960 con 0x7f55880a4cc0 2020-11-20T11:39:03.521 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2020-11-20T11:39:03.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 msgr2=0x7f5560057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 0x7f5560057c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f557c006fd0 tx=0x7f557c008040).stop 2020-11-20T11:39:03.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 msgr2=0x7f5588132ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f557800b1b0 tx=0x7f5578015000).stop 2020-11-20T11:39:03.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 shutdown_connections 2020-11-20T11:39:03.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f55600557c0 0x7f5560057c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f55880a7080 0x7f558812fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55880a4cc0 0x7f5588132ae0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 --2- 172.21.15.161:0/738284779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55880a6c00 0x7f5588067580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.525 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 >> 172.21.15.161:0/738284779 conn(0x7f55880ad6e0 msgr2=0x7f5588139e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.525 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 shutdown_connections 2020-11-20T11:39:03.525 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.519+0000 7f558eeff700 1 -- 172.21.15.161:0/738284779 wait complete. 2020-11-20T11:39:03.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2020-11-20T11:39:03.535 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T11:39:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.651+0000 7f6da1aa4700 1 Processor -- start 2020-11-20T11:39:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.651+0000 7f6da1aa4700 1 -- start start 2020-11-20T11:39:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6d9c0a6c90 0x7f6d9c13a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c13a980 0x7f6d9c13ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0a52f0 con 0x7f6d9c0a68b0 2020-11-20T11:39:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c13b320 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da0aa2700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6d9c0a68b0 0x7f6d9c0a7410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47454/0 (socket says 172.21.15.161:47454) 2020-11-20T11:39:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0a4db0 con 0x7f6d9c13a980 2020-11-20T11:39:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da0aa2700 1 -- 172.21.15.161:0/2096814788 learned_addr learned my addr 172.21.15.161:0/2096814788 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 --2- 172.21.15.161:0/2096814788 >> v2:172.21.15.161:3300/0 conn(0x7f6d9c0a6c90 0x7f6d9c13a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da12a3700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c13a980 0x7f6d9c13ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146966239 0 0) 0x7f6d9c0a52f0 con 0x7f6d9c0a68b0 2020-11-20T11:39:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d80003240 con 0x7f6d9c0a68b0 2020-11-20T11:39:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 -- 172.21.15.161:0/2096814788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c13a980 msgr2=0x7f6d9c13ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c13a980 0x7f6d9c13ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 -- 172.21.15.161:0/2096814788 >> v1:172.21.15.161:6789/0 conn(0x7f6d9c0a68b0 legacy=0x7f6d9c0a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1750454567 0 0) 0x7f6d80003240 con 0x7f6d9c0a68b0 2020-11-20T11:39:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 -- 172.21.15.161:0/2096814788 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0a5050 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9bfff700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c0a6c90 0x7f6d9c13a490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6d8800b9a0 tx=0x7f6d88006df0).ready entity=mon.0 client_cookie=7c4bad1a277660e7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900014e0 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d88011400 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6d9b7fe700 1 -- 172.21.15.161:0/2096814788 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88011780 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2096814788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c0a6c90 msgr2=0x7f6d9c13a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c0a6c90 0x7f6d9c13a490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f6d8800b9a0 tx=0x7f6d88006df0).stop 2020-11-20T11:39:03.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2096814788 shutdown_connections 2020-11-20T11:39:03.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c13a980 0x7f6d9c13ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2096814788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c0a6c90 0x7f6d9c13a490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2096814788 >> 172.21.15.161:0/2096814788 conn(0x7f6d9c0ad5f0 msgr2=0x7f6d9c0ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2096814788 shutdown_connections 2020-11-20T11:39:03.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.655+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2096814788 wait complete. 2020-11-20T11:39:03.665 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 Processor -- start 2020-11-20T11:39:03.665 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- start start 2020-11-20T11:39:03.667 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d9c0a68b0 0x7f6d9c1319c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.667 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 0x7f6d9c12f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c068830 con 0x7f6d9c13a980 2020-11-20T11:39:03.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c067e50 con 0x7f6d9c0a68b0 2020-11-20T11:39:03.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0680f0 con 0x7f6d9c0a6c90 2020-11-20T11:39:03.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 0x7f6d9c12f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37220/0 (socket says 172.21.15.161:37220) 2020-11-20T11:39:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 0x7f6d9c12f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44216/0 (socket says 172.21.15.161:44216) 2020-11-20T11:39:03.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 -- 172.21.15.161:0/2439477997 learned_addr learned my addr 172.21.15.161:0/2439477997 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da0aa2700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d9c0a68b0 0x7f6d9c1319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 -- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 msgr2=0x7f6d9c12f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 0x7f6d9c12f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 -- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d9c0a68b0 msgr2=0x7f6d9c1319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d9c0a68b0 0x7f6d9c1319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 -- 172.21.15.161:0/2439477997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c068390 con 0x7f6d9c13a980 2020-11-20T11:39:03.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da12a3700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6d9400ed20 tx=0x7f6d940091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9400cb00 con 0x7f6d9c13a980 2020-11-20T11:39:03.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9400cc60 con 0x7f6d9c13a980 2020-11-20T11:39:03.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c066bd0 con 0x7f6d9c13a980 2020-11-20T11:39:03.672 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d940123f0 con 0x7f6d9c13a980 2020-11-20T11:39:03.672 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.659+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c066f10 con 0x7f6d9c13a980 2020-11-20T11:39:03.672 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c0a9560 con 0x7f6d9c13a980 2020-11-20T11:39:03.672 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6d94022070 con 0x7f6d9c13a980 2020-11-20T11:39:03.672 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6d98ff9700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 0x7f6d74057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6d9406ee90 con 0x7f6d9c13a980 2020-11-20T11:39:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6da0aa2700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 0x7f6d74057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.663+0000 7f6da0aa2700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 0x7f6d74057cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6d900011a0 tx=0x7f6d90001280).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.673 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.667+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6d9c0a9560 con 0x7f6d9c13a980 2020-11-20T11:39:03.826 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.823+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6d9c0a9560 con 0x7f6d9c13a980 2020-11-20T11:39:03.827 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.823+0000 7f6d98ff9700 1 -- 172.21.15.161:0/2439477997 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d9c0a9560 con 0x7f6d9c13a980 2020-11-20T11:39:03.828 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2020-11-20T11:39:03.830 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 msgr2=0x7f6d74057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.830 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 0x7f6d74057cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f6d900011a0 tx=0x7f6d90001280).stop 2020-11-20T11:39:03.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 msgr2=0x7f6d9c12fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6d9400ed20 tx=0x7f6d940091d0).stop 2020-11-20T11:39:03.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 shutdown_connections 2020-11-20T11:39:03.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6d740557f0 0x7f6d74057cb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6d9c13a980 0x7f6d9c12fae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d9c0a68b0 0x7f6d9c1319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.833 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 --2- 172.21.15.161:0/2439477997 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d9c0a6c90 0x7f6d9c12f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.833 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 >> 172.21.15.161:0/2439477997 conn(0x7f6d9c0ad5f0 msgr2=0x7f6d9c0a7330 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.834 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 shutdown_connections 2020-11-20T11:39:03.834 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.827+0000 7f6da1aa4700 1 -- 172.21.15.161:0/2439477997 wait complete. 2020-11-20T11:39:03.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2020-11-20T11:39:03.842 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T11:39:03.967 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.963+0000 7f3ecf59e700 1 Processor -- start 2020-11-20T11:39:03.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.963+0000 7f3ecf59e700 1 -- start start 2020-11-20T11:39:03.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 0x7f3ed00a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 0x7f3ed00a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed013ddb0 con 0x7f3ed00aaaa0 2020-11-20T11:39:03.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed013dfe0 con 0x7f3ed00aae80 2020-11-20T11:39:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed013e280 con 0x7f3ed00a85a0 2020-11-20T11:39:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3eced9d700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 0x7f3ed00a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 0x7f3ed00a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3eced9d700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 0x7f3ed00a7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42698/0 (socket says 172.21.15.161:42698) 2020-11-20T11:39:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3eced9d700 1 -- 172.21.15.161:0/4025124387 learned_addr learned my addr 172.21.15.161:0/4025124387 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ece59c700 1 --1- 172.21.15.161:0/4025124387 >> v1:172.21.15.186:6789/0 conn(0x7f3ed00aaaa0 0x7f3ed013a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46982/0 (socket says 172.21.15.161:46982) 2020-11-20T11:39:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 -- 172.21.15.161:0/4025124387 >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 msgr2=0x7f3ed00a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 --2- 172.21.15.161:0/4025124387 >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 0x7f3ed00a7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 -- 172.21.15.161:0/4025124387 >> v1:172.21.15.186:6789/0 conn(0x7f3ed00aaaa0 legacy=0x7f3ed013a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 -- 172.21.15.161:0/4025124387 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed013e520 con 0x7f3ed00a85a0 2020-11-20T11:39:03.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ec7fff700 1 --2- 172.21.15.161:0/4025124387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 0x7f3ed00a7580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3eb800b9a0 tx=0x7f3eb8006df0).ready entity=mon.2 client_cookie=2ef80342fd5cedd8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecdd9b700 1 -- 172.21.15.161:0/4025124387 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb80097b0 con 0x7f3ed00a85a0 2020-11-20T11:39:03.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecdd9b700 1 -- 172.21.15.161:0/4025124387 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb8009910 con 0x7f3ed00a85a0 2020-11-20T11:39:03.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecdd9b700 1 -- 172.21.15.161:0/4025124387 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8009c90 con 0x7f3ed00a85a0 2020-11-20T11:39:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- 172.21.15.161:0/4025124387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 msgr2=0x7f3ed00a7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.977 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/4025124387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 0x7f3ed00a7580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3eb800b9a0 tx=0x7f3eb8006df0).stop 2020-11-20T11:39:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- 172.21.15.161:0/4025124387 shutdown_connections 2020-11-20T11:39:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/4025124387 >> v2:172.21.15.186:3300/0 conn(0x7f3ed00aae80 0x7f3ed00a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/4025124387 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00a85a0 0x7f3ed00a7580 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- 172.21.15.161:0/4025124387 >> 172.21.15.161:0/4025124387 conn(0x7f3ed0061aa0 msgr2=0x7f3ed0067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:03.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- 172.21.15.161:0/4025124387 shutdown_connections 2020-11-20T11:39:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- 172.21.15.161:0/4025124387 wait complete. 2020-11-20T11:39:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 Processor -- start 2020-11-20T11:39:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.967+0000 7f3ecf59e700 1 -- start start 2020-11-20T11:39:03.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed00a85a0 0x7f3ed0149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00aaaa0 0x7f3ed00a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0147180 con 0x7f3ed00aae80 2020-11-20T11:39:03.980 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0149d00 con 0x7f3ed00a85a0 2020-11-20T11:39:03.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0149fa0 con 0x7f3ed00aaaa0 2020-11-20T11:39:03.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37234/0 (socket says 172.21.15.161:37234) 2020-11-20T11:39:03.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 -- 172.21.15.161:0/2629669877 learned_addr learned my addr 172.21.15.161:0/2629669877 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:03.981 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec7fff700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00aaaa0 0x7f3ed00a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ece59c700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed00a85a0 0x7f3ed0149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 -- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00aaaa0 msgr2=0x7f3ed00a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00aaaa0 0x7f3ed00a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.982 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 -- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed00a85a0 msgr2=0x7f3ed0149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:03.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed00a85a0 0x7f3ed0149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:03.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 -- 172.21.15.161:0/2629669877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed014a240 con 0x7f3ed00aae80 2020-11-20T11:39:03.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3eced9d700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3ec800ec50 tx=0x7f3ec8009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.983 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800c9b0 con 0x7f3ed00aae80 2020-11-20T11:39:03.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800cb10 con 0x7f3ed00aae80 2020-11-20T11:39:03.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed009f4c0 con 0x7f3ed00aae80 2020-11-20T11:39:03.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec80123f0 con 0x7f3ed00aae80 2020-11-20T11:39:03.984 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed009f960 con 0x7f3ed00aae80 2020-11-20T11:39:03.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed014a600 con 0x7f3ed00aae80 2020-11-20T11:39:03.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f3ec8022070 con 0x7f3ed00aae80 2020-11-20T11:39:03.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 0x7f3ea4057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:03.985 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3ec806edc0 con 0x7f3ed00aae80 2020-11-20T11:39:03.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.971+0000 7f3ece59c700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 0x7f3ea4057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:03.986 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.975+0000 7f3ece59c700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 0x7f3ea4057c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3ec00045d0 tx=0x7f3ec0007b80).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:03.987 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:03.975+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3ec8044b00 con 0x7f3ed00aae80 2020-11-20T11:39:04.135 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.131+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3ed014a3d0 con 0x7f3ed00aae80 2020-11-20T11:39:04.135 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.131+0000 7f3ec67fc700 1 -- 172.21.15.161:0/2629669877 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ec8016070 con 0x7f3ed00aae80 2020-11-20T11:39:04.136 INFO:teuthology.orchestra.run.smithi161.stdout:55834574854 2020-11-20T11:39:04.137 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 msgr2=0x7f3ea4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.138 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 0x7f3ea4057c80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f3ec00045d0 tx=0x7f3ec0007b80).stop 2020-11-20T11:39:04.138 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 msgr2=0x7f3ed00a38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.138 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3ec800ec50 tx=0x7f3ec8009290).stop 2020-11-20T11:39:04.138 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 shutdown_connections 2020-11-20T11:39:04.139 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3ea40557c0 0x7f3ea4057c80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.139 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ed00aae80 0x7f3ed00a38d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.139 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ed00a85a0 0x7f3ed0149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.139 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 --2- 172.21.15.161:0/2629669877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ed00aaaa0 0x7f3ed00a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.140 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 >> 172.21.15.161:0/2629669877 conn(0x7f3ed0061aa0 msgr2=0x7f3ed0137820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.140 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 shutdown_connections 2020-11-20T11:39:04.140 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.135+0000 7f3ecf59e700 1 -- 172.21.15.161:0/2629669877 wait complete. 2020-11-20T11:39:04.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2020-11-20T11:39:04.157 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T11:39:04.158 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:39:04.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 Processor -- start 2020-11-20T11:39:04.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 -- start start 2020-11-20T11:39:04.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13580ad620 0x7f13580a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 0x7f13580a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580a9090 con 0x7f13580a7f90 2020-11-20T11:39:04.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13580a7870 con 0x7f13580ad620 2020-11-20T11:39:04.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135f465700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13580a92c0 con 0x7f1358060150 2020-11-20T11:39:04.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13580ad620 0x7f13580a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135ec64700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 0x7f13580a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f13580ad620 0x7f13580a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42708/0 (socket says 172.21.15.161:42708) 2020-11-20T11:39:04.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 -- 172.21.15.161:0/1303701831 learned_addr learned my addr 172.21.15.161:0/1303701831 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:04.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135dc62700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f13580a7f90 0x7f13580a6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:46998/0 (socket says 172.21.15.161:46998) 2020-11-20T11:39:04.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 -- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 msgr2=0x7f13580a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:04.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 0x7f13580a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 -- 172.21.15.161:0/1303701831 >> v1:172.21.15.186:6789/0 conn(0x7f13580a7f90 legacy=0x7f13580a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135e463700 1 -- 172.21.15.161:0/1303701831 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580605e0 con 0x7f13580ad620 2020-11-20T11:39:04.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.275+0000 7f135ec64700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 0x7f13580a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:04.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135e463700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13580ad620 0x7f13580a5df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f134c006fd0 tx=0x7f134c006eb0).ready entity=mon.1 client_cookie=9ea8767e11576a5b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135d461700 1 -- 172.21.15.161:0/1303701831 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c009810 con 0x7f13580ad620 2020-11-20T11:39:04.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135d461700 1 -- 172.21.15.161:0/1303701831 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c009970 con 0x7f13580ad620 2020-11-20T11:39:04.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135d461700 1 -- 172.21.15.161:0/1303701831 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c009cf0 con 0x7f13580ad620 2020-11-20T11:39:04.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13580ad620 msgr2=0x7f13580a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13580ad620 0x7f13580a5df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f134c006fd0 tx=0x7f134c006eb0).stop 2020-11-20T11:39:04.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- 172.21.15.161:0/1303701831 shutdown_connections 2020-11-20T11:39:04.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1358060150 0x7f13580a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- 172.21.15.161:0/1303701831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13580ad620 0x7f13580a5df0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- 172.21.15.161:0/1303701831 >> 172.21.15.161:0/1303701831 conn(0x7f13580621d0 msgr2=0x7f13580acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- 172.21.15.161:0/1303701831 shutdown_connections 2020-11-20T11:39:04.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- 172.21.15.161:0/1303701831 wait complete. 2020-11-20T11:39:04.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 Processor -- start 2020-11-20T11:39:04.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- start start 2020-11-20T11:39:04.289 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 0x7f135811a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.289 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.289 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13580ad620 0x7f1358149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.289 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135811a6e0 con 0x7f13580a7f90 2020-11-20T11:39:04.290 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135814ae90 con 0x7f1358060150 2020-11-20T11:39:04.290 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135f465700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135811ab50 con 0x7f13580ad620 2020-11-20T11:39:04.290 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.290 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37248/0 (socket says 172.21.15.161:37248) 2020-11-20T11:39:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 -- 172.21.15.161:0/507108023 learned_addr learned my addr 172.21.15.161:0/507108023 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135e463700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 0x7f135811a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135ec64700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13580ad620 0x7f1358149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 -- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13580ad620 msgr2=0x7f1358149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.291 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13580ad620 0x7f1358149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 -- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 msgr2=0x7f135811a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 0x7f135811a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 -- 172.21.15.161:0/507108023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135811adf0 con 0x7f13580a7f90 2020-11-20T11:39:04.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135e463700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 0x7f135811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:04.292 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f135dc62700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f135400c710 tx=0x7f1354007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.279+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354007320 con 0x7f13580a7f90 2020-11-20T11:39:04.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354005530 con 0x7f13580a7f90 2020-11-20T11:39:04.293 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135811b090 con 0x7f13580a7f90 2020-11-20T11:39:04.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540058b0 con 0x7f13580a7f90 2020-11-20T11:39:04.294 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1358118dd0 con 0x7f13580a7f90 2020-11-20T11:39:04.295 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135811b220 con 0x7f13580a7f90 2020-11-20T11:39:04.295 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f1354010030 con 0x7f13580a7f90 2020-11-20T11:39:04.297 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f134a7fc700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 0x7f1334057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.297 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f135406e6a0 con 0x7f13580a7f90 2020-11-20T11:39:04.297 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f135e463700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 0x7f1334057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.283+0000 7f135e463700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 0x7f1334057c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f134c00beb0 tx=0x7f134c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.298 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.291+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f13540442d0 con 0x7f13580a7f90 2020-11-20T11:39:04.446 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.443+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f135811d270 con 0x7f13340557c0 2020-11-20T11:39:04.450 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.447+0000 7f134a7fc700 1 -- 172.21.15.161:0/507108023 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82106 (secure 0 0 0) 0x7f135811d270 con 0x7f13340557c0 2020-11-20T11:39:04.452 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 msgr2=0x7f1334057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.453 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 0x7f1334057c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f134c00beb0 tx=0x7f134c015000).stop 2020-11-20T11:39:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 msgr2=0x7f135811cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f135400c710 tx=0x7f1354007c40).stop 2020-11-20T11:39:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 shutdown_connections 2020-11-20T11:39:04.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f13340557c0 0x7f1334057c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f13580ad620 0x7f1358149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1358060150 0x7f135811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 --2- 172.21.15.161:0/507108023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13580a7f90 0x7f135811cbe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 >> 172.21.15.161:0/507108023 conn(0x7f13580621d0 msgr2=0x7f13580aae00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 shutdown_connections 2020-11-20T11:39:04.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.451+0000 7f135f465700 1 -- 172.21.15.161:0/507108023 wait complete. 2020-11-20T11:39:04.456 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2020-11-20T11:39:04.467 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2020-11-20T11:39:04.275172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41088,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":754933632,"statfs":{"total":773094113280,"available":773052039168,"internally_reserved":0,"allocated":2097152,"data_stored":810728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.316264"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.593498+0000","last_change":"2020-11-20T11:38:53.592096+0000","last_active":"2020-11-20T11:38:53.593498+0000","last_peered":"2020-11-20T11:38:53.593498+0000","last_clean":"2020-11-20T11:38:53.593498+0000","last_became_active":"2020-11-20T11:38:53.591457+0000","last_became_peered":"2020-11-20T11:38:53.591457+0000","last_unstale":"2020-11-20T11:38:53.593498+0000","last_undegraded":"2020-11-20T11:38:53.593498+0000","last_fullsized":"2020-11-20T11:38:53.593498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585163+0000","last_change":"2020-11-20T11:38:48.023124+0000","last_active":"2020-11-20T11:38:53.585163+0000","last_peered":"2020-11-20T11:38:53.585163+0000","last_clean":"2020-11-20T11:38:53.585163+0000","last_became_active":"2020-11-20T11:38:48.022698+0000","last_became_peered":"2020-11-20T11:38:48.022698+0000","last_unstale":"2020-11-20T11:38:53.585163+0000","last_undegraded":"2020-11-20T11:38:53.585163+0000","last_fullsized":"2020-11-20T11:38:53.585163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.983365+0000","last_change":"2020-11-20T11:38:50.587036+0000","last_active":"2020-11-20T11:38:53.983365+0000","last_peered":"2020-11-20T11:38:53.983365+0000","last_clean":"2020-11-20T11:38:53.983365+0000","last_became_active":"2020-11-20T11:38:50.586189+0000","last_became_peered":"2020-11-20T11:38:50.586189+0000","last_unstale":"2020-11-20T11:38:53.983365+0000","last_undegraded":"2020-11-20T11:38:53.983365+0000","last_fullsized":"2020-11-20T11:38:53.983365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.599446+0000","last_change":"2020-11-20T11:38:53.598885+0000","last_active":"2020-11-20T11:38:53.599446+0000","last_peered":"2020-11-20T11:38:53.599446+0000","last_clean":"2020-11-20T11:38:53.599446+0000","last_became_active":"2020-11-20T11:38:53.597636+0000","last_became_peered":"2020-11-20T11:38:53.597636+0000","last_unstale":"2020-11-20T11:38:53.599446+0000","last_undegraded":"2020-11-20T11:38:53.599446+0000","last_fullsized":"2020-11-20T11:38:53.599446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582700+0000","last_change":"2020-11-20T11:38:47.415676+0000","last_active":"2020-11-20T11:38:53.582700+0000","last_peered":"2020-11-20T11:38:53.582700+0000","last_clean":"2020-11-20T11:38:53.582700+0000","last_became_active":"2020-11-20T11:38:47.415243+0000","last_became_peered":"2020-11-20T11:38:47.415243+0000","last_unstale":"2020-11-20T11:38:53.582700+0000","last_undegraded":"2020-11-20T11:38:53.582700+0000","last_fullsized":"2020-11-20T11:38:53.582700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.981636+0000","last_change":"2020-11-20T11:38:50.584681+0000","last_active":"2020-11-20T11:38:53.981636+0000","last_peered":"2020-11-20T11:38:53.981636+0000","last_clean":"2020-11-20T11:38:53.981636+0000","last_became_active":"2020-11-20T11:38:50.584020+0000","last_became_peered":"2020-11-20T11:38:50.584020+0000","last_unstale":"2020-11-20T11:38:53.981636+0000","last_undegraded":"2020-11-20T11:38:53.981636+0000","last_fullsized":"2020-11-20T11:38:53.981636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.593474+0000","last_change":"2020-11-20T11:38:53.592129+0000","last_active":"2020-11-20T11:38:53.593474+0000","last_peered":"2020-11-20T11:38:53.593474+0000","last_clean":"2020-11-20T11:38:53.593474+0000","last_became_active":"2020-11-20T11:38:53.591694+0000","last_became_peered":"2020-11-20T11:38:53.591694+0000","last_unstale":"2020-11-20T11:38:53.593474+0000","last_undegraded":"2020-11-20T11:38:53.593474+0000","last_fullsized":"2020-11-20T11:38:53.593474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.596154+0000","last_change":"2020-11-20T11:38:47.412146+0000","last_active":"2020-11-20T11:38:53.596154+0000","last_peered":"2020-11-20T11:38:53.596154+0000","last_clean":"2020-11-20T11:38:53.596154+0000","last_became_active":"2020-11-20T11:38:47.411779+0000","last_became_peered":"2020-11-20T11:38:47.411779+0000","last_unstale":"2020-11-20T11:38:53.596154+0000","last_undegraded":"2020-11-20T11:38:53.596154+0000","last_fullsized":"2020-11-20T11:38:53.596154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.982592+0000","last_change":"2020-11-20T11:38:51.086358+0000","last_active":"2020-11-20T11:38:53.982592+0000","last_peered":"2020-11-20T11:38:53.982592+0000","last_clean":"2020-11-20T11:38:53.982592+0000","last_became_active":"2020-11-20T11:38:51.085703+0000","last_became_peered":"2020-11-20T11:38:51.085703+0000","last_unstale":"2020-11-20T11:38:53.982592+0000","last_undegraded":"2020-11-20T11:38:53.982592+0000","last_fullsized":"2020-11-20T11:38:53.982592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.603823+0000","last_change":"2020-11-20T11:38:53.602580+0000","last_active":"2020-11-20T11:38:53.603823+0000","last_peered":"2020-11-20T11:38:53.603823+0000","last_clean":"2020-11-20T11:38:53.603823+0000","last_became_active":"2020-11-20T11:38:53.601406+0000","last_became_peered":"2020-11-20T11:38:53.601406+0000","last_unstale":"2020-11-20T11:38:53.603823+0000","last_undegraded":"2020-11-20T11:38:53.603823+0000","last_fullsized":"2020-11-20T11:38:53.603823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582779+0000","last_change":"2020-11-20T11:38:47.415730+0000","last_active":"2020-11-20T11:38:53.582779+0000","last_peered":"2020-11-20T11:38:53.582779+0000","last_clean":"2020-11-20T11:38:53.582779+0000","last_became_active":"2020-11-20T11:38:47.415074+0000","last_became_peered":"2020-11-20T11:38:47.415074+0000","last_unstale":"2020-11-20T11:38:53.582779+0000","last_undegraded":"2020-11-20T11:38:53.582779+0000","last_fullsized":"2020-11-20T11:38:53.582779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598756+0000","last_change":"2020-11-20T11:38:42.662573+0000","last_active":"2020-11-20T11:38:53.598756+0000","last_peered":"2020-11-20T11:38:53.598756+0000","last_clean":"2020-11-20T11:38:53.598756+0000","last_became_active":"2020-11-20T11:38:42.661151+0000","last_became_peered":"2020-11-20T11:38:42.661151+0000","last_unstale":"2020-11-20T11:38:53.598756+0000","last_undegraded":"2020-11-20T11:38:53.598756+0000","last_fullsized":"2020-11-20T11:38:53.598756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_clean_scrub_stamp":"2020-11-20T11:38:39.267196+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.971650+0000","last_change":"2020-11-20T11:38:50.576907+0000","last_active":"2020-11-20T11:38:53.971650+0000","last_peered":"2020-11-20T11:38:53.971650+0000","last_clean":"2020-11-20T11:38:53.971650+0000","last_became_active":"2020-11-20T11:38:50.576462+0000","last_became_peered":"2020-11-20T11:38:50.576462+0000","last_unstale":"2020-11-20T11:38:53.971650+0000","last_undegraded":"2020-11-20T11:38:53.971650+0000","last_fullsized":"2020-11-20T11:38:53.971650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.609715+0000","last_change":"2020-11-20T11:38:53.608371+0000","last_active":"2020-11-20T11:38:53.609715+0000","last_peered":"2020-11-20T11:38:53.609715+0000","last_clean":"2020-11-20T11:38:53.609715+0000","last_became_active":"2020-11-20T11:38:53.607661+0000","last_became_peered":"2020-11-20T11:38:53.607661+0000","last_unstale":"2020-11-20T11:38:53.609715+0000","last_undegraded":"2020-11-20T11:38:53.609715+0000","last_fullsized":"2020-11-20T11:38:53.609715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598787+0000","last_change":"2020-11-20T11:38:47.412658+0000","last_active":"2020-11-20T11:38:53.598787+0000","last_peered":"2020-11-20T11:38:53.598787+0000","last_clean":"2020-11-20T11:38:53.598787+0000","last_became_active":"2020-11-20T11:38:47.412241+0000","last_became_peered":"2020-11-20T11:38:47.412241+0000","last_unstale":"2020-11-20T11:38:53.598787+0000","last_undegraded":"2020-11-20T11:38:53.598787+0000","last_fullsized":"2020-11-20T11:38:53.598787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582841+0000","last_change":"2020-11-20T11:38:50.579983+0000","last_active":"2020-11-20T11:38:53.582841+0000","last_peered":"2020-11-20T11:38:53.582841+0000","last_clean":"2020-11-20T11:38:53.582841+0000","last_became_active":"2020-11-20T11:38:50.579603+0000","last_became_peered":"2020-11-20T11:38:50.579603+0000","last_unstale":"2020-11-20T11:38:53.582841+0000","last_undegraded":"2020-11-20T11:38:53.582841+0000","last_fullsized":"2020-11-20T11:38:53.582841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.606442+0000","last_change":"2020-11-20T11:38:53.600590+0000","last_active":"2020-11-20T11:38:53.606442+0000","last_peered":"2020-11-20T11:38:53.606442+0000","last_clean":"2020-11-20T11:38:53.606442+0000","last_became_active":"2020-11-20T11:38:53.599863+0000","last_became_peered":"2020-11-20T11:38:53.599863+0000","last_unstale":"2020-11-20T11:38:53.606442+0000","last_undegraded":"2020-11-20T11:38:53.606442+0000","last_fullsized":"2020-11-20T11:38:53.606442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598714+0000","last_change":"2020-11-20T11:38:48.027432+0000","last_active":"2020-11-20T11:38:53.598714+0000","last_peered":"2020-11-20T11:38:53.598714+0000","last_clean":"2020-11-20T11:38:53.598714+0000","last_became_active":"2020-11-20T11:38:48.026363+0000","last_became_peered":"2020-11-20T11:38:48.026363+0000","last_unstale":"2020-11-20T11:38:53.598714+0000","last_undegraded":"2020-11-20T11:38:53.598714+0000","last_fullsized":"2020-11-20T11:38:53.598714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.980585+0000","last_change":"2020-11-20T11:38:51.087122+0000","last_active":"2020-11-20T11:38:53.980585+0000","last_peered":"2020-11-20T11:38:53.980585+0000","last_clean":"2020-11-20T11:38:53.980585+0000","last_became_active":"2020-11-20T11:38:51.086037+0000","last_became_peered":"2020-11-20T11:38:51.086037+0000","last_unstale":"2020-11-20T11:38:53.980585+0000","last_undegraded":"2020-11-20T11:38:53.980585+0000","last_fullsized":"2020-11-20T11:38:53.980585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.601150+0000","last_change":"2020-11-20T11:38:53.599915+0000","last_active":"2020-11-20T11:38:53.601150+0000","last_peered":"2020-11-20T11:38:53.601150+0000","last_clean":"2020-11-20T11:38:53.601150+0000","last_became_active":"2020-11-20T11:38:53.599001+0000","last_became_peered":"2020-11-20T11:38:53.599001+0000","last_unstale":"2020-11-20T11:38:53.601150+0000","last_undegraded":"2020-11-20T11:38:53.601150+0000","last_fullsized":"2020-11-20T11:38:53.601150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.980349+0000","last_change":"2020-11-20T11:38:51.328159+0000","last_active":"2020-11-20T11:38:53.980349+0000","last_peered":"2020-11-20T11:38:53.980349+0000","last_clean":"2020-11-20T11:38:53.980349+0000","last_became_active":"2020-11-20T11:38:51.327330+0000","last_became_peered":"2020-11-20T11:38:51.327330+0000","last_unstale":"2020-11-20T11:38:53.980349+0000","last_undegraded":"2020-11-20T11:38:53.980349+0000","last_fullsized":"2020-11-20T11:38:53.980349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585363+0000","last_change":"2020-11-20T11:38:47.411462+0000","last_active":"2020-11-20T11:38:53.585363+0000","last_peered":"2020-11-20T11:38:53.585363+0000","last_clean":"2020-11-20T11:38:53.585363+0000","last_became_active":"2020-11-20T11:38:47.411044+0000","last_became_peered":"2020-11-20T11:38:47.411044+0000","last_unstale":"2020-11-20T11:38:53.585363+0000","last_undegraded":"2020-11-20T11:38:53.585363+0000","last_fullsized":"2020-11-20T11:38:53.585363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.604561+0000","last_change":"2020-11-20T11:38:53.602316+0000","last_active":"2020-11-20T11:38:53.604561+0000","last_peered":"2020-11-20T11:38:53.604561+0000","last_clean":"2020-11-20T11:38:53.604561+0000","last_became_active":"2020-11-20T11:38:53.601560+0000","last_became_peered":"2020-11-20T11:38:53.601560+0000","last_unstale":"2020-11-20T11:38:53.604561+0000","last_undegraded":"2020-11-20T11:38:53.604561+0000","last_fullsized":"2020-11-20T11:38:53.604561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.580277+0000","last_change":"2020-11-20T11:38:47.414164+0000","last_active":"2020-11-20T11:38:53.580277+0000","last_peered":"2020-11-20T11:38:53.580277+0000","last_clean":"2020-11-20T11:38:53.580277+0000","last_became_active":"2020-11-20T11:38:47.413633+0000","last_became_peered":"2020-11-20T11:38:47.413633+0000","last_unstale":"2020-11-20T11:38:53.580277+0000","last_undegraded":"2020-11-20T11:38:53.580277+0000","last_fullsized":"2020-11-20T11:38:53.580277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.979543+0000","last_change":"2020-11-20T11:38:50.583562+0000","last_active":"2020-11-20T11:38:53.979543+0000","last_peered":"2020-11-20T11:38:53.979543+0000","last_clean":"2020-11-20T11:38:53.979543+0000","last_became_active":"2020-11-20T11:38:50.583037+0000","last_became_peered":"2020-11-20T11:38:50.583037+0000","last_unstale":"2020-11-20T11:38:53.979543+0000","last_undegraded":"2020-11-20T11:38:53.979543+0000","last_fullsized":"2020-11-20T11:38:53.979543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5128,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366712,"statfs":{"total":96636764160,"available":96631513088,"internally_reserved":0,"allocated":262144,"data_stored":101340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4510000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.129}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.609}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.371}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5120,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366720,"statfs":{"total":96636764160,"available":96631521280,"internally_reserved":0,"allocated":253952,"data_stored":100765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1749999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5579999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2519999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366644,"statfs":{"total":96636764160,"available":96631443456,"internally_reserved":0,"allocated":266240,"data_stored":102300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5124,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366716,"statfs":{"total":96636764160,"available":96631517184,"internally_reserved":0,"allocated":258048,"data_stored":100799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0470000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9220000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.734}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":102300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4820000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9929999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":101500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.323}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8889999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3090000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.117}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5124,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366716,"statfs":{"total":96636764160,"available":96631517184,"internally_reserved":0,"allocated":258048,"data_stored":100799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.946}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8740000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5128,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366712,"statfs":{"total":96636764160,"available":96631513088,"internally_reserved":0,"allocated":262144,"data_stored":100925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6230000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2400000000000002}]}]}]}} 2020-11-20T11:39:04.469 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T11:39:04.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 Processor -- start 2020-11-20T11:39:04.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- start start 2020-11-20T11:39:04.591 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 0x7fc1fc060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc1fc0a5d60 0x7fc1fc142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc0a8bc0 con 0x7fc1fc0a58e0 2020-11-20T11:39:04.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc061050 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a8df0 con 0x7fc1fc0ad620 2020-11-20T11:39:04.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc201a2b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc1fc0a58e0 0x7fc1fc1427f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47500/0 (socket says 172.21.15.161:47500) 2020-11-20T11:39:04.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc201a2b700 1 -- 172.21.15.161:0/3503304971 learned_addr learned my addr 172.21.15.161:0/3503304971 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:04.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc202a2d700 1 --2- 172.21.15.161:0/3503304971 >> v2:172.21.15.186:3300/0 conn(0x7fc1fc0a5d60 0x7fc1fc142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 --2- 172.21.15.161:0/3503304971 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 0x7fc1fc060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20122a700 1 -- 172.21.15.161:0/3503304971 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306322383 0 0) 0x7fc1fc0a8bc0 con 0x7fc1fc0a58e0 2020-11-20T11:39:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20122a700 1 -- 172.21.15.161:0/3503304971 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e4003240 con 0x7fc1fc0a58e0 2020-11-20T11:39:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 -- 172.21.15.161:0/3503304971 >> v2:172.21.15.186:3300/0 conn(0x7fc1fc0a5d60 msgr2=0x7fc1fc142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 --2- 172.21.15.161:0/3503304971 >> v2:172.21.15.186:3300/0 conn(0x7fc1fc0a5d60 0x7fc1fc142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 -- 172.21.15.161:0/3503304971 >> v1:172.21.15.161:6789/0 conn(0x7fc1fc0a58e0 legacy=0x7fc1fc1427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 -- 172.21.15.161:0/3503304971 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc0a9090 con 0x7fc1fc0ad620 2020-11-20T11:39:04.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20222c700 1 --2- 172.21.15.161:0/3503304971 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 0x7fc1fc060150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc1f800b9a0 tx=0x7fc1f8006df0).ready entity=mon.2 client_cookie=4ebf980c4e31b07d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20122a700 1 -- 172.21.15.161:0/3503304971 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8009680 con 0x7fc1fc0ad620 2020-11-20T11:39:04.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20122a700 1 -- 172.21.15.161:0/3503304971 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f80097e0 con 0x7fc1fc0ad620 2020-11-20T11:39:04.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20122a700 1 -- 172.21.15.161:0/3503304971 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8009b60 con 0x7fc1fc0ad620 2020-11-20T11:39:04.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- 172.21.15.161:0/3503304971 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 msgr2=0x7fc1fc060150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 --2- 172.21.15.161:0/3503304971 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 0x7fc1fc060150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc1f800b9a0 tx=0x7fc1f8006df0).stop 2020-11-20T11:39:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- 172.21.15.161:0/3503304971 shutdown_connections 2020-11-20T11:39:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 --2- 172.21.15.161:0/3503304971 >> v2:172.21.15.186:3300/0 conn(0x7fc1fc0a5d60 0x7fc1fc142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 --2- 172.21.15.161:0/3503304971 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0ad620 0x7fc1fc060150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- 172.21.15.161:0/3503304971 >> 172.21.15.161:0/3503304971 conn(0x7fc1fc0621d0 msgr2=0x7fc1fc0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- 172.21.15.161:0/3503304971 shutdown_connections 2020-11-20T11:39:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.587+0000 7fc20322e700 1 -- 172.21.15.161:0/3503304971 wait complete. 2020-11-20T11:39:04.599 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 Processor -- start 2020-11-20T11:39:04.599 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- start start 2020-11-20T11:39:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0a58e0 0x7fc1fc116840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc0ad620 0x7fc1fc14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0a0510 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc1162e0 con 0x7fc1fc0ad620 2020-11-20T11:39:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc115900 con 0x7fc1fc0a58e0 2020-11-20T11:39:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37260/0 (socket says 172.21.15.161:37260) 2020-11-20T11:39:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 -- 172.21.15.161:0/3905806241 learned_addr learned my addr 172.21.15.161:0/3905806241 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc202a2d700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc0ad620 0x7fc1fc14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.602 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20222c700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0a58e0 0x7fc1fc116840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.602 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 -- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0a58e0 msgr2=0x7fc1fc116840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.602 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0a58e0 0x7fc1fc116840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.602 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 -- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc0ad620 msgr2=0x7fc1fc14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.602 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc0ad620 0x7fc1fc14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 -- 172.21.15.161:0/3905806241 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc115ba0 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc201a2b700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc1ec00c710 tx=0x7fc1ec007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0072e0 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec007440 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc115e40 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec005800 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.591+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc115580 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc115fd0 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fc1ec01a060 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc1ea7fc700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 0x7fc1d4057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc1ec06dc30 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc20222c700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 0x7fc1d4057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.595+0000 7fc20222c700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 0x7fc1d4057c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc1f800b150 tx=0x7fc1f8015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.606 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.599+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc1ec043970 con 0x7fc1fc0a5d60 2020-11-20T11:39:04.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.747+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1fc069250 con 0x7fc1d40557c0 2020-11-20T11:39:04.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.751+0000 7fc1ea7fc700 1 -- 172.21.15.161:0/3905806241 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82106 (secure 0 0 0) 0x7fc1fc069250 con 0x7fc1d40557c0 2020-11-20T11:39:04.756 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:04.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 msgr2=0x7fc1d4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 0x7fc1d4057c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc1f800b150 tx=0x7fc1f8015000).stop 2020-11-20T11:39:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 msgr2=0x7fc1fc1185c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc1ec00c710 tx=0x7fc1ec007aa0).stop 2020-11-20T11:39:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 shutdown_connections 2020-11-20T11:39:04.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc1d40557c0 0x7fc1d4057c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc0ad620 0x7fc1fc14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc1fc0a58e0 0x7fc1fc116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 --2- 172.21.15.161:0/3905806241 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc1fc0a5d60 0x7fc1fc1185c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 >> 172.21.15.161:0/3905806241 conn(0x7fc1fc0621d0 msgr2=0x7fc1fc067970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.760 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 shutdown_connections 2020-11-20T11:39:04.760 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.755+0000 7fc20322e700 1 -- 172.21.15.161:0/3905806241 wait complete. 2020-11-20T11:39:04.760 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2020-11-20T11:39:04.771 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2020-11-20T11:39:04.275172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41088,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":38976,"kb_avail":754933632,"statfs":{"total":773094113280,"available":773052039168,"internally_reserved":0,"allocated":2097152,"data_stored":810728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39911424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.316264"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.593498+0000","last_change":"2020-11-20T11:38:53.592096+0000","last_active":"2020-11-20T11:38:53.593498+0000","last_peered":"2020-11-20T11:38:53.593498+0000","last_clean":"2020-11-20T11:38:53.593498+0000","last_became_active":"2020-11-20T11:38:53.591457+0000","last_became_peered":"2020-11-20T11:38:53.591457+0000","last_unstale":"2020-11-20T11:38:53.593498+0000","last_undegraded":"2020-11-20T11:38:53.593498+0000","last_fullsized":"2020-11-20T11:38:53.593498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585163+0000","last_change":"2020-11-20T11:38:48.023124+0000","last_active":"2020-11-20T11:38:53.585163+0000","last_peered":"2020-11-20T11:38:53.585163+0000","last_clean":"2020-11-20T11:38:53.585163+0000","last_became_active":"2020-11-20T11:38:48.022698+0000","last_became_peered":"2020-11-20T11:38:48.022698+0000","last_unstale":"2020-11-20T11:38:53.585163+0000","last_undegraded":"2020-11-20T11:38:53.585163+0000","last_fullsized":"2020-11-20T11:38:53.585163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.983365+0000","last_change":"2020-11-20T11:38:50.587036+0000","last_active":"2020-11-20T11:38:53.983365+0000","last_peered":"2020-11-20T11:38:53.983365+0000","last_clean":"2020-11-20T11:38:53.983365+0000","last_became_active":"2020-11-20T11:38:50.586189+0000","last_became_peered":"2020-11-20T11:38:50.586189+0000","last_unstale":"2020-11-20T11:38:53.983365+0000","last_undegraded":"2020-11-20T11:38:53.983365+0000","last_fullsized":"2020-11-20T11:38:53.983365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.599446+0000","last_change":"2020-11-20T11:38:53.598885+0000","last_active":"2020-11-20T11:38:53.599446+0000","last_peered":"2020-11-20T11:38:53.599446+0000","last_clean":"2020-11-20T11:38:53.599446+0000","last_became_active":"2020-11-20T11:38:53.597636+0000","last_became_peered":"2020-11-20T11:38:53.597636+0000","last_unstale":"2020-11-20T11:38:53.599446+0000","last_undegraded":"2020-11-20T11:38:53.599446+0000","last_fullsized":"2020-11-20T11:38:53.599446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582700+0000","last_change":"2020-11-20T11:38:47.415676+0000","last_active":"2020-11-20T11:38:53.582700+0000","last_peered":"2020-11-20T11:38:53.582700+0000","last_clean":"2020-11-20T11:38:53.582700+0000","last_became_active":"2020-11-20T11:38:47.415243+0000","last_became_peered":"2020-11-20T11:38:47.415243+0000","last_unstale":"2020-11-20T11:38:53.582700+0000","last_undegraded":"2020-11-20T11:38:53.582700+0000","last_fullsized":"2020-11-20T11:38:53.582700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.981636+0000","last_change":"2020-11-20T11:38:50.584681+0000","last_active":"2020-11-20T11:38:53.981636+0000","last_peered":"2020-11-20T11:38:53.981636+0000","last_clean":"2020-11-20T11:38:53.981636+0000","last_became_active":"2020-11-20T11:38:50.584020+0000","last_became_peered":"2020-11-20T11:38:50.584020+0000","last_unstale":"2020-11-20T11:38:53.981636+0000","last_undegraded":"2020-11-20T11:38:53.981636+0000","last_fullsized":"2020-11-20T11:38:53.981636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.593474+0000","last_change":"2020-11-20T11:38:53.592129+0000","last_active":"2020-11-20T11:38:53.593474+0000","last_peered":"2020-11-20T11:38:53.593474+0000","last_clean":"2020-11-20T11:38:53.593474+0000","last_became_active":"2020-11-20T11:38:53.591694+0000","last_became_peered":"2020-11-20T11:38:53.591694+0000","last_unstale":"2020-11-20T11:38:53.593474+0000","last_undegraded":"2020-11-20T11:38:53.593474+0000","last_fullsized":"2020-11-20T11:38:53.593474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.596154+0000","last_change":"2020-11-20T11:38:47.412146+0000","last_active":"2020-11-20T11:38:53.596154+0000","last_peered":"2020-11-20T11:38:53.596154+0000","last_clean":"2020-11-20T11:38:53.596154+0000","last_became_active":"2020-11-20T11:38:47.411779+0000","last_became_peered":"2020-11-20T11:38:47.411779+0000","last_unstale":"2020-11-20T11:38:53.596154+0000","last_undegraded":"2020-11-20T11:38:53.596154+0000","last_fullsized":"2020-11-20T11:38:53.596154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.982592+0000","last_change":"2020-11-20T11:38:51.086358+0000","last_active":"2020-11-20T11:38:53.982592+0000","last_peered":"2020-11-20T11:38:53.982592+0000","last_clean":"2020-11-20T11:38:53.982592+0000","last_became_active":"2020-11-20T11:38:51.085703+0000","last_became_peered":"2020-11-20T11:38:51.085703+0000","last_unstale":"2020-11-20T11:38:53.982592+0000","last_undegraded":"2020-11-20T11:38:53.982592+0000","last_fullsized":"2020-11-20T11:38:53.982592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.603823+0000","last_change":"2020-11-20T11:38:53.602580+0000","last_active":"2020-11-20T11:38:53.603823+0000","last_peered":"2020-11-20T11:38:53.603823+0000","last_clean":"2020-11-20T11:38:53.603823+0000","last_became_active":"2020-11-20T11:38:53.601406+0000","last_became_peered":"2020-11-20T11:38:53.601406+0000","last_unstale":"2020-11-20T11:38:53.603823+0000","last_undegraded":"2020-11-20T11:38:53.603823+0000","last_fullsized":"2020-11-20T11:38:53.603823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582779+0000","last_change":"2020-11-20T11:38:47.415730+0000","last_active":"2020-11-20T11:38:53.582779+0000","last_peered":"2020-11-20T11:38:53.582779+0000","last_clean":"2020-11-20T11:38:53.582779+0000","last_became_active":"2020-11-20T11:38:47.415074+0000","last_became_peered":"2020-11-20T11:38:47.415074+0000","last_unstale":"2020-11-20T11:38:53.582779+0000","last_undegraded":"2020-11-20T11:38:53.582779+0000","last_fullsized":"2020-11-20T11:38:53.582779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598756+0000","last_change":"2020-11-20T11:38:42.662573+0000","last_active":"2020-11-20T11:38:53.598756+0000","last_peered":"2020-11-20T11:38:53.598756+0000","last_clean":"2020-11-20T11:38:53.598756+0000","last_became_active":"2020-11-20T11:38:42.661151+0000","last_became_peered":"2020-11-20T11:38:42.661151+0000","last_unstale":"2020-11-20T11:38:53.598756+0000","last_undegraded":"2020-11-20T11:38:53.598756+0000","last_fullsized":"2020-11-20T11:38:53.598756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_clean_scrub_stamp":"2020-11-20T11:38:39.267196+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.971650+0000","last_change":"2020-11-20T11:38:50.576907+0000","last_active":"2020-11-20T11:38:53.971650+0000","last_peered":"2020-11-20T11:38:53.971650+0000","last_clean":"2020-11-20T11:38:53.971650+0000","last_became_active":"2020-11-20T11:38:50.576462+0000","last_became_peered":"2020-11-20T11:38:50.576462+0000","last_unstale":"2020-11-20T11:38:53.971650+0000","last_undegraded":"2020-11-20T11:38:53.971650+0000","last_fullsized":"2020-11-20T11:38:53.971650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.609715+0000","last_change":"2020-11-20T11:38:53.608371+0000","last_active":"2020-11-20T11:38:53.609715+0000","last_peered":"2020-11-20T11:38:53.609715+0000","last_clean":"2020-11-20T11:38:53.609715+0000","last_became_active":"2020-11-20T11:38:53.607661+0000","last_became_peered":"2020-11-20T11:38:53.607661+0000","last_unstale":"2020-11-20T11:38:53.609715+0000","last_undegraded":"2020-11-20T11:38:53.609715+0000","last_fullsized":"2020-11-20T11:38:53.609715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598787+0000","last_change":"2020-11-20T11:38:47.412658+0000","last_active":"2020-11-20T11:38:53.598787+0000","last_peered":"2020-11-20T11:38:53.598787+0000","last_clean":"2020-11-20T11:38:53.598787+0000","last_became_active":"2020-11-20T11:38:47.412241+0000","last_became_peered":"2020-11-20T11:38:47.412241+0000","last_unstale":"2020-11-20T11:38:53.598787+0000","last_undegraded":"2020-11-20T11:38:53.598787+0000","last_fullsized":"2020-11-20T11:38:53.598787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582841+0000","last_change":"2020-11-20T11:38:50.579983+0000","last_active":"2020-11-20T11:38:53.582841+0000","last_peered":"2020-11-20T11:38:53.582841+0000","last_clean":"2020-11-20T11:38:53.582841+0000","last_became_active":"2020-11-20T11:38:50.579603+0000","last_became_peered":"2020-11-20T11:38:50.579603+0000","last_unstale":"2020-11-20T11:38:53.582841+0000","last_undegraded":"2020-11-20T11:38:53.582841+0000","last_fullsized":"2020-11-20T11:38:53.582841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.606442+0000","last_change":"2020-11-20T11:38:53.600590+0000","last_active":"2020-11-20T11:38:53.606442+0000","last_peered":"2020-11-20T11:38:53.606442+0000","last_clean":"2020-11-20T11:38:53.606442+0000","last_became_active":"2020-11-20T11:38:53.599863+0000","last_became_peered":"2020-11-20T11:38:53.599863+0000","last_unstale":"2020-11-20T11:38:53.606442+0000","last_undegraded":"2020-11-20T11:38:53.606442+0000","last_fullsized":"2020-11-20T11:38:53.606442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598714+0000","last_change":"2020-11-20T11:38:48.027432+0000","last_active":"2020-11-20T11:38:53.598714+0000","last_peered":"2020-11-20T11:38:53.598714+0000","last_clean":"2020-11-20T11:38:53.598714+0000","last_became_active":"2020-11-20T11:38:48.026363+0000","last_became_peered":"2020-11-20T11:38:48.026363+0000","last_unstale":"2020-11-20T11:38:53.598714+0000","last_undegraded":"2020-11-20T11:38:53.598714+0000","last_fullsized":"2020-11-20T11:38:53.598714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.980585+0000","last_change":"2020-11-20T11:38:51.087122+0000","last_active":"2020-11-20T11:38:53.980585+0000","last_peered":"2020-11-20T11:38:53.980585+0000","last_clean":"2020-11-20T11:38:53.980585+0000","last_became_active":"2020-11-20T11:38:51.086037+0000","last_became_peered":"2020-11-20T11:38:51.086037+0000","last_unstale":"2020-11-20T11:38:53.980585+0000","last_undegraded":"2020-11-20T11:38:53.980585+0000","last_fullsized":"2020-11-20T11:38:53.980585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.601150+0000","last_change":"2020-11-20T11:38:53.599915+0000","last_active":"2020-11-20T11:38:53.601150+0000","last_peered":"2020-11-20T11:38:53.601150+0000","last_clean":"2020-11-20T11:38:53.601150+0000","last_became_active":"2020-11-20T11:38:53.599001+0000","last_became_peered":"2020-11-20T11:38:53.599001+0000","last_unstale":"2020-11-20T11:38:53.601150+0000","last_undegraded":"2020-11-20T11:38:53.601150+0000","last_fullsized":"2020-11-20T11:38:53.601150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'6","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.980349+0000","last_change":"2020-11-20T11:38:51.328159+0000","last_active":"2020-11-20T11:38:53.980349+0000","last_peered":"2020-11-20T11:38:53.980349+0000","last_clean":"2020-11-20T11:38:53.980349+0000","last_became_active":"2020-11-20T11:38:51.327330+0000","last_became_peered":"2020-11-20T11:38:51.327330+0000","last_unstale":"2020-11-20T11:38:53.980349+0000","last_undegraded":"2020-11-20T11:38:53.980349+0000","last_fullsized":"2020-11-20T11:38:53.980349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585363+0000","last_change":"2020-11-20T11:38:47.411462+0000","last_active":"2020-11-20T11:38:53.585363+0000","last_peered":"2020-11-20T11:38:53.585363+0000","last_clean":"2020-11-20T11:38:53.585363+0000","last_became_active":"2020-11-20T11:38:47.411044+0000","last_became_peered":"2020-11-20T11:38:47.411044+0000","last_unstale":"2020-11-20T11:38:53.585363+0000","last_undegraded":"2020-11-20T11:38:53.585363+0000","last_fullsized":"2020-11-20T11:38:53.585363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.604561+0000","last_change":"2020-11-20T11:38:53.602316+0000","last_active":"2020-11-20T11:38:53.604561+0000","last_peered":"2020-11-20T11:38:53.604561+0000","last_clean":"2020-11-20T11:38:53.604561+0000","last_became_active":"2020-11-20T11:38:53.601560+0000","last_became_peered":"2020-11-20T11:38:53.601560+0000","last_unstale":"2020-11-20T11:38:53.604561+0000","last_undegraded":"2020-11-20T11:38:53.604561+0000","last_fullsized":"2020-11-20T11:38:53.604561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.580277+0000","last_change":"2020-11-20T11:38:47.414164+0000","last_active":"2020-11-20T11:38:53.580277+0000","last_peered":"2020-11-20T11:38:53.580277+0000","last_clean":"2020-11-20T11:38:53.580277+0000","last_became_active":"2020-11-20T11:38:47.413633+0000","last_became_peered":"2020-11-20T11:38:47.413633+0000","last_unstale":"2020-11-20T11:38:53.580277+0000","last_undegraded":"2020-11-20T11:38:53.580277+0000","last_fullsized":"2020-11-20T11:38:53.580277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T11:38:53.979543+0000","last_change":"2020-11-20T11:38:50.583562+0000","last_active":"2020-11-20T11:38:53.979543+0000","last_peered":"2020-11-20T11:38:53.979543+0000","last_clean":"2020-11-20T11:38:53.979543+0000","last_became_active":"2020-11-20T11:38:50.583037+0000","last_became_peered":"2020-11-20T11:38:50.583037+0000","last_unstale":"2020-11-20T11:38:53.979543+0000","last_undegraded":"2020-11-20T11:38:53.979543+0000","last_fullsized":"2020-11-20T11:38:53.979543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5128,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366712,"statfs":{"total":96636764160,"available":96631513088,"internally_reserved":0,"allocated":262144,"data_stored":101340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.456}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4510000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.129}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.609}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.222}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.371}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5120,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366720,"statfs":{"total":96636764160,"available":96631521280,"internally_reserved":0,"allocated":253952,"data_stored":100765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1749999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0489999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7010000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5579999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2519999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5196,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366644,"statfs":{"total":96636764160,"available":96631443456,"internally_reserved":0,"allocated":266240,"data_stored":102300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5124,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366716,"statfs":{"total":96636764160,"available":96631517184,"internally_reserved":0,"allocated":258048,"data_stored":100799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8260000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.363}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0470000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9220000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.734}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5132,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366708,"statfs":{"total":96636764160,"available":96631508992,"internally_reserved":0,"allocated":266240,"data_stored":102300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0030000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6419999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4820000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9929999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5136,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366704,"statfs":{"total":96636764160,"available":96631504896,"internally_reserved":0,"allocated":270336,"data_stored":101500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.323}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8889999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3090000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.117}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5124,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366716,"statfs":{"total":96636764160,"available":96631517184,"internally_reserved":0,"allocated":258048,"data_stored":100799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.946}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.581}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.464}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8740000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5128,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366712,"statfs":{"total":96636764160,"available":96631513088,"internally_reserved":0,"allocated":262144,"data_stored":100925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.613}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.77}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6230000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4969999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2400000000000002}]}]}]}} 2020-11-20T11:39:04.773 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T11:39:04.773 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T11:39:04.774 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T11:39:04.774 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T11:39:04.894 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 Processor -- start 2020-11-20T11:39:04.895 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 -- start start 2020-11-20T11:39:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84ec0ad620 0x7f84ec060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84ec0a58e0 0x7f84ec1427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.896 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0a8bc0 con 0x7f84ec0a5d60 2020-11-20T11:39:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec061050 con 0x7f84ec0a58e0 2020-11-20T11:39:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ebfff700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0a8df0 con 0x7f84ec0ad620 2020-11-20T11:39:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84eb7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f84ec0a5d60 0x7f84ec142ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47510/0 (socket says 172.21.15.161:47510) 2020-11-20T11:39:04.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84eb7fe700 1 -- 172.21.15.161:0/2206948204 learned_addr learned my addr 172.21.15.161:0/2206948204 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:04.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84ea7fc700 1 --2- 172.21.15.161:0/2206948204 >> v2:172.21.15.161:3300/0 conn(0x7f84ec0a58e0 0x7f84ec1427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84eaffd700 1 --2- 172.21.15.161:0/2206948204 >> v2:172.21.15.186:3300/0 conn(0x7f84ec0ad620 0x7f84ec060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555425012 0 0) 0x7f84ec0a8bc0 con 0x7f84ec0a5d60 2020-11-20T11:39:04.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.891+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d0003240 con 0x7f84ec0a5d60 2020-11-20T11:39:04.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 -- 172.21.15.161:0/2206948204 >> v2:172.21.15.186:3300/0 conn(0x7f84ec0ad620 msgr2=0x7f84ec060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 --2- 172.21.15.161:0/2206948204 >> v2:172.21.15.186:3300/0 conn(0x7f84ec0ad620 0x7f84ec060150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 -- 172.21.15.161:0/2206948204 >> v1:172.21.15.161:6789/0 conn(0x7f84ec0a5d60 legacy=0x7f84ec142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3196399122 0 0) 0x7f84d0003240 con 0x7f84ec0a5d60 2020-11-20T11:39:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 -- 172.21.15.161:0/2206948204 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0a9090 con 0x7f84ec0a58e0 2020-11-20T11:39:04.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 --2- 172.21.15.161:0/2206948204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0a58e0 0x7f84ec1427f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f84ec0aa820 tx=0x7f84dc0091d0).ready entity=mon.0 client_cookie=4a5705b38513d33d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40014e0 con 0x7f84ec0a58e0 2020-11-20T11:39:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc00b6b0 con 0x7f84ec0a58e0 2020-11-20T11:39:04.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84e9ffb700 1 -- 172.21.15.161:0/2206948204 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00ba30 con 0x7f84ec0a58e0 2020-11-20T11:39:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- 172.21.15.161:0/2206948204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0a58e0 msgr2=0x7f84ec1427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.902 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- 172.21.15.161:0/2206948204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0a58e0 0x7f84ec1427f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f84ec0aa820 tx=0x7f84dc0091d0).stop 2020-11-20T11:39:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- 172.21.15.161:0/2206948204 shutdown_connections 2020-11-20T11:39:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- 172.21.15.161:0/2206948204 >> v2:172.21.15.186:3300/0 conn(0x7f84ec0ad620 0x7f84ec060150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- 172.21.15.161:0/2206948204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0a58e0 0x7f84ec1427f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.903 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- 172.21.15.161:0/2206948204 >> 172.21.15.161:0/2206948204 conn(0x7f84ec0621d0 msgr2=0x7f84ec0acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- 172.21.15.161:0/2206948204 shutdown_connections 2020-11-20T11:39:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- 172.21.15.161:0/2206948204 wait complete. 2020-11-20T11:39:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 Processor -- start 2020-11-20T11:39:04.904 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- start start 2020-11-20T11:39:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec0a58e0 0x7f84ec0a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 0x7f84ec13fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0a1820 con 0x7f84ec0ad620 2020-11-20T11:39:04.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0a1ac0 con 0x7f84ec0a5d60 2020-11-20T11:39:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ebfff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0a1d60 con 0x7f84ec0a58e0 2020-11-20T11:39:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37276/0 (socket says 172.21.15.161:37276) 2020-11-20T11:39:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 -- 172.21.15.161:0/943843500 learned_addr learned my addr 172.21.15.161:0/943843500 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:04.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 0x7f84ec13fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eaffd700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec0a58e0 0x7f84ec0a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 -- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec0a58e0 msgr2=0x7f84ec0a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec0a58e0 0x7f84ec0a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 -- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 msgr2=0x7f84ec13fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:04.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 0x7f84ec13fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:04.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84eb7fe700 1 -- 172.21.15.161:0/943843500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec140230 con 0x7f84ec0ad620 2020-11-20T11:39:04.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.895+0000 7f84ea7fc700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 0x7f84ec13fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:04.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84eb7fe700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f84e400cae0 tx=0x7f84e4001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e4007170 con 0x7f84ec0ad620 2020-11-20T11:39:04.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40072d0 con 0x7f84ec0ad620 2020-11-20T11:39:04.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400a960 con 0x7f84ec0ad620 2020-11-20T11:39:04.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec0a0ca0 con 0x7f84ec0ad620 2020-11-20T11:39:04.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec09e360 con 0x7f84ec0ad620 2020-11-20T11:39:04.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec09e640 con 0x7f84ec0ad620 2020-11-20T11:39:04.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f84e4010070 con 0x7f84ec0ad620 2020-11-20T11:39:04.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 0x7f84bc057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:04.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f84e406e2a0 con 0x7f84ec0ad620 2020-11-20T11:39:04.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.899+0000 7f84eaffd700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 0x7f84bc057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:04.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.903+0000 7f84eaffd700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 0x7f84bc057c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f84d4006fd0 tx=0x7f84d4006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:04.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:04.907+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f84e4043fe0 con 0x7f84ec0ad620 2020-11-20T11:39:05.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.111+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f84ec0a2420 con 0x7f84ec0ad620 2020-11-20T11:39:05.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.111+0000 7f84e2ffd700 1 -- 172.21.15.161:0/943843500 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f84e4047600 con 0x7f84ec0ad620 2020-11-20T11:39:05.116 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:05.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 msgr2=0x7f84bc057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 0x7f84bc057c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f84d4006fd0 tx=0x7f84d4006df0).stop 2020-11-20T11:39:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 msgr2=0x7f84ec13e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f84e400cae0 tx=0x7f84e4001280).stop 2020-11-20T11:39:05.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 shutdown_connections 2020-11-20T11:39:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f84bc0557c0 0x7f84bc057c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84ec0ad620 0x7f84ec13e730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84ec0a58e0 0x7f84ec0a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 --2- 172.21.15.161:0/943843500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84ec0a5d60 0x7f84ec13fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 >> 172.21.15.161:0/943843500 conn(0x7f84ec0621d0 msgr2=0x7f84ec0aab80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 shutdown_connections 2020-11-20T11:39:05.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.115+0000 7f84ebfff700 1 -- 172.21.15.161:0/943843500 wait complete. 2020-11-20T11:39:05.135 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T11:39:05.135 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T11:39:05.136 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:39:05.256 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.251+0000 7f06b69de700 1 Processor -- start 2020-11-20T11:39:05.256 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.251+0000 7f06b69de700 1 -- start start 2020-11-20T11:39:05.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 0x7f06b00671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06b0137b50 0x7f06b0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b01384f0 con 0x7f06b0065b30 2020-11-20T11:39:05.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b00679f0 con 0x7f06b0137b50 2020-11-20T11:39:05.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0067750 con 0x7f06b00ad6f0 2020-11-20T11:39:05.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06b0137b50 0x7f06b0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06b0137b50 0x7f06b0138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37286/0 (socket says 172.21.15.161:37286) 2020-11-20T11:39:05.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 -- 172.21.15.161:0/3370254401 learned_addr learned my addr 172.21.15.161:0/3370254401 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:05.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06affff700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 0x7f06b00671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 -- 172.21.15.161:0/3370254401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 msgr2=0x7f06b00671a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:05.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 0x7f06b00671a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 -- 172.21.15.161:0/3370254401 >> v1:172.21.15.186:6789/0 conn(0x7f06b0065b30 legacy=0x7f06b00a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:05.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 -- 172.21.15.161:0/3370254401 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b00a8be0 con 0x7f06b0137b50 2020-11-20T11:39:05.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06affff700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 0x7f06b00671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:05.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b4f7b700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b0138000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f06a8009d50 tx=0x7f06a8009290).ready entity=mon.0 client_cookie=a0fa22c2081a0464 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06af7fe700 1 -- 172.21.15.161:0/3370254401 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a800bc40 con 0x7f06b0137b50 2020-11-20T11:39:05.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06af7fe700 1 -- 172.21.15.161:0/3370254401 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a800bda0 con 0x7f06b0137b50 2020-11-20T11:39:05.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06af7fe700 1 -- 172.21.15.161:0/3370254401 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8011610 con 0x7f06b0137b50 2020-11-20T11:39:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- 172.21.15.161:0/3370254401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 msgr2=0x7f06b0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b0138000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f06a8009d50 tx=0x7f06a8009290).stop 2020-11-20T11:39:05.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- 172.21.15.161:0/3370254401 shutdown_connections 2020-11-20T11:39:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b0138000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.272 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 --2- 172.21.15.161:0/3370254401 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b00ad6f0 0x7f06b00671a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.273 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- 172.21.15.161:0/3370254401 >> 172.21.15.161:0/3370254401 conn(0x7f06b0060c20 msgr2=0x7f06b00ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.273 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- 172.21.15.161:0/3370254401 shutdown_connections 2020-11-20T11:39:05.273 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- 172.21.15.161:0/3370254401 wait complete. 2020-11-20T11:39:05.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 Processor -- start 2020-11-20T11:39:05.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.255+0000 7f06b69de700 1 -- start start 2020-11-20T11:39:05.274 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b0065b30 0x7f06b009e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06b00ad6f0 0x7f06b013afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.275 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b013a6c0 con 0x7f06b0137b50 2020-11-20T11:39:05.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0139ce0 con 0x7f06b00ad6f0 2020-11-20T11:39:05.276 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b0139f80 con 0x7f06b0065b30 2020-11-20T11:39:05.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.277 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37292/0 (socket says 172.21.15.161:37292) 2020-11-20T11:39:05.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 -- 172.21.15.161:0/2652518491 learned_addr learned my addr 172.21.15.161:0/2652518491 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:05.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06a7fff700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06b00ad6f0 0x7f06b013afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.278 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06affff700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b0065b30 0x7f06b009e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 -- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b0065b30 msgr2=0x7f06b009e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.279 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b0065b30 0x7f06b009e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 -- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06b00ad6f0 msgr2=0x7f06b013afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.280 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06b00ad6f0 0x7f06b013afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 -- 172.21.15.161:0/2652518491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b013a220 con 0x7f06b0137b50 2020-11-20T11:39:05.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b4f7b700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f06a80092d0 tx=0x7f06a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.281 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8003290 con 0x7f06b0137b50 2020-11-20T11:39:05.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a8009e90 con 0x7f06b0137b50 2020-11-20T11:39:05.282 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b01399d0 con 0x7f06b0137b50 2020-11-20T11:39:05.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a8010cd0 con 0x7f06b0137b50 2020-11-20T11:39:05.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b0146ab0 con 0x7f06b0137b50 2020-11-20T11:39:05.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b013e940 con 0x7f06b0137b50 2020-11-20T11:39:05.284 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.259+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f06a8023030 con 0x7f06b0137b50 2020-11-20T11:39:05.284 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.263+0000 7f06acff9700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 0x7f068c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.263+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f06a806ffe0 con 0x7f06b0137b50 2020-11-20T11:39:05.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.263+0000 7f06affff700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 0x7f068c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.263+0000 7f06affff700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 0x7f068c057c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f06a000ba80 tx=0x7f06a0008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.267+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f06a8045d20 con 0x7f06b0137b50 2020-11-20T11:39:05.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.423+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06b013a3b0 con 0x7f06b0137b50 2020-11-20T11:39:05.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06acff9700 1 -- 172.21.15.161:0/2652518491 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f06a8021020 con 0x7f06b0137b50 2020-11-20T11:39:05.428 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:05.429 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:39:05.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 msgr2=0x7f068c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 0x7f068c057c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f06a000ba80 tx=0x7f06a0008040).stop 2020-11-20T11:39:05.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 msgr2=0x7f06b01465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f06a80092d0 tx=0x7f06a8016000).stop 2020-11-20T11:39:05.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 shutdown_connections 2020-11-20T11:39:05.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f068c0557c0 0x7f068c057c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06b0137b50 0x7f06b01465c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06b0065b30 0x7f06b009e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 --2- 172.21.15.161:0/2652518491 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06b00ad6f0 0x7f06b013afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 >> 172.21.15.161:0/2652518491 conn(0x7f06b0060c20 msgr2=0x7f06b00aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.432 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 shutdown_connections 2020-11-20T11:39:05.433 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.427+0000 7f06b69de700 1 -- 172.21.15.161:0/2652518491 wait complete. 2020-11-20T11:39:05.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:38:38.321980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:38:45.546076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:38:49.160214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:38:51.610748+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:39:05.445 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:39:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.571+0000 7f8171854700 1 Processor -- start 2020-11-20T11:39:05.576 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.571+0000 7f8171854700 1 -- start start 2020-11-20T11:39:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0adf30 0x7f816c0a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f816c0a8dd0 0x7f816c0a9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.578 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f816c067160 con 0x7f816c134430 2020-11-20T11:39:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f816c134ff0 con 0x7f816c0a8dd0 2020-11-20T11:39:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816c067400 con 0x7f816c0adf30 2020-11-20T11:39:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171053700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f816c134430 0x7f816c1348e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47542/0 (socket says 172.21.15.161:47542) 2020-11-20T11:39:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171053700 1 -- 172.21.15.161:0/1468764081 learned_addr learned my addr 172.21.15.161:0/1468764081 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:05.579 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 --2- 172.21.15.161:0/1468764081 >> v2:172.21.15.186:3300/0 conn(0x7f816c0a8dd0 0x7f816c0a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8170852700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0adf30 0x7f816c0a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816b7fe700 1 -- 172.21.15.161:0/1468764081 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641478370 0 0) 0x7f816c067160 con 0x7f816c134430 2020-11-20T11:39:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816b7fe700 1 -- 172.21.15.161:0/1468764081 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8158003240 con 0x7f816c134430 2020-11-20T11:39:05.580 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 -- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0adf30 msgr2=0x7f816c0a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:05.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0adf30 0x7f816c0a9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 -- 172.21.15.161:0/1468764081 >> v1:172.21.15.161:6789/0 conn(0x7f816c134430 legacy=0x7f816c1348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 -- 172.21.15.161:0/1468764081 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c0676a0 con 0x7f816c0a8dd0 2020-11-20T11:39:05.581 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816bfff700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0a8dd0 0x7f816c0a9230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f816000b9a0 tx=0x7f8160006df0).ready entity=mon.1 client_cookie=c713913e8efe5442 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816b7fe700 1 -- 172.21.15.161:0/1468764081 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160009680 con 0x7f816c0a8dd0 2020-11-20T11:39:05.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816b7fe700 1 -- 172.21.15.161:0/1468764081 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81600097e0 con 0x7f816c0a8dd0 2020-11-20T11:39:05.582 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f816b7fe700 1 -- 172.21.15.161:0/1468764081 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160009b60 con 0x7f816c0a8dd0 2020-11-20T11:39:05.585 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0a8dd0 msgr2=0x7f816c0a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0a8dd0 0x7f816c0a9230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f816000b9a0 tx=0x7f8160006df0).stop 2020-11-20T11:39:05.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- 172.21.15.161:0/1468764081 shutdown_connections 2020-11-20T11:39:05.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0adf30 0x7f816c0a9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 --2- 172.21.15.161:0/1468764081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0a8dd0 0x7f816c0a9230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.586 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- 172.21.15.161:0/1468764081 >> 172.21.15.161:0/1468764081 conn(0x7f816c0626c0 msgr2=0x7f816c062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- 172.21.15.161:0/1468764081 shutdown_connections 2020-11-20T11:39:05.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 -- 172.21.15.161:0/1468764081 wait complete. 2020-11-20T11:39:05.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.575+0000 7f8171854700 1 Processor -- start 2020-11-20T11:39:05.587 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- start start 2020-11-20T11:39:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0a8dd0 0x7f816c09d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 0x7f816c0a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0a43f0 con 0x7f816c134430 2020-11-20T11:39:05.588 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0a36b0 con 0x7f816c0adf30 2020-11-20T11:39:05.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816c0a20c0 con 0x7f816c0a8dd0 2020-11-20T11:39:05.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.589 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37306/0 (socket says 172.21.15.161:37306) 2020-11-20T11:39:05.590 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 -- 172.21.15.161:0/3977244903 learned_addr learned my addr 172.21.15.161:0/3977244903 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:05.590 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f816bfff700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 0x7f816c0a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.591 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8170852700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0a8dd0 0x7f816c09d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.591 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 -- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0a8dd0 msgr2=0x7f816c09d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0a8dd0 0x7f816c09d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 -- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 msgr2=0x7f816c0a2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.592 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 0x7f816c0a2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 -- 172.21.15.161:0/3977244903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c0a22f0 con 0x7f816c134430 2020-11-20T11:39:05.593 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f816bfff700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 0x7f816c0a2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:05.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171053700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f816400ca90 tx=0x7f8164007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164005b80 con 0x7f816c134430 2020-11-20T11:39:05.594 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816c0a2590 con 0x7f816c134430 2020-11-20T11:39:05.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8164005ce0 con 0x7f816c134430 2020-11-20T11:39:05.595 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164007360 con 0x7f816c134430 2020-11-20T11:39:05.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816c0a7c90 con 0x7f816c134430 2020-11-20T11:39:05.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.579+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816c044f60 con 0x7f816c134430 2020-11-20T11:39:05.596 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.583+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f8164010030 con 0x7f816c134430 2020-11-20T11:39:05.597 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.583+0000 7f8168ff9700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 0x7f8144057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.597 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.583+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f816406e7f0 con 0x7f816c134430 2020-11-20T11:39:05.598 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.583+0000 7f8170852700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 0x7f8144057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.598 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.583+0000 7f8170852700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 0x7f8144057c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f815c006fd0 tx=0x7f815c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.599 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.591+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8164044530 con 0x7f816c134430 2020-11-20T11:39:05.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.743+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f816c0ab6c0 con 0x7f816c134430 2020-11-20T11:39:05.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.743+0000 7f8168ff9700 1 -- 172.21.15.161:0/3977244903 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f816406ce60 con 0x7f816c134430 2020-11-20T11:39:05.747 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2020-11-20T11:39:05.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 msgr2=0x7f8144057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 0x7f8144057c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f815c006fd0 tx=0x7f815c008040).stop 2020-11-20T11:39:05.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 msgr2=0x7f816c0a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f816400ca90 tx=0x7f8164007da0).stop 2020-11-20T11:39:05.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 shutdown_connections 2020-11-20T11:39:05.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f81440557c0 0x7f8144057c80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f816c134430 0x7f816c0a31c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f816c0a8dd0 0x7f816c09d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 --2- 172.21.15.161:0/3977244903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f816c0adf30 0x7f816c0a2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 >> 172.21.15.161:0/3977244903 conn(0x7f816c0626c0 msgr2=0x7f816c068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 shutdown_connections 2020-11-20T11:39:05.752 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.747+0000 7f8171854700 1 -- 172.21.15.161:0/3977244903 wait complete. 2020-11-20T11:39:05.765 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:39:05.893 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 Processor -- start 2020-11-20T11:39:05.893 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 -- start start 2020-11-20T11:39:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 0x7f03880ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880a95d0 con 0x7f03880adc70 2020-11-20T11:39:05.894 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880aadd0 con 0x7f03880ae050 2020-11-20T11:39:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038cd98700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03880aabe0 con 0x7f03880a9050 2020-11-20T11:39:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038659c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03880adc70 0x7f038813b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47552/0 (socket says 172.21.15.161:47552) 2020-11-20T11:39:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038659c700 1 -- 172.21.15.161:0/2144230222 learned_addr learned my addr 172.21.15.161:0/2144230222 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:05.895 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f0386d9d700 1 --2- 172.21.15.161:0/2144230222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 0x7f03880ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767609829 0 0) 0x7f03880a95d0 con 0x7f03880adc70 2020-11-20T11:39:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f036c003240 con 0x7f03880adc70 2020-11-20T11:39:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f0386d9d700 1 -- 172.21.15.161:0/2144230222 >> v1:172.21.15.186:6789/0 conn(0x7f03880ae050 legacy=0x7f0388143470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f0386d9d700 1 -- 172.21.15.161:0/2144230222 >> v1:172.21.15.161:6789/0 conn(0x7f03880adc70 legacy=0x7f038813b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 138272941 0 0) 0x7f036c003240 con 0x7f03880adc70 2020-11-20T11:39:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f0386d9d700 1 -- 172.21.15.161:0/2144230222 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880a8760 con 0x7f03880a9050 2020-11-20T11:39:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f0386d9d700 1 --2- 172.21.15.161:0/2144230222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 0x7f03880ab270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0380009cc0 tx=0x7f03800091d0).ready entity=mon.2 client_cookie=d8d37d19e629e66a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780014e0 con 0x7f03880a9050 2020-11-20T11:39:05.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038000b7c0 con 0x7f03880a9050 2020-11-20T11:39:05.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.891+0000 7f038559a700 1 -- 172.21.15.161:0/2144230222 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038000bb40 con 0x7f03880a9050 2020-11-20T11:39:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- 172.21.15.161:0/2144230222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 msgr2=0x7f03880ab270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 --2- 172.21.15.161:0/2144230222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 0x7f03880ab270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f0380009cc0 tx=0x7f03800091d0).stop 2020-11-20T11:39:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- 172.21.15.161:0/2144230222 shutdown_connections 2020-11-20T11:39:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 --2- 172.21.15.161:0/2144230222 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880a9050 0x7f03880ab270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- 172.21.15.161:0/2144230222 >> 172.21.15.161:0/2144230222 conn(0x7f0388067880 msgr2=0x7f0388067c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- 172.21.15.161:0/2144230222 shutdown_connections 2020-11-20T11:39:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- 172.21.15.161:0/2144230222 wait complete. 2020-11-20T11:39:05.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 Processor -- start 2020-11-20T11:39:05.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- start start 2020-11-20T11:39:05.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 0x7f03880a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.905 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880adc70 0x7f038814a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03880a8080 con 0x7f03880ae050 2020-11-20T11:39:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038813d210 con 0x7f03880a9050 2020-11-20T11:39:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038cd98700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03880a6670 con 0x7f03880adc70 2020-11-20T11:39:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37320/0 (socket says 172.21.15.161:37320) 2020-11-20T11:39:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 -- 172.21.15.161:0/3146923342 learned_addr learned my addr 172.21.15.161:0/3146923342 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0385d9b700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880adc70 0x7f038814a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f038659c700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 0x7f03880a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 -- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880adc70 msgr2=0x7f038814a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880adc70 0x7f038814a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.895+0000 7f0386d9d700 1 -- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 msgr2=0x7f03880a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f0386d9d700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 0x7f03880a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f0386d9d700 1 -- 172.21.15.161:0/3146923342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0388149cd0 con 0x7f03880ae050 2020-11-20T11:39:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038659c700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 0x7f03880a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f0386d9d700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f03880684a0 tx=0x7f0380016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038001d660 con 0x7f03880ae050 2020-11-20T11:39:05.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038001d7c0 con 0x7f03880ae050 2020-11-20T11:39:05.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0388149f70 con 0x7f03880ae050 2020-11-20T11:39:05.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038001db60 con 0x7f03880ae050 2020-11-20T11:39:05.910 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038814a900 con 0x7f03880ae050 2020-11-20T11:39:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038814ab80 con 0x7f03880ae050 2020-11-20T11:39:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f038002d070 con 0x7f03880ae050 2020-11-20T11:39:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 0x7f035c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0380070e10 con 0x7f03880ae050 2020-11-20T11:39:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038659c700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 0x7f035c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:05.912 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.899+0000 7f038659c700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 0x7f035c057c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0378000bc0 tx=0x7f0378001df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:05.912 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:05.911+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0380046c00 con 0x7f03880ae050 2020-11-20T11:39:06.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.063+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0388069250 con 0x7f03880ae050 2020-11-20T11:39:06.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.063+0000 7f03767fc700 1 -- 172.21.15.161:0/3146923342 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0380021020 con 0x7f03880ae050 2020-11-20T11:39:06.067 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:06.069 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 msgr2=0x7f035c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.069 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 0x7f035c057c80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0378000bc0 tx=0x7f0378001df0).stop 2020-11-20T11:39:06.069 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 msgr2=0x7f03880a6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.070 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f03880684a0 tx=0x7f0380016000).stop 2020-11-20T11:39:06.070 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 shutdown_connections 2020-11-20T11:39:06.070 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f035c0557c0 0x7f035c057c80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.070 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03880ae050 0x7f03880a6fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.070 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f03880a9050 0x7f03880a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.071 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 --2- 172.21.15.161:0/3146923342 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f03880adc70 0x7f038814a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.071 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 >> 172.21.15.161:0/3146923342 conn(0x7f0388067880 msgr2=0x7f03880af920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.071 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 shutdown_connections 2020-11-20T11:39:06.071 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.067+0000 7f038cd98700 1 -- 172.21.15.161:0/3146923342 wait complete. 2020-11-20T11:39:06.082 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:39:06.214 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.211+0000 7f252032c700 1 Processor -- start 2020-11-20T11:39:06.214 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.211+0000 7f252032c700 1 -- start start 2020-11-20T11:39:06.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.211+0000 7f252032c700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2518061300 0x7f25180a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.211+0000 7f252032c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 0x7f2518137650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25180a7740 con 0x7f25180a6f50 2020-11-20T11:39:06.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180a9470 con 0x7f2518061300 2020-11-20T11:39:06.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25180a9710 con 0x7f25180aad70 2020-11-20T11:39:06.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2518061300 0x7f25180a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251d8c7700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 0x7f2518137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2518061300 0x7f25180a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:42792/0 (socket says 172.21.15.161:42792) 2020-11-20T11:39:06.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e8c9700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f25180a6f50 0x7f2518134880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:47084/0 (socket says 172.21.15.161:47084) 2020-11-20T11:39:06.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 -- 172.21.15.161:0/1806794403 learned_addr learned my addr 172.21.15.161:0/1806794403 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:06.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 -- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 msgr2=0x7f2518137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:06.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 0x7f2518137650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 -- 172.21.15.161:0/1806794403 >> v1:172.21.15.186:6789/0 conn(0x7f25180a6f50 legacy=0x7f2518134880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 -- 172.21.15.161:0/1806794403 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25180616e0 con 0x7f2518061300 2020-11-20T11:39:06.220 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251d8c7700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 0x7f2518137650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:06.221 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251e0c8700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2518061300 0x7f25180a9bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2510009d80 tx=0x7f2510009290).ready entity=mon.1 client_cookie=ae927dff6cd4ea9d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.221 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251d0c6700 1 -- 172.21.15.161:0/1806794403 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000bb80 con 0x7f2518061300 2020-11-20T11:39:06.221 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251d0c6700 1 -- 172.21.15.161:0/1806794403 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000bce0 con 0x7f2518061300 2020-11-20T11:39:06.221 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f251d0c6700 1 -- 172.21.15.161:0/1806794403 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510011610 con 0x7f2518061300 2020-11-20T11:39:06.222 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2518061300 msgr2=0x7f25180a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.222 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2518061300 0x7f25180a9bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2510009d80 tx=0x7f2510009290).stop 2020-11-20T11:39:06.222 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- 172.21.15.161:0/1806794403 shutdown_connections 2020-11-20T11:39:06.222 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2518061300 0x7f25180a9bb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.222 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 --2- 172.21.15.161:0/1806794403 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180aad70 0x7f2518137650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.223 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- 172.21.15.161:0/1806794403 >> 172.21.15.161:0/1806794403 conn(0x7f25180ae1b0 msgr2=0x7f25180aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.223 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- 172.21.15.161:0/1806794403 shutdown_connections 2020-11-20T11:39:06.223 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.215+0000 7f252032c700 1 -- 172.21.15.161:0/1806794403 wait complete. 2020-11-20T11:39:06.225 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 Processor -- start 2020-11-20T11:39:06.226 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 -- start start 2020-11-20T11:39:06.226 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 0x7f251809d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.226 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.226 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25180aad70 0x7f2518146a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.227 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518147a60 con 0x7f2518061300 2020-11-20T11:39:06.227 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518065780 con 0x7f25180aad70 2020-11-20T11:39:06.227 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f252032c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518065a20 con 0x7f25180a6f50 2020-11-20T11:39:06.227 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251e0c8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 0x7f251809d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.228 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251d8c7700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.228 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251d8c7700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44326/0 (socket says 172.21.15.161:44326) 2020-11-20T11:39:06.228 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251e0c8700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 0x7f251809d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37330/0 (socket says 172.21.15.161:37330) 2020-11-20T11:39:06.228 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251d8c7700 1 -- 172.21.15.161:0/128371943 learned_addr learned my addr 172.21.15.161:0/128371943 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:06.228 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.219+0000 7f251e8c9700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25180aad70 0x7f2518146a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.229 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 -- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25180aad70 msgr2=0x7f2518146a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.229 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25180aad70 0x7f2518146a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.229 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 -- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 msgr2=0x7f251809d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.229 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 0x7f251809d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 -- 172.21.15.161:0/128371943 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518065cc0 con 0x7f25180a6f50 2020-11-20T11:39:06.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251d8c7700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f250c00ef50 tx=0x7f250c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00cb10 con 0x7f25180a6f50 2020-11-20T11:39:06.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00cc70 con 0x7f25180a6f50 2020-11-20T11:39:06.230 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251813ae60 con 0x7f25180a6f50 2020-11-20T11:39:06.231 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0123f0 con 0x7f25180a6f50 2020-11-20T11:39:06.231 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2518146f80 con 0x7f25180a6f50 2020-11-20T11:39:06.231 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518069250 con 0x7f25180a6f50 2020-11-20T11:39:06.232 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f250c012760 con 0x7f25180a6f50 2020-11-20T11:39:06.232 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 0x7f24f0057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.232 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f250c06f920 con 0x7f25180a6f50 2020-11-20T11:39:06.232 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.223+0000 7f251e0c8700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 0x7f24f0057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.233 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.227+0000 7f251e0c8700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 0x7f24f0057cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2510009eb0 tx=0x7f2510016000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.237 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.235+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f250c045660 con 0x7f25180a6f50 2020-11-20T11:39:06.391 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.387+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25180a7b40 con 0x7f25180a6f50 2020-11-20T11:39:06.392 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f25167fc700 1 -- 172.21.15.161:0/128371943 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f250c048c80 con 0x7f25180a6f50 2020-11-20T11:39:06.392 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:06.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 msgr2=0x7f24f0057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.394 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 0x7f24f0057cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f2510009eb0 tx=0x7f2510016000).stop 2020-11-20T11:39:06.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 msgr2=0x7f2518066bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f250c00ef50 tx=0x7f250c006df0).stop 2020-11-20T11:39:06.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 shutdown_connections 2020-11-20T11:39:06.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f24f00557f0 0x7f24f0057cb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.395 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25180aad70 0x7f2518146a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.396 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2518061300 0x7f251809d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.396 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 --2- 172.21.15.161:0/128371943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25180a6f50 0x7f2518066bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.396 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 >> 172.21.15.161:0/128371943 conn(0x7f25180ae1b0 msgr2=0x7f25180aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.396 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 shutdown_connections 2020-11-20T11:39:06.397 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.391+0000 7f252032c700 1 -- 172.21.15.161:0/128371943 wait complete. 2020-11-20T11:39:06.407 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:39:06.536 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 Processor -- start 2020-11-20T11:39:06.536 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- start start 2020-11-20T11:39:06.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c000b17c0 0x7f8c000acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c0013af10 0x7f8c0013b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000aa9a0 con 0x7f8c000b1ba0 2020-11-20T11:39:06.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c001383f0 con 0x7f8c0013af10 2020-11-20T11:39:06.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000ab510 con 0x7f8c000b17c0 2020-11-20T11:39:06.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c04b94700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8c000b1ba0 0x7f8c000aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47580/0 (socket says 172.21.15.161:47580) 2020-11-20T11:39:06.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c04b94700 1 -- 172.21.15.161:0/2198202859 learned_addr learned my addr 172.21.15.161:0/2198202859 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:06.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 --2- 172.21.15.161:0/2198202859 >> v2:172.21.15.161:3300/0 conn(0x7f8c0013af10 0x7f8c0013b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05395700 1 --2- 172.21.15.161:0/2198202859 >> v2:172.21.15.186:3300/0 conn(0x7f8c000b17c0 0x7f8c000acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792704751 0 0) 0x7f8c000aa9a0 con 0x7f8c000b1ba0 2020-11-20T11:39:06.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be8003240 con 0x7f8c000b1ba0 2020-11-20T11:39:06.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 -- 172.21.15.161:0/2198202859 >> v2:172.21.15.186:3300/0 conn(0x7f8c000b17c0 msgr2=0x7f8c000acdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:06.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 --2- 172.21.15.161:0/2198202859 >> v2:172.21.15.186:3300/0 conn(0x7f8c000b17c0 0x7f8c000acdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 -- 172.21.15.161:0/2198202859 >> v1:172.21.15.161:6789/0 conn(0x7f8c000b1ba0 legacy=0x7f8c000aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1542264620 0 0) 0x7f8be8003240 con 0x7f8c000b1ba0 2020-11-20T11:39:06.541 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 -- 172.21.15.161:0/2198202859 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000ad5e0 con 0x7f8c0013af10 2020-11-20T11:39:06.542 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c05b96700 1 --2- 172.21.15.161:0/2198202859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c0013af10 0x7f8c0013b3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8c00062be0 tx=0x7f8bf80091d0).ready entity=mon.0 client_cookie=ef3f6c911ce75c75 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0001680 con 0x7f8c0013af10 2020-11-20T11:39:06.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf800b6b0 con 0x7f8c0013af10 2020-11-20T11:39:06.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8beffff700 1 -- 172.21.15.161:0/2198202859 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800ba30 con 0x7f8c0013af10 2020-11-20T11:39:06.543 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- 172.21.15.161:0/2198202859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c0013af10 msgr2=0x7f8c0013b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 --2- 172.21.15.161:0/2198202859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c0013af10 0x7f8c0013b3c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8c00062be0 tx=0x7f8bf80091d0).stop 2020-11-20T11:39:06.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- 172.21.15.161:0/2198202859 shutdown_connections 2020-11-20T11:39:06.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 --2- 172.21.15.161:0/2198202859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c0013af10 0x7f8c0013b3c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 --2- 172.21.15.161:0/2198202859 >> v2:172.21.15.186:3300/0 conn(0x7f8c000b17c0 0x7f8c000acdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.544 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- 172.21.15.161:0/2198202859 >> 172.21.15.161:0/2198202859 conn(0x7f8c00068350 msgr2=0x7f8c000b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.535+0000 7f8c06397700 1 -- 172.21.15.161:0/2198202859 shutdown_connections 2020-11-20T11:39:06.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 -- 172.21.15.161:0/2198202859 wait complete. 2020-11-20T11:39:06.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 Processor -- start 2020-11-20T11:39:06.545 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 -- start start 2020-11-20T11:39:06.547 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c000b1ba0 0x7f8c0013e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0013af10 0x7f8c001416d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0013cc20 con 0x7f8c000b17c0 2020-11-20T11:39:06.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0013c980 con 0x7f8c000b1ba0 2020-11-20T11:39:06.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c06397700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c00141230 con 0x7f8c0013af10 2020-11-20T11:39:06.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.539+0000 7f8c05395700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37344/0 (socket says 172.21.15.161:37344) 2020-11-20T11:39:06.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 -- 172.21.15.161:0/2605068722 learned_addr learned my addr 172.21.15.161:0/2605068722 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:06.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c04b94700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c000b1ba0 0x7f8c0013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05b96700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0013af10 0x7f8c001416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 -- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0013af10 msgr2=0x7f8c001416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0013af10 0x7f8c001416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 -- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c000b1ba0 msgr2=0x7f8c0013e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c000b1ba0 0x7f8c0013e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 -- 172.21.15.161:0/2605068722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0013c670 con 0x7f8c000b17c0 2020-11-20T11:39:06.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c05395700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8bfc00ebd0 tx=0x7f8bfc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00c8e0 con 0x7f8c000b17c0 2020-11-20T11:39:06.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00ca40 con 0x7f8c000b17c0 2020-11-20T11:39:06.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c00141bc0 con 0x7f8c000b17c0 2020-11-20T11:39:06.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00cde0 con 0x7f8c000b17c0 2020-11-20T11:39:06.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c00149720 con 0x7f8c000b17c0 2020-11-20T11:39:06.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f8bfc012600 con 0x7f8c000b17c0 2020-11-20T11:39:06.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00149910 con 0x7f8c000b17c0 2020-11-20T11:39:06.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 0x7f8bd8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8c04b94700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 0x7f8bd8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.543+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8bfc06eb30 con 0x7f8c000b17c0 2020-11-20T11:39:06.553 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.547+0000 7f8c04b94700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 0x7f8bd8057c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8c000aa570 tx=0x7f8bf0002e60).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.554 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.551+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8bfc044870 con 0x7f8c000b17c0 2020-11-20T11:39:06.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.703+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c00044f60 con 0x7f8c000b17c0 2020-11-20T11:39:06.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.703+0000 7f8bed7fa700 1 -- 172.21.15.161:0/2605068722 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8bfc047e90 con 0x7f8c000b17c0 2020-11-20T11:39:06.708 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:06.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 msgr2=0x7f8bd8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 0x7f8bd8057c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8c000aa570 tx=0x7f8bf0002e60).stop 2020-11-20T11:39:06.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 msgr2=0x7f8c0013e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8bfc00ebd0 tx=0x7f8bfc006df0).stop 2020-11-20T11:39:06.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 shutdown_connections 2020-11-20T11:39:06.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8bd80557c0 0x7f8bd8057c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c0013af10 0x7f8c001416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c000b17c0 0x7f8c0013e970 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 --2- 172.21.15.161:0/2605068722 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c000b1ba0 0x7f8c0013e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 >> 172.21.15.161:0/2605068722 conn(0x7f8c00068350 msgr2=0x7f8c000b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 shutdown_connections 2020-11-20T11:39:06.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.707+0000 7f8c06397700 1 -- 172.21.15.161:0/2605068722 wait complete. 2020-11-20T11:39:06.725 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:39:06.848 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 Processor -- start 2020-11-20T11:39:06.849 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- start start 2020-11-20T11:39:06.850 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f492c0ae150 0x7f492c13b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f492c065ec0 0x7f492c067a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c068170 con 0x7f492c0add70 2020-11-20T11:39:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c13ad30 con 0x7f492c0ae150 2020-11-20T11:39:06.851 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c13afd0 con 0x7f492c065ec0 2020-11-20T11:39:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f492c0ae150 0x7f492c13b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f492c0ae150 0x7f492c13b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37354/0 (socket says 172.21.15.161:37354) 2020-11-20T11:39:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 -- 172.21.15.161:0/1624610841 learned_addr learned my addr 172.21.15.161:0/1624610841 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4931f6b700 1 --2- 172.21.15.161:0/1624610841 >> v2:172.21.15.186:3300/0 conn(0x7f492c065ec0 0x7f492c067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.852 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 -- 172.21.15.161:0/1624610841 >> v2:172.21.15.186:3300/0 conn(0x7f492c065ec0 msgr2=0x7f492c067a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:06.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 --2- 172.21.15.161:0/1624610841 >> v2:172.21.15.186:3300/0 conn(0x7f492c065ec0 0x7f492c067a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 -- 172.21.15.161:0/1624610841 >> v1:172.21.15.186:6789/0 conn(0x7f492c0add70 legacy=0x7f492c137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f492bfff700 1 -- 172.21.15.161:0/1624610841 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966312446 0 0) 0x7f492c068170 con 0x7f492c0add70 2020-11-20T11:39:06.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 -- 172.21.15.161:0/1624610841 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c13b270 con 0x7f492c0ae150 2020-11-20T11:39:06.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f4930f69700 1 --2- 172.21.15.161:0/1624610841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0ae150 0x7f492c13b710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f492c0aee10 tx=0x7f4920006eb0).ready entity=mon.0 client_cookie=8684305686f49207 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f492bfff700 1 -- 172.21.15.161:0/1624610841 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920009810 con 0x7f492c0ae150 2020-11-20T11:39:06.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f492bfff700 1 -- 172.21.15.161:0/1624610841 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920009970 con 0x7f492c0ae150 2020-11-20T11:39:06.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f492bfff700 1 -- 172.21.15.161:0/1624610841 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920009cf0 con 0x7f492c0ae150 2020-11-20T11:39:06.857 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- 172.21.15.161:0/1624610841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0ae150 msgr2=0x7f492c13b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.857 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 --2- 172.21.15.161:0/1624610841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0ae150 0x7f492c13b710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f492c0aee10 tx=0x7f4920006eb0).stop 2020-11-20T11:39:06.857 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- 172.21.15.161:0/1624610841 shutdown_connections 2020-11-20T11:39:06.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 --2- 172.21.15.161:0/1624610841 >> v2:172.21.15.186:3300/0 conn(0x7f492c065ec0 0x7f492c067a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 --2- 172.21.15.161:0/1624610841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0ae150 0x7f492c13b710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- 172.21.15.161:0/1624610841 >> 172.21.15.161:0/1624610841 conn(0x7f492c062840 msgr2=0x7f492c062c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:06.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- 172.21.15.161:0/1624610841 shutdown_connections 2020-11-20T11:39:06.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.847+0000 7f493276c700 1 -- 172.21.15.161:0/1624610841 wait complete. 2020-11-20T11:39:06.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 Processor -- start 2020-11-20T11:39:06.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- start start 2020-11-20T11:39:06.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f492c065ec0 0x7f492c1367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c0a7b80 0x7f492c0a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0a5e30 con 0x7f492c0add70 2020-11-20T11:39:06.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0a76a0 con 0x7f492c0a7b80 2020-11-20T11:39:06.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0a7940 con 0x7f492c065ec0 2020-11-20T11:39:06.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.860 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37360/0 (socket says 172.21.15.161:37360) 2020-11-20T11:39:06.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 -- 172.21.15.161:0/380796723 learned_addr learned my addr 172.21.15.161:0/380796723 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:06.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4931f6b700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c0a7b80 0x7f492c0a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493176a700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f492c065ec0 0x7f492c1367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 -- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f492c065ec0 msgr2=0x7f492c1367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f492c065ec0 0x7f492c1367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 -- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c0a7b80 msgr2=0x7f492c0a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:06.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c0a7b80 0x7f492c0a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:06.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 -- 172.21.15.161:0/380796723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0a54a0 con 0x7f492c0add70 2020-11-20T11:39:06.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f4930f69700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4920006ef0 tx=0x7f4920015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920011d00 con 0x7f492c0add70 2020-11-20T11:39:06.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4920011e60 con 0x7f492c0add70 2020-11-20T11:39:06.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492001e670 con 0x7f492c0add70 2020-11-20T11:39:06.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c135ad0 con 0x7f492c0add70 2020-11-20T11:39:06.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.851+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c0a81f0 con 0x7f492c0add70 2020-11-20T11:39:06.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c0a5630 con 0x7f492c0add70 2020-11-20T11:39:06.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f4920025030 con 0x7f492c0add70 2020-11-20T11:39:06.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f49297fa700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 0x7f4904057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:06.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f492006feb0 con 0x7f492c0add70 2020-11-20T11:39:06.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f493176a700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 0x7f4904057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:06.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.855+0000 7f493176a700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 0x7f4904057c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f492c0a5180 tx=0x7f491c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:06.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:06.863+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4920045b90 con 0x7f492c0add70 2020-11-20T11:39:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.059+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f492c069250 con 0x7f492c0add70 2020-11-20T11:39:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.059+0000 7f49297fa700 1 -- 172.21.15.161:0/380796723 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2136 (secure 0 0 0) 0x7f4920023070 con 0x7f492c0add70 2020-11-20T11:39:07.064 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:07.064 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.186:6833/2262024112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2262024112},{"type":"v1","addr":"172.21.15.186:6833","nonce":2262024112}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:38:53.953828+0000","modified":"2020-11-20T11:38:55.630027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4197892368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4197892368},{"type":"v1","addr":"172.21.15.161:6835","nonce":4197892368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:39:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 msgr2=0x7f4904057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 0x7f4904057c80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f492c0a5180 tx=0x7f491c009040).stop 2020-11-20T11:39:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 msgr2=0x7f492c13a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4920006ef0 tx=0x7f4920015000).stop 2020-11-20T11:39:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 shutdown_connections 2020-11-20T11:39:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f49040557c0 0x7f4904057c80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f492c0a7b80 0x7f492c0a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f492c065ec0 0x7f492c1367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 --2- 172.21.15.161:0/380796723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f492c0add70 0x7f492c13a510 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 >> 172.21.15.161:0/380796723 conn(0x7f492c062840 msgr2=0x7f492c060150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 shutdown_connections 2020-11-20T11:39:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:07.063+0000 7f493276c700 1 -- 172.21.15.161:0/380796723 wait complete. 2020-11-20T11:39:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 6 2020-11-20T11:39:07.279 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:38:53.953828+0000', 'modified': '2020-11-20T11:38:55.630027+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6835/4197892368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 4197892368}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 4197892368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:39:07.280 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:39:07.280 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T11:39:07.419 INFO:teuthology.orchestra.run.smithi161.stdout:{"cluster_fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","whoami":0,"id":4263,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.451954255,"mdsmap_epoch":6,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":19.889152290999998} 2020-11-20T11:39:07.568 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "416fbbe8-6418-42c8-b3e0-6e08bacfe8cc", "fs_name": "cephfs", "id": 4263, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 13.451954255, "state": "up:active", "uptime": 19.889152291, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:39:07.569 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-11-20T11:39:07.592 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-11-20T11:39:07.593 INFO:tasks.ceph_fuse:config is None 2020-11-20T11:39:07.593 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-11-20T11:39:07.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.594 INFO:teuthology.orchestra.run.smithi161:> ip netns list 2020-11-20T11:39:07.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.604 INFO:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2020-11-20T11:39:07.672 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2020-11-20T11:39:07.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T11:39:07.673 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-11-20T11:39:07.673 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T11:39:07.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2020-11-20T11:39:07.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T11:39:07.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T11:39:07.675 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T11:39:07.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T11:39:07.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T11:39:07.675 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:39:07.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.676 INFO:teuthology.orchestra.run.smithi161:> ip addr 2020-11-20T11:39:07.722 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T11:39:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T11:39:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T11:39:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:39:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2020-11-20T11:39:07.723 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:39:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-11-20T11:39:07.724 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2020-11-20T11:39:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-11-20T11:39:07.724 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2020-11-20T11:39:07.724 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2020-11-20T11:39:07.725 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:39:07.725 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T11:39:07.725 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2020-11-20T11:39:07.725 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global enp3s0f1 2020-11-20T11:39:07.726 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:39:07.726 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2020-11-20T11:39:07.726 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:39:07.726 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2020-11-20T11:39:07.726 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:5e:91:64:2e brd ff:ff:ff:ff:ff:ff 2020-11-20T11:39:07.727 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2020-11-20T11:39:07.727 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2020-11-20T11:39:07.727 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T11:39:07.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.728 INFO:teuthology.orchestra.run.smithi161:> (cd / && exec sudo bash -c ' 2020-11-20T11:39:07.728 INFO:teuthology.orchestra.run.smithi161:> set -e 2020-11-20T11:39:07.729 INFO:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2020-11-20T11:39:07.729 INFO:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2020-11-20T11:39:07.729 INFO:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2020-11-20T11:39:07.730 INFO:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T11:39:07.730 INFO:teuthology.orchestra.run.smithi161:> ') 2020-11-20T11:39:07.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.817 INFO:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T11:39:07.828 INFO:teuthology.orchestra.run.smithi161.stdout:1 2020-11-20T11:39:07.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.830 INFO:teuthology.orchestra.run.smithi161:> route 2020-11-20T11:39:07.981 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2020-11-20T11:39:07.982 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T11:39:07.982 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2020-11-20T11:39:07.982 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2020-11-20T11:39:07.982 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2020-11-20T11:39:07.983 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T11:39:07.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:07.984 INFO:teuthology.orchestra.run.smithi161:> (cd / && exec sudo bash -c ' 2020-11-20T11:39:07.984 INFO:teuthology.orchestra.run.smithi161:> set -e 2020-11-20T11:39:07.984 INFO:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T11:39:07.985 INFO:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T11:39:07.985 INFO:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T11:39:07.985 INFO:teuthology.orchestra.run.smithi161:> ') 2020-11-20T11:39:08.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:08.028 INFO:teuthology.orchestra.run.smithi161:> ip netns list 2020-11-20T11:39:08.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:08.075 INFO:teuthology.orchestra.run.smithi161:> ip netns list-id 2020-11-20T11:39:08.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:08.122 INFO:teuthology.orchestra.run.smithi161:> (cd / && exec sudo bash -c ' 2020-11-20T11:39:08.123 INFO:teuthology.orchestra.run.smithi161:> set -e 2020-11-20T11:39:08.123 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T11:39:08.123 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T11:39:08.124 INFO:teuthology.orchestra.run.smithi161:> ') 2020-11-20T11:39:08.200 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T11:39:08.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:08.201 INFO:teuthology.orchestra.run.smithi161:> (cd / && exec sudo bash -c ' 2020-11-20T11:39:08.201 INFO:teuthology.orchestra.run.smithi161:> set -e 2020-11-20T11:39:08.201 INFO:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T11:39:08.202 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T11:39:08.202 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T11:39:08.202 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T11:39:08.203 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T11:39:08.203 INFO:teuthology.orchestra.run.smithi161:> ') 2020-11-20T11:39:08.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T11:39:08.508 INFO:teuthology.orchestra.run.smithi161:> (cd / && exec sudo bash -c ' 2020-11-20T11:39:08.508 INFO:teuthology.orchestra.run.smithi161:> set -e 2020-11-20T11:39:08.508 INFO:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2020-11-20T11:39:08.509 INFO:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T11:39:08.509 INFO:teuthology.orchestra.run.smithi161:> ') 2020-11-20T11:39:08.546 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T11:39:08.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 Processor -- start 2020-11-20T11:39:08.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 -- start start 2020-11-20T11:39:08.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca40ad620 0x7f6ca40a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6ca40a7f90 0x7f6ca4060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 0x7f6ca40a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40a7870 con 0x7f6ca40ad620 2020-11-20T11:39:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40a9090 con 0x7f6ca40a7f90 2020-11-20T11:39:08.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6caa5a9700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40a92c0 con 0x7f6ca40a6340 2020-11-20T11:39:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca40ad620 0x7f6ca40a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca40ad620 0x7f6ca40a5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37368/0 (socket says 172.21.15.161:37368) 2020-11-20T11:39:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 -- 172.21.15.161:0/814357006 learned_addr learned my addr 172.21.15.161:0/814357006 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:08.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca8da6700 1 --2- 172.21.15.161:0/814357006 >> v2:172.21.15.186:3300/0 conn(0x7f6ca40a7f90 0x7f6ca4060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca9da8700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 0x7f6ca40a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 -- 172.21.15.161:0/814357006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 msgr2=0x7f6ca40a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 0x7f6ca40a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 -- 172.21.15.161:0/814357006 >> v2:172.21.15.186:3300/0 conn(0x7f6ca40a7f90 msgr2=0x7f6ca4060150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/814357006 >> v2:172.21.15.186:3300/0 conn(0x7f6ca40a7f90 0x7f6ca4060150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 -- 172.21.15.161:0/814357006 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca40a9560 con 0x7f6ca40ad620 2020-11-20T11:39:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca9da8700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 0x7f6ca40a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.715+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40ad620 0x7f6ca40a5df0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6ca40a9040 tx=0x7f6c98006eb0).ready entity=mon.0 client_cookie=9f088387d3c70bfc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:08.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6c97fff700 1 -- 172.21.15.161:0/814357006 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98009810 con 0x7f6ca40ad620 2020-11-20T11:39:08.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6c97fff700 1 -- 172.21.15.161:0/814357006 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98009970 con 0x7f6ca40ad620 2020-11-20T11:39:08.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6c97fff700 1 -- 172.21.15.161:0/814357006 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98009cf0 con 0x7f6ca40ad620 2020-11-20T11:39:08.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- 172.21.15.161:0/814357006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40ad620 msgr2=0x7f6ca40a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:08.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40ad620 0x7f6ca40a5df0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6ca40a9040 tx=0x7f6c98006eb0).stop 2020-11-20T11:39:08.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- 172.21.15.161:0/814357006 shutdown_connections 2020-11-20T11:39:08.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40a6340 0x7f6ca40a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/814357006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40ad620 0x7f6ca40a5df0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/814357006 >> v2:172.21.15.186:3300/0 conn(0x7f6ca40a7f90 0x7f6ca4060150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.727 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- 172.21.15.161:0/814357006 >> 172.21.15.161:0/814357006 conn(0x7f6ca40621d0 msgr2=0x7f6ca40acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:08.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- 172.21.15.161:0/814357006 shutdown_connections 2020-11-20T11:39:08.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- 172.21.15.161:0/814357006 wait complete. 2020-11-20T11:39:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 Processor -- start 2020-11-20T11:39:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- start start 2020-11-20T11:39:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 0x7f6ca41197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40ad620 0x7f6ca4149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca409efd0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca409e5f0 con 0x7f6ca40a6340 2020-11-20T11:39:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6caa5a9700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca409e890 con 0x7f6ca40ad620 2020-11-20T11:39:08.732 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6ca8da6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6ca8da6700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37376/0 (socket says 172.21.15.161:37376) 2020-11-20T11:39:08.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6ca8da6700 1 -- 172.21.15.161:0/1922264138 learned_addr learned my addr 172.21.15.161:0/1922264138 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:08.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 0x7f6ca41197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.733 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.719+0000 7f6ca9da8700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40ad620 0x7f6ca4149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 -- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40ad620 msgr2=0x7f6ca4149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40ad620 0x7f6ca4149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 -- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 msgr2=0x7f6ca41197a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:08.734 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 0x7f6ca41197a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 -- 172.21.15.161:0/1922264138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca409eb30 con 0x7f6ca40a7f90 2020-11-20T11:39:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 0x7f6ca41197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6ca8da6700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6ca000eba0 tx=0x7f6ca0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000c9b0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.735 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca409e2e0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca409fe40 con 0x7f6ca40a7f90 2020-11-20T11:39:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca000cb10 con 0x7f6ca40a7f90 2020-11-20T11:39:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca000ce90 con 0x7f6ca40a7f90 2020-11-20T11:39:08.736 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca4069250 con 0x7f6ca40a7f90 2020-11-20T11:39:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.723+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f6ca0012600 con 0x7f6ca40a7f90 2020-11-20T11:39:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.727+0000 7f6c957fa700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 0x7f6c7c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.727+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6ca006ecb0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.727+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 0x7f6c7c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:08.737 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.727+0000 7f6ca95a7700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 0x7f6c7c057c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6c98006ef0 tx=0x7f6c98015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:08.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.731+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6ca00449f0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.893 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.891+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca405cdc0 con 0x7f6ca40a7f90 2020-11-20T11:39:08.894 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.891+0000 7f6c957fa700 1 -- 172.21.15.161:0/1922264138 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7f6ca0048010 con 0x7f6ca40a7f90 2020-11-20T11:39:08.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:08.896 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T11:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 msgr2=0x7f6c7c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 0x7f6c7c057c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f6c98006ef0 tx=0x7f6c98015000).stop 2020-11-20T11:39:08.897 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 msgr2=0x7f6ca409f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:08.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f6ca000eba0 tx=0x7f6ca0006df0).stop 2020-11-20T11:39:08.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 shutdown_connections 2020-11-20T11:39:08.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f6c7c0557c0 0x7f6c7c057c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6ca40ad620 0x7f6ca4149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.898 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6ca40a6340 0x7f6ca41197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 --2- 172.21.15.161:0/1922264138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca40a7f90 0x7f6ca409f950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:08.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 >> 172.21.15.161:0/1922264138 conn(0x7f6ca40621d0 msgr2=0x7f6ca40a67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:08.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 shutdown_connections 2020-11-20T11:39:08.899 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:08.895+0000 7f6caa5a9700 1 -- 172.21.15.161:0/1922264138 wait complete. 2020-11-20T11:39:08.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T11:38:38.321980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T11:38:45.546076+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T11:38:49.160214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T11:38:51.610748+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T11:39:08.911 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T11:39:09.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 Processor -- start 2020-11-20T11:39:09.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 -- start start 2020-11-20T11:39:09.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 0x7fd64c0673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c0aafe0 con 0x7fd64c0a2170 2020-11-20T11:39:09.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c0aa600 con 0x7fd64c0678a0 2020-11-20T11:39:09.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd651dc5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0a2aa0 con 0x7fd64c0a19d0 2020-11-20T11:39:09.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd64b7fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd64c0a2170 0x7fd64c0aefd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47622/0 (socket says 172.21.15.161:47622) 2020-11-20T11:39:09.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd64b7fe700 1 -- 172.21.15.161:0/1200638140 learned_addr learned my addr 172.21.15.161:0/1200638140 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:09.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd64affd700 1 --2- 172.21.15.161:0/1200638140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 0x7fd64c0673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.042 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189397571 0 0) 0x7fd64c0aafe0 con 0x7fd64c0a2170 2020-11-20T11:39:09.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.035+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd638003240 con 0x7fd64c0a2170 2020-11-20T11:39:09.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927444666 0 0) 0x7fd64c0aa600 con 0x7fd64c0678a0 2020-11-20T11:39:09.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd64c0aafe0 con 0x7fd64c0678a0 2020-11-20T11:39:09.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 632549448 0 0) 0x7fd638003240 con 0x7fd64c0a2170 2020-11-20T11:39:09.043 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64affd700 1 -- 172.21.15.161:0/1200638140 >> v1:172.21.15.186:6789/0 conn(0x7fd64c0678a0 legacy=0x7fd64c137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64affd700 1 -- 172.21.15.161:0/1200638140 >> v1:172.21.15.161:6789/0 conn(0x7fd64c0a2170 legacy=0x7fd64c0aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64affd700 1 -- 172.21.15.161:0/1200638140 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0aa8a0 con 0x7fd64c0a19d0 2020-11-20T11:39:09.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64affd700 1 --2- 172.21.15.161:0/1200638140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 0x7fd64c0673b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd63c00b9d0 tx=0x7fd63c006df0).ready entity=mon.2 client_cookie=d88872e3ea3f5081 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400014e0 con 0x7fd64c0a19d0 2020-11-20T11:39:09.044 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c011400 con 0x7fd64c0a19d0 2020-11-20T11:39:09.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd64a7fc700 1 -- 172.21.15.161:0/1200638140 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011780 con 0x7fd64c0a19d0 2020-11-20T11:39:09.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- 172.21.15.161:0/1200638140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 msgr2=0x7fd64c0673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 --2- 172.21.15.161:0/1200638140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 0x7fd64c0673b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fd63c00b9d0 tx=0x7fd63c006df0).stop 2020-11-20T11:39:09.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- 172.21.15.161:0/1200638140 shutdown_connections 2020-11-20T11:39:09.045 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 --2- 172.21.15.161:0/1200638140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c0a19d0 0x7fd64c0673b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- 172.21.15.161:0/1200638140 >> 172.21.15.161:0/1200638140 conn(0x7fd64c0666a0 msgr2=0x7fd64c063d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- 172.21.15.161:0/1200638140 shutdown_connections 2020-11-20T11:39:09.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- 172.21.15.161:0/1200638140 wait complete. 2020-11-20T11:39:09.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 Processor -- start 2020-11-20T11:39:09.046 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.039+0000 7fd651dc5700 1 -- start start 2020-11-20T11:39:09.049 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.049 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd64c0a2170 0x7fd64c13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.049 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 0x7fd64c13be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.049 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13c660 con 0x7fd64c0678a0 2020-11-20T11:39:09.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13c900 con 0x7fd64c0a2170 2020-11-20T11:39:09.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13cba0 con 0x7fd64c14a210 2020-11-20T11:39:09.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37386/0 (socket says 172.21.15.161:37386) 2020-11-20T11:39:09.050 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 -- 172.21.15.161:0/2797498758 learned_addr learned my addr 172.21.15.161:0/2797498758 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:09.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64bfff700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 0x7fd64c13be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64affd700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd64c0a2170 0x7fd64c13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 -- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 msgr2=0x7fd64c13be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.051 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 0x7fd64c13be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 -- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd64c0a2170 msgr2=0x7fd64c13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd64c0a2170 0x7fd64c13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 -- 172.21.15.161:0/2797498758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c13c2f0 con 0x7fd64c0678a0 2020-11-20T11:39:09.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64bfff700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 0x7fd64c13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T11:39:09.052 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd64b7fe700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd64000c860 tx=0x7fd640001960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640007170 con 0x7fd64c0678a0 2020-11-20T11:39:09.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400072d0 con 0x7fd64c0678a0 2020-11-20T11:39:09.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c14a670 con 0x7fd64c0678a0 2020-11-20T11:39:09.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640004960 con 0x7fd64c0678a0 2020-11-20T11:39:09.053 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c13aa10 con 0x7fd64c0678a0 2020-11-20T11:39:09.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c13cd60 con 0x7fd64c0678a0 2020-11-20T11:39:09.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fd640010070 con 0x7fd64c0678a0 2020-11-20T11:39:09.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 0x7fd620057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.043+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd64006e1a0 con 0x7fd64c0678a0 2020-11-20T11:39:09.054 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.047+0000 7fd64affd700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 0x7fd620057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.047+0000 7fd64affd700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 0x7fd620057cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd63c00b9d0 tx=0x7fd63c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.055 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.051+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd640043e80 con 0x7fd64c0678a0 2020-11-20T11:39:09.208 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd64c069250 con 0x7fd64c0678a0 2020-11-20T11:39:09.209 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd6337fe700 1 -- 172.21.15.161:0/2797498758 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd6400474a0 con 0x7fd64c0678a0 2020-11-20T11:39:09.209 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2020-11-20T11:39:09.211 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 msgr2=0x7fd620057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.211 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 0x7fd620057cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd63c00b9d0 tx=0x7fd63c015000).stop 2020-11-20T11:39:09.211 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 msgr2=0x7fd64c13d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fd64000c860 tx=0x7fd640001960).stop 2020-11-20T11:39:09.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 shutdown_connections 2020-11-20T11:39:09.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd6200557f0 0x7fd620057cb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd64c14a210 0x7fd64c13be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.212 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0678a0 0x7fd64c13d040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 --2- 172.21.15.161:0/2797498758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd64c0a2170 0x7fd64c13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 >> 172.21.15.161:0/2797498758 conn(0x7fd64c0666a0 msgr2=0x7fd64c1357c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 shutdown_connections 2020-11-20T11:39:09.213 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.207+0000 7fd651dc5700 1 -- 172.21.15.161:0/2797498758 wait complete. 2020-11-20T11:39:09.224 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T11:39:09.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 Processor -- start 2020-11-20T11:39:09.358 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 -- start start 2020-11-20T11:39:09.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 0x7f02780a9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780aa600 con 0x7f02780a8dd0 2020-11-20T11:39:09.359 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0278134fd0 con 0x7f02780adf30 2020-11-20T11:39:09.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027db7c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0278067160 con 0x7f0278134b40 2020-11-20T11:39:09.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f0277fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f02780a8dd0 0x7f0278134430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47638/0 (socket says 172.21.15.161:47638) 2020-11-20T11:39:09.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f0277fff700 1 -- 172.21.15.161:0/2453265769 learned_addr learned my addr 172.21.15.161:0/2453265769 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:09.360 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f027d37b700 1 --2- 172.21.15.161:0/2453265769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 0x7f02780a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192724678 0 0) 0x7f02780aa600 con 0x7f02780a8dd0 2020-11-20T11:39:09.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.355+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0258003240 con 0x7f02780a8dd0 2020-11-20T11:39:09.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245111963 0 0) 0x7f0278134fd0 con 0x7f02780adf30 2020-11-20T11:39:09.362 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027d37b700 1 -- 172.21.15.161:0/2453265769 >> v1:172.21.15.186:6789/0 conn(0x7f02780adf30 legacy=0x7f02780a9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027d37b700 1 -- 172.21.15.161:0/2453265769 >> v1:172.21.15.161:6789/0 conn(0x7f02780a8dd0 legacy=0x7f0278134430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027d37b700 1 -- 172.21.15.161:0/2453265769 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0278067400 con 0x7f0278134b40 2020-11-20T11:39:09.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027d37b700 1 --2- 172.21.15.161:0/2453265769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 0x7f02780a9230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0270009cc0 tx=0x7f02700091d0).ready entity=mon.2 client_cookie=418cd7ad85156a7d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000b9d0 con 0x7f0278134b40 2020-11-20T11:39:09.363 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000bb30 con 0x7f0278134b40 2020-11-20T11:39:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f02777fe700 1 -- 172.21.15.161:0/2453265769 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000beb0 con 0x7f0278134b40 2020-11-20T11:39:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 -- 172.21.15.161:0/2453265769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 msgr2=0x7f02780a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 --2- 172.21.15.161:0/2453265769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 0x7f02780a9230 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0270009cc0 tx=0x7f02700091d0).stop 2020-11-20T11:39:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 -- 172.21.15.161:0/2453265769 shutdown_connections 2020-11-20T11:39:09.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 --2- 172.21.15.161:0/2453265769 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0278134b40 0x7f02780a9230 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 -- 172.21.15.161:0/2453265769 >> 172.21.15.161:0/2453265769 conn(0x7f02780626c0 msgr2=0x7f0278062aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 -- 172.21.15.161:0/2453265769 shutdown_connections 2020-11-20T11:39:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.359+0000 7f027db7c700 1 -- 172.21.15.161:0/2453265769 wait complete. 2020-11-20T11:39:09.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 Processor -- start 2020-11-20T11:39:09.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- start start 2020-11-20T11:39:09.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02780a8dd0 0x7f027809d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02780adf30 0x7f02780a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02780a7a20 con 0x7f0278134b40 2020-11-20T11:39:09.368 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02780a60a0 con 0x7f02780adf30 2020-11-20T11:39:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02780a56c0 con 0x7f02780a8dd0 2020-11-20T11:39:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37404/0 (socket says 172.21.15.161:37404) 2020-11-20T11:39:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027cb7a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02780a8dd0 0x7f027809d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 -- 172.21.15.161:0/1558226602 learned_addr learned my addr 172.21.15.161:0/1558226602 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f0277fff700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02780adf30 0x7f02780a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 -- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02780a8dd0 msgr2=0x7f027809d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02780a8dd0 0x7f027809d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 -- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02780adf30 msgr2=0x7f02780a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02780adf30 0x7f02780a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 -- 172.21.15.161:0/1558226602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780a5960 con 0x7f0278134b40 2020-11-20T11:39:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027d37b700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0270009c10 tx=0x7f0270016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027001d660 con 0x7f0278134b40 2020-11-20T11:39:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027001d7c0 con 0x7f0278134b40 2020-11-20T11:39:09.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02780a5c00 con 0x7f0278134b40 2020-11-20T11:39:09.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027001db60 con 0x7f0278134b40 2020-11-20T11:39:09.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.363+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02780a6f40 con 0x7f0278134b40 2020-11-20T11:39:09.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02780a5d90 con 0x7f0278134b40 2020-11-20T11:39:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f0270017040 con 0x7f0278134b40 2020-11-20T11:39:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f0274ff9700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 0x7f0254057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0270070970 con 0x7f0278134b40 2020-11-20T11:39:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f027cb7a700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 0x7f0254057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.367+0000 7f027cb7a700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 0x7f0254057c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f02680011a0 tx=0x7f02680079b0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.371+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f02700465a0 con 0x7f0278134b40 2020-11-20T11:39:09.523 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.519+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0278044f60 con 0x7f0278134b40 2020-11-20T11:39:09.524 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.519+0000 7f0274ff9700 1 -- 172.21.15.161:0/1558226602 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f02700210a0 con 0x7f0278134b40 2020-11-20T11:39:09.525 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:09.528 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 msgr2=0x7f0254057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.529 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 0x7f0254057c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f02680011a0 tx=0x7f02680079b0).stop 2020-11-20T11:39:09.530 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 msgr2=0x7f027814aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.531 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0270009c10 tx=0x7f0270016000).stop 2020-11-20T11:39:09.531 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 shutdown_connections 2020-11-20T11:39:09.532 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f02540557c0 0x7f0254057c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.532 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0278134b40 0x7f027814aac0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.532 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f02780a8dd0 0x7f027809d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 --2- 172.21.15.161:0/1558226602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f02780adf30 0x7f02780a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 >> 172.21.15.161:0/1558226602 conn(0x7f02780626c0 msgr2=0x7f0278068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.533 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 shutdown_connections 2020-11-20T11:39:09.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.523+0000 7f027db7c700 1 -- 172.21.15.161:0/1558226602 wait complete. 2020-11-20T11:39:09.537 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T11:39:09.683 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.679+0000 7f634bfff700 1 Processor -- start 2020-11-20T11:39:09.684 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.679+0000 7f634bfff700 1 -- start start 2020-11-20T11:39:09.701 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f634c1376c0 0x7f634c0a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f634c0a7480 0x7f634c141f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0a78d0 con 0x7f634c061300 2020-11-20T11:39:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c138660 con 0x7f634c1376c0 2020-11-20T11:39:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c137b20 con 0x7f634c0a7480 2020-11-20T11:39:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634affd700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f634c061300 0x7f634c0a0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47650/0 (socket says 172.21.15.161:47650) 2020-11-20T11:39:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f634c1376c0 0x7f634c0a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634affd700 1 -- 172.21.15.161:0/4053601480 learned_addr learned my addr 172.21.15.161:0/4053601480 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294503014 0 0) 0x7f634c0a78d0 con 0x7f634c061300 2020-11-20T11:39:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6338003240 con 0x7f634c061300 2020-11-20T11:39:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634b7fe700 1 --2- 172.21.15.161:0/4053601480 >> v2:172.21.15.186:3300/0 conn(0x7f634c0a7480 0x7f634c141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 622045322 0 0) 0x7f6338003240 con 0x7f634c061300 2020-11-20T11:39:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 >> v2:172.21.15.186:3300/0 conn(0x7f634c0a7480 msgr2=0x7f634c141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 --2- 172.21.15.161:0/4053601480 >> v2:172.21.15.186:3300/0 conn(0x7f634c0a7480 0x7f634c141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 >> v2:172.21.15.161:3300/0 conn(0x7f634c1376c0 msgr2=0x7f634c0a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:09.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 --2- 172.21.15.161:0/4053601480 >> v2:172.21.15.161:3300/0 conn(0x7f634c1376c0 0x7f634c0a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c05c170 con 0x7f634c061300 2020-11-20T11:39:09.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f633c001860 con 0x7f634c061300 2020-11-20T11:39:09.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 >> v1:172.21.15.161:6789/0 conn(0x7f634c061300 legacy=0x7f634c0a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6338003760 0x7f6338003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 0x7f6338004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6338004e50 0x7f633800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338004290 con 0x7f63380044e0 2020-11-20T11:39:09.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633800bc20 con 0x7f6338004e50 2020-11-20T11:39:09.706 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633800bd60 con 0x7f6338003760 2020-11-20T11:39:09.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- 172.21.15.161:0/4053601480 >> v2:172.21.15.161:3300/0 conn(0x7f634c1376c0 0x7f634c0a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T11:39:09.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 0x7f6338004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634affd700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6338003760 0x7f6338003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634b7fe700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6338004e50 0x7f633800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 -- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6338003760 msgr2=0x7f6338003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:09.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6338003760 0x7f6338003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 -- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6338004e50 msgr2=0x7f633800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:09.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6338004e50 0x7f633800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 -- 172.21.15.161:0/4053601480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338003240 con 0x7f63380044e0 2020-11-20T11:39:09.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634b7fe700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6338004e50 0x7f633800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T11:39:09.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634b7fe700 1 -- 172.21.15.161:0/4053601480 reap_dead start 2020-11-20T11:39:09.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634a7fc700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 0x7f6338004960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f634000be90 tx=0x7f6340006df0).ready entity=mon.0 client_cookie=eb0f5e04cf9451e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000b590 con 0x7f63380044e0 2020-11-20T11:39:09.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634000ecf0 con 0x7f63380044e0 2020-11-20T11:39:09.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f6349ffb700 1 -- 172.21.15.161:0/4053601480 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340012600 con 0x7f63380044e0 2020-11-20T11:39:09.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 msgr2=0x7f6338004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 0x7f6338004960 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f634000be90 tx=0x7f6340006df0).stop 2020-11-20T11:39:09.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- 172.21.15.161:0/4053601480 shutdown_connections 2020-11-20T11:39:09.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 --2- 172.21.15.161:0/4053601480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63380044e0 0x7f6338004960 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- 172.21.15.161:0/4053601480 >> 172.21.15.161:0/4053601480 conn(0x7f634c0adf90 msgr2=0x7f634c0a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- 172.21.15.161:0/4053601480 shutdown_connections 2020-11-20T11:39:09.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.683+0000 7f634bfff700 1 -- 172.21.15.161:0/4053601480 wait complete. 2020-11-20T11:39:09.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 Processor -- start 2020-11-20T11:39:09.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 -- start start 2020-11-20T11:39:09.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63380044e0 0x7f634c0682f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0a2060 0x7f634c0a24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0a1c30 con 0x7f634c14cce0 2020-11-20T11:39:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0a3fb0 con 0x7f63380044e0 2020-11-20T11:39:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634bfff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0a4250 con 0x7f634c0a2060 2020-11-20T11:39:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634b7fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37424/0 (socket says 172.21.15.161:37424) 2020-11-20T11:39:09.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634b7fe700 1 -- 172.21.15.161:0/549709394 learned_addr learned my addr 172.21.15.161:0/549709394 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:09.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634a7fc700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0a2060 0x7f634c0a24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.687+0000 7f634affd700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63380044e0 0x7f634c0682f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 -- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0a2060 msgr2=0x7f634c0a24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0a2060 0x7f634c0a24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 -- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63380044e0 msgr2=0x7f634c0682f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63380044e0 0x7f634c0682f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.715 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 -- 172.21.15.161:0/549709394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c067590 con 0x7f634c14cce0 2020-11-20T11:39:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634b7fe700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6344006cf0 tx=0x7f6344008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344013400 con 0x7f634c14cce0 2020-11-20T11:39:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344013560 con 0x7f634c14cce0 2020-11-20T11:39:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0a45b0 con 0x7f634c14cce0 2020-11-20T11:39:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440138e0 con 0x7f634c14cce0 2020-11-20T11:39:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c0a3cf0 con 0x7f634c14cce0 2020-11-20T11:39:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f634401a030 con 0x7f634c14cce0 2020-11-20T11:39:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c044f60 con 0x7f634c14cce0 2020-11-20T11:39:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 0x7f6328057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f634406dd90 con 0x7f634c14cce0 2020-11-20T11:39:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634affd700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 0x7f6328057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.691+0000 7f634affd700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 0x7f6328057c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f633c007fd0 tx=0x7f633c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.699+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6344043c00 con 0x7f634c14cce0 2020-11-20T11:39:09.850 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.847+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f634c0a1dc0 con 0x7f634c14cce0 2020-11-20T11:39:09.850 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.847+0000 7f6332ffd700 1 -- 172.21.15.161:0/549709394 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6344047220 con 0x7f634c14cce0 2020-11-20T11:39:09.851 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:09.853 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 msgr2=0x7f6328057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 0x7f6328057c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f633c007fd0 tx=0x7f633c009040).stop 2020-11-20T11:39:09.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 msgr2=0x7f634c14d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:09.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f6344006cf0 tx=0x7f6344008040).stop 2020-11-20T11:39:09.854 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 shutdown_connections 2020-11-20T11:39:09.855 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f63280557c0 0x7f6328057c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.855 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f634c14cce0 0x7f634c14d140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.855 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f63380044e0 0x7f634c0682f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.855 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 --2- 172.21.15.161:0/549709394 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0a2060 0x7f634c0a24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:09.855 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 >> 172.21.15.161:0/549709394 conn(0x7f634c0adf90 msgr2=0x7f634c0608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:09.856 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 shutdown_connections 2020-11-20T11:39:09.856 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.851+0000 7f634bfff700 1 -- 172.21.15.161:0/549709394 wait complete. 2020-11-20T11:39:09.871 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T11:39:10.000 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 Processor -- start 2020-11-20T11:39:10.000 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 -- start start 2020-11-20T11:39:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe8146220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80a9a10 con 0x7f3fe813b090 2020-11-20T11:39:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe8068790 con 0x7f3fe8061300 2020-11-20T11:39:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fee03f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80aa8f0 con 0x7f3fe80a0c20 2020-11-20T11:39:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fec83c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3fe813b090 0x7f3fe80a0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47672/0 (socket says 172.21.15.161:47672) 2020-11-20T11:39:10.005 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fec83c700 1 -- 172.21.15.161:0/622228479 learned_addr learned my addr 172.21.15.161:0/622228479 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:10.005 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fed83e700 1 --2- 172.21.15.161:0/622228479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe8146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.005 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876795639 0 0) 0x7f3fe80a9a10 con 0x7f3fe813b090 2020-11-20T11:39:10.005 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd0003240 con 0x7f3fe813b090 2020-11-20T11:39:10.005 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248509864 0 0) 0x7f3fe8068790 con 0x7f3fe8061300 2020-11-20T11:39:10.006 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fe80a9a10 con 0x7f3fe8061300 2020-11-20T11:39:10.006 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fed83e700 1 -- 172.21.15.161:0/622228479 >> v1:172.21.15.186:6789/0 conn(0x7f3fe8061300 legacy=0x7f3fe813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.006 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fed83e700 1 -- 172.21.15.161:0/622228479 >> v1:172.21.15.161:6789/0 conn(0x7f3fe813b090 legacy=0x7f3fe80a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.006 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fed83e700 1 -- 172.21.15.161:0/622228479 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80aab90 con 0x7f3fe80a0c20 2020-11-20T11:39:10.006 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fed83e700 1 --2- 172.21.15.161:0/622228479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe8146220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3fe0009cc0 tx=0x7f3fe00091d0).ready entity=mon.2 client_cookie=e4d5f7d2a3ae1736 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0005aa0 con 0x7f3fe80a0c20 2020-11-20T11:39:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe0005c00 con 0x7f3fe80a0c20 2020-11-20T11:39:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:09.999+0000 7f3fd7fff700 1 -- 172.21.15.161:0/622228479 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000ba20 con 0x7f3fe80a0c20 2020-11-20T11:39:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/622228479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 msgr2=0x7f3fe8146220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 --2- 172.21.15.161:0/622228479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe8146220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3fe0009cc0 tx=0x7f3fe00091d0).stop 2020-11-20T11:39:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/622228479 shutdown_connections 2020-11-20T11:39:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 --2- 172.21.15.161:0/622228479 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe8146220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/622228479 >> 172.21.15.161:0/622228479 conn(0x7f3fe80adf90 msgr2=0x7f3fe80a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/622228479 shutdown_connections 2020-11-20T11:39:10.009 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/622228479 wait complete. 2020-11-20T11:39:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 Processor -- start 2020-11-20T11:39:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- start start 2020-11-20T11:39:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.012 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe809f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.012 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe813b090 0x7f3fe809e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.012 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe809e510 con 0x7f3fe8061300 2020-11-20T11:39:10.012 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe809fb30 con 0x7f3fe813b090 2020-11-20T11:39:10.012 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe809fdc0 con 0x7f3fe80a0c20 2020-11-20T11:39:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37436/0 (socket says 172.21.15.161:37436) 2020-11-20T11:39:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 -- 172.21.15.161:0/1287207136 learned_addr learned my addr 172.21.15.161:0/1287207136 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed83e700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe813b090 0x7f3fe809e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fec83c700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe809f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.014 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 -- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 msgr2=0x7f3fe809f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.014 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe809f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.014 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 -- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe813b090 msgr2=0x7f3fe809e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.014 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe813b090 0x7f3fe809e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 -- 172.21.15.161:0/1287207136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80a0060 con 0x7f3fe8061300 2020-11-20T11:39:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fed03d700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f3fe400c6d0 tx=0x7f3fe4007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400e490 con 0x7f3fe8061300 2020-11-20T11:39:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400e5f0 con 0x7f3fe8061300 2020-11-20T11:39:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.003+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe813cb30 con 0x7f3fe8061300 2020-11-20T11:39:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400e990 con 0x7f3fe8061300 2020-11-20T11:39:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe809f000 con 0x7f3fe8061300 2020-11-20T11:39:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe8044f60 con 0x7f3fe8061300 2020-11-20T11:39:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f3fe4019030 con 0x7f3fe8061300 2020-11-20T11:39:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fd57fa700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 0x7f3fc0057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3fe406dd00 con 0x7f3fe8061300 2020-11-20T11:39:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fec83c700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 0x7f3fc0057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.007+0000 7f3fec83c700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 0x7f3fc0057c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3fd8007fd0 tx=0x7f3fd8009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.018 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.015+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3fe40439e0 con 0x7f3fe8061300 2020-11-20T11:39:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.167+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fe809e6d0 con 0x7f3fe8061300 2020-11-20T11:39:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fd57fa700 1 -- 172.21.15.161:0/1287207136 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3fe4047000 con 0x7f3fe8061300 2020-11-20T11:39:10.172 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 8 2020-11-20T11:39:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 msgr2=0x7f3fc0057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 0x7f3fc0057c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f3fd8007fd0 tx=0x7f3fd8009040).stop 2020-11-20T11:39:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 msgr2=0x7f3fe8141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f3fe400c6d0 tx=0x7f3fe4007ae0).stop 2020-11-20T11:39:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 shutdown_connections 2020-11-20T11:39:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f3fc00557c0 0x7f3fc0057c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3fe813b090 0x7f3fe809e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe8061300 0x7f3fe8141730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 --2- 172.21.15.161:0/1287207136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3fe80a0c20 0x7f3fe809f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 >> 172.21.15.161:0/1287207136 conn(0x7f3fe80adf90 msgr2=0x7f3fe80ac980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 shutdown_connections 2020-11-20T11:39:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.171+0000 7f3fee03f700 1 -- 172.21.15.161:0/1287207136 wait complete. 2020-11-20T11:39:10.187 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T11:39:10.187 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T11:39:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 Processor -- start 2020-11-20T11:39:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- start start 2020-11-20T11:39:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8c280a4f20 0x7f8c280a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 0x7f8c28060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c280a8df0 con 0x7f8c28060640 2020-11-20T11:39:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c280a9a60 con 0x7f8c280a4f20 2020-11-20T11:39:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280a6770 con 0x7f8c280a76a0 2020-11-20T11:39:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2d281700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8c28060640 0x7f8c2813a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47688/0 (socket says 172.21.15.161:47688) 2020-11-20T11:39:10.317 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2d281700 1 -- 172.21.15.161:0/1612001978 learned_addr learned my addr 172.21.15.161:0/1612001978 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T11:39:10.317 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2ca80700 1 --2- 172.21.15.161:0/1612001978 >> v2:172.21.15.186:3300/0 conn(0x7f8c280a4f20 0x7f8c280a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.317 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1612001978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 0x7f8c28060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.317 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c277fe700 1 -- 172.21.15.161:0/1612001978 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942150125 0 0) 0x7f8c280a8df0 con 0x7f8c28060640 2020-11-20T11:39:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c277fe700 1 -- 172.21.15.161:0/1612001978 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c08003240 con 0x7f8c28060640 2020-11-20T11:39:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 -- 172.21.15.161:0/1612001978 >> v2:172.21.15.186:3300/0 conn(0x7f8c280a4f20 msgr2=0x7f8c280a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T11:39:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1612001978 >> v2:172.21.15.186:3300/0 conn(0x7f8c280a4f20 0x7f8c280a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 -- 172.21.15.161:0/1612001978 >> v1:172.21.15.161:6789/0 conn(0x7f8c28060640 legacy=0x7f8c2813a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 -- 172.21.15.161:0/1612001978 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c280a6a10 con 0x7f8c280a76a0 2020-11-20T11:39:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1612001978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 0x7f8c28060150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8c10009c90 tx=0x7f8c100091d0).ready entity=mon.2 client_cookie=ddcb55eba9c20e37 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c277fe700 1 -- 172.21.15.161:0/1612001978 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000b9c0 con 0x7f8c280a76a0 2020-11-20T11:39:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c277fe700 1 -- 172.21.15.161:0/1612001978 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000bb20 con 0x7f8c280a76a0 2020-11-20T11:39:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c277fe700 1 -- 172.21.15.161:0/1612001978 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000bea0 con 0x7f8c280a76a0 2020-11-20T11:39:10.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- 172.21.15.161:0/1612001978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 msgr2=0x7f8c28060150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1612001978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 0x7f8c28060150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8c10009c90 tx=0x7f8c100091d0).stop 2020-11-20T11:39:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- 172.21.15.161:0/1612001978 shutdown_connections 2020-11-20T11:39:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1612001978 >> v2:172.21.15.186:3300/0 conn(0x7f8c280a4f20 0x7f8c280a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1612001978 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c280a76a0 0x7f8c28060150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- 172.21.15.161:0/1612001978 >> 172.21.15.161:0/1612001978 conn(0x7f8c280ad630 msgr2=0x7f8c280ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.311+0000 7f8c2da82700 1 -- 172.21.15.161:0/1612001978 shutdown_connections 2020-11-20T11:39:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- 172.21.15.161:0/1612001978 wait complete. 2020-11-20T11:39:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 Processor -- start 2020-11-20T11:39:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- start start 2020-11-20T11:39:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c28060640 0x7f8c280655f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c280a76a0 0x7f8c28117170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28115cb0 con 0x7f8c280a4f20 2020-11-20T11:39:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28067600 con 0x7f8c280a76a0 2020-11-20T11:39:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28068720 con 0x7f8c28060640 2020-11-20T11:39:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37450/0 (socket says 172.21.15.161:37450) 2020-11-20T11:39:10.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 -- 172.21.15.161:0/1500886848 learned_addr learned my addr 172.21.15.161:0/1500886848 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T11:39:10.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2d281700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c280a76a0 0x7f8c28117170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2ca80700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c28060640 0x7f8c280655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 -- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c28060640 msgr2=0x7f8c280655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c28060640 0x7f8c280655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 -- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c280a76a0 msgr2=0x7f8c28117170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c280a76a0 0x7f8c28117170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 -- 172.21.15.161:0/1500886848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28067830 con 0x7f8c280a4f20 2020-11-20T11:39:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c27fff700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8c10011dd0 tx=0x7f8c10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10021070 con 0x7f8c280a4f20 2020-11-20T11:39:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000b3c0 con 0x7f8c280a4f20 2020-11-20T11:39:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c28115320 con 0x7f8c280a4f20 2020-11-20T11:39:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1001c800 con 0x7f8c280a4f20 2020-11-20T11:39:10.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.315+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28067ad0 con 0x7f8c280a4f20 2020-11-20T11:39:10.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f8c10017070 con 0x7f8c280a4f20 2020-11-20T11:39:10.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28069250 con 0x7f8c280a4f20 2020-11-20T11:39:10.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c24ff9700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 0x7f8c04057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T11:39:10.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8c100708a0 con 0x7f8c280a4f20 2020-11-20T11:39:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c2ca80700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 0x7f8c04057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T11:39:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.319+0000 7f8c2ca80700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 0x7f8c04057c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8c18006fd0 tx=0x7f8c18006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T11:39:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.327+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8c100465e0 con 0x7f8c280a4f20 2020-11-20T11:39:10.534 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.531+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c280a8bf0 con 0x7f8c280a4f20 2020-11-20T11:39:10.535 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.531+0000 7f8c24ff9700 1 -- 172.21.15.161:0/1500886848 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2136 (secure 0 0 0) 0x7f8c10015020 con 0x7f8c280a4f20 2020-11-20T11:39:10.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T11:39:10.536 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.186:6833/2262024112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":2262024112},{"type":"v1","addr":"172.21.15.186:6833","nonce":2262024112}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T11:38:53.953828+0000","modified":"2020-11-20T11:38:55.630027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4197892368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4197892368},{"type":"v1","addr":"172.21.15.161:6835","nonce":4197892368}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T11:39:10.537 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 msgr2=0x7f8c04057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.537 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 0x7f8c04057c80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8c18006fd0 tx=0x7f8c18006df0).stop 2020-11-20T11:39:10.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 msgr2=0x7f8c281157c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T11:39:10.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f8c10011dd0 tx=0x7f8c10016000).stop 2020-11-20T11:39:10.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 shutdown_connections 2020-11-20T11:39:10.538 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f8c040557c0 0x7f8c04057c80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8c280a76a0 0x7f8c28117170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8c28060640 0x7f8c280655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 --2- 172.21.15.161:0/1500886848 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c280a4f20 0x7f8c281157c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T11:39:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 >> 172.21.15.161:0/1500886848 conn(0x7f8c280ad630 msgr2=0x7f8c280a6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T11:39:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 shutdown_connections 2020-11-20T11:39:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T11:39:10.535+0000 7f8c2da82700 1 -- 172.21.15.161:0/1500886848 wait complete. 2020-11-20T11:39:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 6 2020-11-20T11:39:10.753 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T11:38:53.953828+0000', 'modified': '2020-11-20T11:38:55.630027+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6835/4197892368', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 4197892368}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 4197892368}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T11:39:10.754 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T11:39:10.754 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T11:39:10.896 INFO:teuthology.orchestra.run.smithi161.stdout:{"cluster_fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","whoami":0,"id":4263,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.928985730000001,"mdsmap_epoch":6,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":23.366176929000002} 2020-11-20T11:39:10.896 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "416fbbe8-6418-42c8-b3e0-6e08bacfe8cc", "fs_name": "cephfs", "id": 4263, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 16.92898573, "state": "up:active", "uptime": 23.366176929, "want_state": "up:active", "whoami": 0 } 2020-11-20T11:39:10.897 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-11-20T11:39:10.897 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-11-20T11:39:10.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:10.898 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:39:10.907 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2020-11-20T11:39:10.908 INFO:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2020-11-20T11:39:10.969 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:39:10.969 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:39:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-11-20T11:39:11.032 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T11:39:11.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:11.033 INFO:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2020-11-20T11:39:11.084 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-11-20T11:39:11.085 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --id 0 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:39:11.131 INFO:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2020-11-20T11:39:11.148 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:39:11.149 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:39:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-11-20T11:39:11.204 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T11:39:11.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:11.205 INFO:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2020-11-20T11:39:11.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:2020-11-20T11:39:11.227+0000 7f1c31a94100 -1 init, newargv = 0x55639cea8320 newargc=15ceph-fuse[ 2020-11-20T11:39:11.230 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:18759]: starting ceph client 2020-11-20T11:39:11.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[18759]: starting fuse 2020-11-20T11:39:12.337 INFO:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2020-11-20T11:39:12.354 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-11-20T11:39:12.354 INFO:teuthology.orchestra.run.smithi161:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-11-20T11:39:12.410 INFO:teuthology.orchestra.run.smithi161.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-11-20T11:39:12.411 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-11-20T11:39:12.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:12.412 INFO:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2020-11-20T11:39:12.457 INFO:teuthology.orchestra.run.smithi161.stdout:49 2020-11-20T11:39:12.458 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-11-20T11:39:12.458 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-11-20T11:39:12.459 INFO:teuthology.orchestra.run.smithi161:> import glob 2020-11-20T11:39:12.459 INFO:teuthology.orchestra.run.smithi161:> import re 2020-11-20T11:39:12.459 INFO:teuthology.orchestra.run.smithi161:> import os 2020-11-20T11:39:12.460 INFO:teuthology.orchestra.run.smithi161:> import subprocess 2020-11-20T11:39:12.460 INFO:teuthology.orchestra.run.smithi161:> 2020-11-20T11:39:12.460 INFO:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2020-11-20T11:39:12.461 INFO:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-11-20T11:39:12.461 INFO:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2020-11-20T11:39:12.462 INFO:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2020-11-20T11:39:12.462 INFO:teuthology.orchestra.run.smithi161:> 2020-11-20T11:39:12.462 INFO:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2020-11-20T11:39:12.463 INFO:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2020-11-20T11:39:12.463 INFO:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2020-11-20T11:39:12.463 INFO:teuthology.orchestra.run.smithi161:> return files[0] 2020-11-20T11:39:12.464 INFO:teuthology.orchestra.run.smithi161:> 2020-11-20T11:39:12.464 INFO:teuthology.orchestra.run.smithi161:> for f in files: 2020-11-20T11:39:12.464 INFO:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-11-20T11:39:12.465 INFO:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2020-11-20T11:39:12.465 INFO:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2020-11-20T11:39:12.465 INFO:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2020-11-20T11:39:12.466 INFO:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2020-11-20T11:39:12.466 INFO:teuthology.orchestra.run.smithi161:> return f 2020-11-20T11:39:12.466 INFO:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-11-20T11:39:12.467 INFO:teuthology.orchestra.run.smithi161:> 2020-11-20T11:39:12.467 INFO:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.0")) 2020-11-20T11:39:12.468 INFO:teuthology.orchestra.run.smithi161:> ' 2020-11-20T11:39:12.587 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.0.18759.asok 2020-11-20T11:39:12.768 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.18759.asok 2020-11-20T11:39:12.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:12.769 INFO:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.18759.asok status 2020-11-20T11:39:12.924 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T11:39:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2020-11-20T11:39:12.924 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "b86e691bf191566922a8f08e2a5abf64fde8cfcb", 2020-11-20T11:39:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 16.0.0-7397-gb86e691b (b86e691bf191566922a8f08e2a5abf64fde8cfcb) pacific (dev)", 2020-11-20T11:39:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "0", 2020-11-20T11:39:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2020-11-20T11:39:12.925 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-11-20T11:39:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "18759", 2020-11-20T11:39:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2020-11-20T11:39:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2020-11-20T11:39:12.926 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2020-11-20T11:39:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2020-11-20T11:39:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4620, 2020-11-20T11:39:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2020-11-20T11:39:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2020-11-20T11:39:12.927 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2020-11-20T11:39:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 4620 2020-11-20T11:39:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2020-11-20T11:39:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2020-11-20T11:39:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2020-11-20T11:39:12.928 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:39:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1001662960 2020-11-20T11:39:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: } 2020-11-20T11:39:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2020-11-20T11:39:12.929 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2020-11-20T11:39:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2020-11-20T11:39:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2020-11-20T11:39:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1001662960 2020-11-20T11:39:12.930 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2020-11-20T11:39:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.4620 192.168.0.1:0/1001662960", 2020-11-20T11:39:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/1001662960", 2020-11-20T11:39:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2020-11-20T11:39:12.931 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 6, 2020-11-20T11:39:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 24, 2020-11-20T11:39:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2020-11-20T11:39:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2020-11-20T11:39:12.932 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2020-11-20T11:39:12.932 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T11:39:12.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:12.934 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-11-20T11:39:12.935 INFO:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:39:12.941 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2020-11-20T11:39:12.942 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-11-20T11:39:12.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T11:39:12.943 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-11-20T11:39:12.999 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T11:39:13.013 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:39:13.015 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T11:39:13.015 INFO:tasks.workunit:timeout=3h 2020-11-20T11:39:13.015 INFO:tasks.workunit:cleanup=True 2020-11-20T11:39:13.016 INFO:teuthology.orchestra.run.smithi161:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T11:39:13.052 INFO:teuthology.orchestra.run.smithi161.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T11:39:13.052 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-11-20T11:39:13.052 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 31h/49d Inode: 1 Links: 2 2020-11-20T11:39:13.053 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T11:39:13.053 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T11:39:13.053 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2020-11-20 11:38:53.957873515 +0000 2020-11-20T11:39:13.053 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2020-11-20 11:39:12.998476546 +0000 2020-11-20T11:39:13.054 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2020-11-20T11:39:13.054 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T11:39:13.054 INFO:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T11:39:13.125 INFO:teuthology.orchestra.run.smithi161:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:39:13.234 INFO:tasks.workunit.client.0.smithi161.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T11:39:30.219 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:39:30.222 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:40:00.346 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:40:00.349 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:40:03.543 INFO:tasks.workunit.client.0.smithi161.stderr:Note: checking out 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T11:40:03.544 INFO:tasks.workunit.client.0.smithi161.stderr: 2020-11-20T11:40:03.544 INFO:tasks.workunit.client.0.smithi161.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T11:40:03.544 INFO:tasks.workunit.client.0.smithi161.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T11:40:03.544 INFO:tasks.workunit.client.0.smithi161.stderr:state without impacting any branches by performing another checkout. 2020-11-20T11:40:03.545 INFO:tasks.workunit.client.0.smithi161.stderr: 2020-11-20T11:40:03.545 INFO:tasks.workunit.client.0.smithi161.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T11:40:03.545 INFO:tasks.workunit.client.0.smithi161.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-11-20T11:40:03.545 INFO:tasks.workunit.client.0.smithi161.stderr: 2020-11-20T11:40:03.545 INFO:tasks.workunit.client.0.smithi161.stderr: git checkout -b 2020-11-20T11:40:03.546 INFO:tasks.workunit.client.0.smithi161.stderr: 2020-11-20T11:40:03.546 INFO:tasks.workunit.client.0.smithi161.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T11:40:03.547 INFO:teuthology.orchestra.run.smithi161:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T11:40:03.555 INFO:tasks.workunit.client.0.smithi161.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T11:40:03.557 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:40:03.557 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T11:40:04.366 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T11:40:04.500 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T11:40:04.556 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T11:40:04.559 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:40:04.559 INFO:tasks.workunit.client.0.smithi161.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T11:40:04.617 INFO:tasks.workunit.client.0.smithi161.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T11:40:04.622 INFO:teuthology.orchestra.run.smithi161:> set -ex 2020-11-20T11:40:04.622 INFO:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:40:04.667 INFO:teuthology.orchestra.run.smithi161.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T11:40:04.668 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-tests/ceph-admin-commands.shrgw/test_rgw_reshard.pyrgw/s3_user_quota.plrgw/test_rgw_gc_log.shrgw/run-s3tests.shrgw/run-reshard.shrgw/s3_multipart_upload.plrgw/test_rgw_obj.shrgw/s3_bucket_quota.plrgw/test_rgw_orphan_list.shrgw/test_rgw_throttle.shosdc/stress_objectcacher.shceph-helpers-root.shobjectstore/test_fuse.shrbd/test_rbd_mirror.shrbd/rbd_groups.shrbd/permissions.shrbd/image_read.shrbd/import_export.shrbd/krbd_fallocate.shrbd/rbd-ggate.shrbd/test_rbdmap_RBDMAPFILE.shrbd/krbd_data_pool.shrbd/test_librbd.shrbd/notify_slave.shrbd/krbd_latest_osdmap_on_map.shrbd/huge-tickets.shrbd/rbd_mirror_journal.shrbd/test_admin_socket.shrbd/diff.shrbd/test_librbd_python.shrbd/concurrent.shrbd/merge_diff.shrbd/krbd_exclusive_option.shrbd/krbd_udev_symlinks.shrbd/krbd_namespaces.shrbd/simple_big.shrbd/issue-20295.shrbd/krbd_udev_enumerate.shrbd/test_lock_fence.shrbd/rbd_mirror_fsx_compare.shrbd/qemu_rebuild_object_map.shrbd/rbd_mirror_ha.shrbd/read-flags.shrbd/krbd_stable_pages_required.shrbd/journal.shrbd/krbd_udev_netns.shrbd/verify_pool.shrbd/qemu_dynamic_features.shrbd/map-unmap.shrbd/notify_master.shrbd/cli_generic.shrbd/krbd_wac.shrbd/rbd_mirror_helpers.shrbd/krbd_huge_osdmap.shrbd/rbd_mirror_fsx_prepare.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd_mirror_stress.shrbd/rbd-nbd.shrbd/qemu-iotests.shrbd/kernel.shrbd/test_rbd_tasks.shrbd/qos.shrbd/map-snapshot-io.shrbd/rbd_mirror_snapshot.shrbd/rbd_mirror_bootstrap.shrbd/diff_continuous.shtrue.shcaps/mon_commands.shlibcephfs/test.shsuites/iozone.shsuites/fio.shsuites/iozone-sync.shsuites/fsstress.shsuites/pjd.shsuites/iogen.shsuites/bonnie.shsuites/cephfs_journal_tool_smoke.shsuites/dbench-short.shsuites/dbench.shsuites/blogbench.shsuites/fsync-tester.shsuites/fsx.shsuites/ffsb.shmon/rbd_snaps_ops.shmon/pool_ops.shmon/pg_autoscaler.shmon/osd.shmon/config.shmon/test_config_key_caps.shmon/ping.pymon/crush_ops.shmon/auth_caps.shmon/caps.shmon/test_mon_osdmap_prune.shmon/test_mon_config_key.pycls/test_cls_log.shcls/test_cls_lock.shcls/test_cls_refcount.shcls/test_cls_numops.shcls/test_cls_hello.shcls/test_cls_journal.shcls/test_cls_2pc_queue.shcls/test_cls_cmpomap.shcls/test_cls_sdk.shcls/test_cls_rbd.shcls/test_cls_rgw.shmgr/test_localpool.shdirect_io/test_short_dio_readdirect_io/direct_io_testdirect_io/test_sync_iodirect_io/misc.shdirect_io/big.shcephadm/test_cephadm.shcephadm/test_dashboard_e2e.shcephadm/create_iscsi_disks.shcephadm/test_adoption.shcephadm/test_repos.shrename/pri_rem.shrename/prepare.shrename/pri_pri.shrename/dir_pri_nul.shrename/rem_rem.shrename/pri_nul.shrename/rem_nul.shrename/dir_pri_pri.shrename/all.shrename/rem_pri.shpost-file.sherasure-code/encode-decode-non-regression.sherasure-code/bench.shhadoop/terasort.shhadoop/wordcount.shhadoop/repl.shkernel_untar_build.shrest/test_mgr_rest_api.pyrest/test-restful.shrados/load-gen-big.shrados/stress_watch.shrados/load-gen-mix.shrados/test_dedup_tool.shrados/test_cache_pool.shrados/clone.shrados/load-gen-mix-small-long.shrados/load-gen-mostlyread.shrados/load-gen-mix-small.shrados/version_number_sanity.shrados/test_crash.shrados/test_envlibrados_for_rocksdb.shrados/test_rados_tool.shrados/test_hang.shrados/test_librados_build.shrados/test_pool_quota.shrados/test_health_warnings.shrados/test_large_omap_detection.pyrados/test_alloc_hint.shrados/test_pool_access.shrados/test_python.shrados/test_rados_timeouts.shrados/test.shfs/misc/acl.shfs/misc/dirfrag.shfs/misc/filelock_interrupt.pyfs/misc/direct_io.pyfs/misc/subvolume.shfs/misc/layout_vxattrs.shfs/misc/trivial_sync.shfs/misc/xattrs.shfs/misc/i_complete_vs_rename.shfs/misc/chmod.shfs/misc/filelock_deadlock.pyfs/misc/rstats.shfs/misc/multiple_rsync.shfs/misc/mkpool_layout_vxattrs.shfs/quota/quota.shfs/multiclient_sync_read_eof.pyfs/snap-hierarchy.shfs/test_o_truncfs/snaps/snap-rm-diff.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-snap-rename.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-double-null.shfs/snaps/snaptest-2.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-1.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-realm-split.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-git-ceph.shfs/snaps/snaptest-0.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-hardlink.shfs/upgrade/volume_clientfs/test_o_trunc.shfs/test_python.shfs/norstats/kernel_untar_tar.shrestart/test-backtraces.pycephtool/test_kvstore_tool.shcephtool/test_daemon.shcephtool/test.sh 2020-11-20T11:40:04.669 INFO:teuthology.orchestra.run.smithi161.stderr:9+1 records in 2020-11-20T11:40:04.669 INFO:teuthology.orchestra.run.smithi161.stderr:9+1 records out 2020-11-20T11:40:04.669 INFO:teuthology.orchestra.run.smithi161.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 0.000196163 s, 24.2 MB/s 2020-11-20T11:40:04.669 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2020-11-20T11:40:04.671 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2020-11-20T11:40:04.671 INFO:teuthology.orchestra.run.smithi161:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2020-11-20T11:40:04.753 INFO:tasks.workunit.client.0.smithi161.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T11:40:04.753 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T11:40:04.753 INFO:tasks.workunit.client.0.smithi161.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T11:40:04.760 INFO:tasks.workunit.client.0.smithi161.stdout:0 of 1 processes prepared for launch 0 sec 2020-11-20T11:40:04.860 INFO:tasks.workunit.client.0.smithi161.stdout:1 of 1 processes prepared for launch 0 sec 2020-11-20T11:40:04.861 INFO:tasks.workunit.client.0.smithi161.stdout:releasing clients 2020-11-20T11:40:05.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 651 21.06 MB/sec warmup 1 sec latency 17.467 ms 2020-11-20T11:40:06.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 1169 11.51 MB/sec warmup 2 sec latency 16.567 ms 2020-11-20T11:40:07.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 1791 8.77 MB/sec warmup 3 sec latency 17.534 ms 2020-11-20T11:40:08.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 2428 7.03 MB/sec warmup 4 sec latency 15.300 ms 2020-11-20T11:40:09.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 3199 6.86 MB/sec warmup 5 sec latency 21.903 ms 2020-11-20T11:40:10.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 3792 6.63 MB/sec warmup 6 sec latency 16.081 ms 2020-11-20T11:40:11.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 4068 5.72 MB/sec warmup 7 sec latency 17.067 ms 2020-11-20T11:40:12.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 4505 5.11 MB/sec warmup 8 sec latency 16.002 ms 2020-11-20T11:40:13.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 5117 5.02 MB/sec warmup 9 sec latency 14.508 ms 2020-11-20T11:40:14.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 5752 4.59 MB/sec warmup 10 sec latency 15.443 ms 2020-11-20T11:40:15.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 6457 4.72 MB/sec warmup 11 sec latency 19.381 ms 2020-11-20T11:40:16.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 7135 4.80 MB/sec warmup 12 sec latency 22.702 ms 2020-11-20T11:40:17.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 7488 4.55 MB/sec warmup 13 sec latency 18.832 ms 2020-11-20T11:40:18.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 7824 4.25 MB/sec warmup 14 sec latency 18.582 ms 2020-11-20T11:40:19.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 8323 4.09 MB/sec warmup 15 sec latency 31.165 ms 2020-11-20T11:40:20.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 8968 4.04 MB/sec warmup 16 sec latency 17.190 ms 2020-11-20T11:40:21.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 9581 3.94 MB/sec warmup 17 sec latency 27.666 ms 2020-11-20T11:40:22.861 INFO:tasks.workunit.client.0.smithi161.stdout: 1 10123 3.99 MB/sec warmup 18 sec latency 218.981 ms 2020-11-20T11:40:23.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 10806 4.05 MB/sec warmup 19 sec latency 20.400 ms 2020-11-20T11:40:24.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 11083 3.92 MB/sec warmup 20 sec latency 19.045 ms 2020-11-20T11:40:25.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 11449 3.75 MB/sec warmup 21 sec latency 22.635 ms 2020-11-20T11:40:26.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 11934 3.66 MB/sec warmup 22 sec latency 25.122 ms 2020-11-20T11:40:27.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 12542 3.64 MB/sec warmup 23 sec latency 16.298 ms 2020-11-20T11:40:28.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 13102 3.56 MB/sec warmup 24 sec latency 75.936 ms 2020-11-20T11:40:29.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 13859 3.67 MB/sec warmup 25 sec latency 21.917 ms 2020-11-20T11:40:30.421 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:40:30.426 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:40:30.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 14406 3.74 MB/sec warmup 26 sec latency 16.473 ms 2020-11-20T11:40:31.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 14649 3.61 MB/sec warmup 27 sec latency 18.861 ms 2020-11-20T11:40:32.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 15001 3.50 MB/sec warmup 28 sec latency 22.089 ms 2020-11-20T11:40:33.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 15593 3.53 MB/sec warmup 29 sec latency 28.937 ms 2020-11-20T11:40:34.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 16123 3.43 MB/sec warmup 30 sec latency 15.982 ms 2020-11-20T11:40:35.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 16695 3.39 MB/sec warmup 31 sec latency 26.588 ms 2020-11-20T11:40:36.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 17469 3.49 MB/sec warmup 32 sec latency 21.424 ms 2020-11-20T11:40:37.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 17964 3.52 MB/sec warmup 33 sec latency 15.737 ms 2020-11-20T11:40:38.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 18204 3.43 MB/sec warmup 34 sec latency 20.260 ms 2020-11-20T11:40:39.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 18556 3.34 MB/sec warmup 35 sec latency 19.532 ms 2020-11-20T11:40:40.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 19127 3.38 MB/sec warmup 36 sec latency 29.129 ms 2020-11-20T11:40:41.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 19628 3.30 MB/sec warmup 37 sec latency 19.578 ms 2020-11-20T11:40:42.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 20238 3.26 MB/sec warmup 38 sec latency 26.736 ms 2020-11-20T11:40:43.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 20969 3.33 MB/sec warmup 39 sec latency 29.529 ms 2020-11-20T11:40:44.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 21529 3.39 MB/sec warmup 40 sec latency 16.898 ms 2020-11-20T11:40:45.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 21775 3.31 MB/sec warmup 41 sec latency 26.173 ms 2020-11-20T11:40:46.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 22122 3.24 MB/sec warmup 42 sec latency 20.015 ms 2020-11-20T11:40:47.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 22575 3.21 MB/sec warmup 43 sec latency 29.544 ms 2020-11-20T11:40:48.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 23169 3.21 MB/sec warmup 44 sec latency 17.599 ms 2020-11-20T11:40:49.862 INFO:tasks.workunit.client.0.smithi161.stdout: 1 23755 3.17 MB/sec warmup 45 sec latency 27.143 ms 2020-11-20T11:40:50.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 24354 3.23 MB/sec warmup 46 sec latency 19.032 ms 2020-11-20T11:40:51.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 25010 3.27 MB/sec warmup 47 sec latency 25.675 ms 2020-11-20T11:40:52.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 25286 3.23 MB/sec warmup 48 sec latency 18.318 ms 2020-11-20T11:40:53.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 25604 3.17 MB/sec warmup 49 sec latency 22.406 ms 2020-11-20T11:40:54.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 26081 3.14 MB/sec warmup 50 sec latency 24.653 ms 2020-11-20T11:40:55.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 26584 3.14 MB/sec warmup 51 sec latency 94.736 ms 2020-11-20T11:40:56.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 27276 3.11 MB/sec warmup 52 sec latency 19.938 ms 2020-11-20T11:40:57.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 27878 3.16 MB/sec warmup 53 sec latency 20.452 ms 2020-11-20T11:40:58.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 28514 3.20 MB/sec warmup 54 sec latency 25.193 ms 2020-11-20T11:40:59.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 28813 3.16 MB/sec warmup 55 sec latency 20.068 ms 2020-11-20T11:41:00.508 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:41:00.510 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:41:00.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 29161 3.11 MB/sec warmup 56 sec latency 21.610 ms 2020-11-20T11:41:01.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 29654 3.09 MB/sec warmup 57 sec latency 21.057 ms 2020-11-20T11:41:02.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 30266 3.09 MB/sec warmup 58 sec latency 17.541 ms 2020-11-20T11:41:03.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 30872 3.07 MB/sec warmup 59 sec latency 15.597 ms 2020-11-20T11:41:04.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 31671 3.13 MB/sec warmup 60 sec latency 24.990 ms 2020-11-20T11:41:05.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 32179 3.16 MB/sec warmup 61 sec latency 15.467 ms 2020-11-20T11:41:06.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 32415 3.11 MB/sec warmup 62 sec latency 19.249 ms 2020-11-20T11:41:07.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 32767 3.07 MB/sec warmup 63 sec latency 22.680 ms 2020-11-20T11:41:08.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 33349 3.10 MB/sec warmup 64 sec latency 17.357 ms 2020-11-20T11:41:09.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 33896 3.06 MB/sec warmup 65 sec latency 18.552 ms 2020-11-20T11:41:10.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 34523 3.05 MB/sec warmup 66 sec latency 24.100 ms 2020-11-20T11:41:11.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 35289 3.10 MB/sec warmup 67 sec latency 24.262 ms 2020-11-20T11:41:12.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 35758 3.12 MB/sec warmup 68 sec latency 17.995 ms 2020-11-20T11:41:13.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 36030 3.08 MB/sec warmup 69 sec latency 18.991 ms 2020-11-20T11:41:14.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 36423 3.04 MB/sec warmup 70 sec latency 20.338 ms 2020-11-20T11:41:15.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 37007 3.06 MB/sec warmup 71 sec latency 19.002 ms 2020-11-20T11:41:16.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 37599 3.03 MB/sec warmup 72 sec latency 19.985 ms 2020-11-20T11:41:17.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 38223 3.06 MB/sec warmup 73 sec latency 23.417 ms 2020-11-20T11:41:18.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 38894 3.06 MB/sec warmup 74 sec latency 22.473 ms 2020-11-20T11:41:19.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 39356 3.08 MB/sec warmup 75 sec latency 17.871 ms 2020-11-20T11:41:20.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 39651 3.04 MB/sec warmup 76 sec latency 18.479 ms 2020-11-20T11:41:21.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 40117 3.03 MB/sec warmup 77 sec latency 22.007 ms 2020-11-20T11:41:22.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 40705 3.03 MB/sec warmup 78 sec latency 21.711 ms 2020-11-20T11:41:23.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 41406 3.02 MB/sec warmup 79 sec latency 16.847 ms 2020-11-20T11:41:24.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 42027 3.05 MB/sec warmup 80 sec latency 20.103 ms 2020-11-20T11:41:25.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 42707 3.08 MB/sec warmup 81 sec latency 21.907 ms 2020-11-20T11:41:26.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 42999 3.05 MB/sec warmup 82 sec latency 20.705 ms 2020-11-20T11:41:27.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 43320 3.02 MB/sec warmup 83 sec latency 18.513 ms 2020-11-20T11:41:28.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 43784 3.01 MB/sec warmup 84 sec latency 24.619 ms 2020-11-20T11:41:29.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 44390 3.01 MB/sec warmup 85 sec latency 16.601 ms 2020-11-20T11:41:30.564 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:41:30.566 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:41:30.863 INFO:tasks.workunit.client.0.smithi161.stdout: 1 44894 2.99 MB/sec warmup 86 sec latency 334.009 ms 2020-11-20T11:41:31.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 45006 2.96 MB/sec warmup 87 sec latency 1033.639 ms 2020-11-20T11:41:32.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 45584 2.99 MB/sec warmup 88 sec latency 170.839 ms 2020-11-20T11:41:33.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 46233 3.01 MB/sec warmup 89 sec latency 56.930 ms 2020-11-20T11:41:34.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 46536 3.00 MB/sec warmup 90 sec latency 18.911 ms 2020-11-20T11:41:35.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 46834 2.96 MB/sec warmup 91 sec latency 19.311 ms 2020-11-20T11:41:36.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 47356 2.95 MB/sec warmup 92 sec latency 14.198 ms 2020-11-20T11:41:37.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 48008 2.96 MB/sec warmup 93 sec latency 14.199 ms 2020-11-20T11:41:38.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 48637 2.95 MB/sec warmup 94 sec latency 16.558 ms 2020-11-20T11:41:39.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 49465 2.99 MB/sec warmup 95 sec latency 20.791 ms 2020-11-20T11:41:40.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 49959 3.00 MB/sec warmup 96 sec latency 16.495 ms 2020-11-20T11:41:41.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 50255 2.98 MB/sec warmup 97 sec latency 16.851 ms 2020-11-20T11:41:42.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 50729 2.97 MB/sec warmup 98 sec latency 14.276 ms 2020-11-20T11:41:43.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 51313 2.97 MB/sec warmup 99 sec latency 20.149 ms 2020-11-20T11:41:44.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 52021 2.96 MB/sec warmup 100 sec latency 20.478 ms 2020-11-20T11:41:45.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 52670 2.98 MB/sec warmup 101 sec latency 19.913 ms 2020-11-20T11:41:46.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 53356 3.00 MB/sec warmup 102 sec latency 18.939 ms 2020-11-20T11:41:47.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 53668 2.99 MB/sec warmup 103 sec latency 18.556 ms 2020-11-20T11:41:48.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 54034 2.96 MB/sec warmup 104 sec latency 16.820 ms 2020-11-20T11:41:49.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 54525 2.95 MB/sec warmup 105 sec latency 21.726 ms 2020-11-20T11:41:50.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 55215 2.96 MB/sec warmup 106 sec latency 15.306 ms 2020-11-20T11:41:51.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 55823 2.95 MB/sec warmup 107 sec latency 22.070 ms 2020-11-20T11:41:52.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 56586 2.98 MB/sec warmup 108 sec latency 25.195 ms 2020-11-20T11:41:53.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 57048 3.00 MB/sec warmup 109 sec latency 17.285 ms 2020-11-20T11:41:54.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 57321 2.97 MB/sec warmup 110 sec latency 20.692 ms 2020-11-20T11:41:55.864 INFO:tasks.workunit.client.0.smithi161.stdout: 1 57718 2.95 MB/sec warmup 111 sec latency 27.421 ms 2020-11-20T11:41:56.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 58284 2.96 MB/sec warmup 112 sec latency 25.725 ms 2020-11-20T11:41:57.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 58920 2.94 MB/sec warmup 113 sec latency 19.223 ms 2020-11-20T11:41:58.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 59526 2.96 MB/sec warmup 114 sec latency 20.974 ms 2020-11-20T11:41:59.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 60150 2.97 MB/sec warmup 115 sec latency 23.430 ms 2020-11-20T11:42:00.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 60529 2.98 MB/sec warmup 116 sec latency 202.872 ms 2020-11-20T11:42:01.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 60750 2.96 MB/sec warmup 117 sec latency 340.627 ms 2020-11-20T11:42:02.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 61075 2.94 MB/sec warmup 118 sec latency 20.728 ms 2020-11-20T11:42:03.778 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:42:03.780 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:42:03.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 61546 2.93 MB/sec warmup 119 sec latency 24.518 ms 2020-11-20T11:42:05.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 62760 1.76 MB/sec execute 1 sec latency 23.948 ms 2020-11-20T11:42:06.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 63499 3.89 MB/sec execute 2 sec latency 21.485 ms 2020-11-20T11:42:07.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 64030 4.15 MB/sec execute 3 sec latency 27.850 ms 2020-11-20T11:42:08.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 64301 3.43 MB/sec execute 4 sec latency 22.188 ms 2020-11-20T11:42:09.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 64650 2.83 MB/sec execute 5 sec latency 21.002 ms 2020-11-20T11:42:10.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 65117 2.64 MB/sec execute 6 sec latency 28.142 ms 2020-11-20T11:42:11.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 65712 2.73 MB/sec execute 7 sec latency 20.706 ms 2020-11-20T11:42:12.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 66312 2.61 MB/sec execute 8 sec latency 21.465 ms 2020-11-20T11:42:13.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 67057 3.00 MB/sec execute 9 sec latency 35.259 ms 2020-11-20T11:42:14.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 67581 3.16 MB/sec execute 10 sec latency 26.988 ms 2020-11-20T11:42:15.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 67860 2.99 MB/sec execute 11 sec latency 18.870 ms 2020-11-20T11:42:16.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 68210 2.77 MB/sec execute 12 sec latency 18.142 ms 2020-11-20T11:42:17.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 68659 2.69 MB/sec execute 13 sec latency 28.272 ms 2020-11-20T11:42:18.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 69266 2.73 MB/sec execute 14 sec latency 16.285 ms 2020-11-20T11:42:19.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 69872 2.67 MB/sec execute 15 sec latency 33.653 ms 2020-11-20T11:42:20.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 70594 2.88 MB/sec execute 16 sec latency 25.743 ms 2020-11-20T11:42:21.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 71109 2.98 MB/sec execute 17 sec latency 18.374 ms 2020-11-20T11:42:22.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 71371 2.89 MB/sec execute 18 sec latency 20.239 ms 2020-11-20T11:42:23.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 71679 2.75 MB/sec execute 19 sec latency 17.644 ms 2020-11-20T11:42:24.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 72137 2.70 MB/sec execute 20 sec latency 25.173 ms 2020-11-20T11:42:25.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 72696 2.73 MB/sec execute 21 sec latency 20.009 ms 2020-11-20T11:42:26.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 73374 2.68 MB/sec execute 22 sec latency 18.268 ms 2020-11-20T11:42:27.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 73971 2.81 MB/sec execute 23 sec latency 22.538 ms 2020-11-20T11:42:28.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 74625 2.91 MB/sec execute 24 sec latency 23.489 ms 2020-11-20T11:42:29.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 74928 2.85 MB/sec execute 25 sec latency 19.610 ms 2020-11-20T11:42:30.865 INFO:tasks.workunit.client.0.smithi161.stdout: 1 75261 2.75 MB/sec execute 26 sec latency 16.463 ms 2020-11-20T11:42:31.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 75764 2.71 MB/sec execute 27 sec latency 25.403 ms 2020-11-20T11:42:32.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 76404 2.73 MB/sec execute 28 sec latency 19.353 ms 2020-11-20T11:42:33.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 77097 2.73 MB/sec execute 29 sec latency 16.071 ms 2020-11-20T11:42:33.883 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:42:33.888 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:42:34.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 77877 2.85 MB/sec execute 30 sec latency 19.506 ms 2020-11-20T11:42:35.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 78362 2.90 MB/sec execute 31 sec latency 16.772 ms 2020-11-20T11:42:36.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 78644 2.82 MB/sec execute 32 sec latency 20.273 ms 2020-11-20T11:42:37.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 79125 2.79 MB/sec execute 33 sec latency 21.304 ms 2020-11-20T11:42:38.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 79725 2.81 MB/sec execute 34 sec latency 27.489 ms 2020-11-20T11:42:39.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 80433 2.78 MB/sec execute 35 sec latency 14.793 ms 2020-11-20T11:42:40.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 81072 2.86 MB/sec execute 36 sec latency 29.045 ms 2020-11-20T11:42:41.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 81748 2.92 MB/sec execute 37 sec latency 20.807 ms 2020-11-20T11:42:42.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 82048 2.88 MB/sec execute 38 sec latency 16.593 ms 2020-11-20T11:42:43.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 82420 2.82 MB/sec execute 39 sec latency 24.067 ms 2020-11-20T11:42:44.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 82771 2.79 MB/sec execute 40 sec latency 291.262 ms 2020-11-20T11:42:45.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 83342 2.80 MB/sec execute 41 sec latency 19.793 ms 2020-11-20T11:42:46.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 84037 2.77 MB/sec execute 42 sec latency 16.163 ms 2020-11-20T11:42:47.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 84644 2.84 MB/sec execute 43 sec latency 25.038 ms 2020-11-20T11:42:48.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 85286 2.89 MB/sec execute 44 sec latency 21.179 ms 2020-11-20T11:42:49.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 85569 2.86 MB/sec execute 45 sec latency 22.694 ms 2020-11-20T11:42:50.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 85887 2.80 MB/sec execute 46 sec latency 26.974 ms 2020-11-20T11:42:51.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 86356 2.78 MB/sec execute 47 sec latency 22.058 ms 2020-11-20T11:42:52.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 86907 2.79 MB/sec execute 48 sec latency 21.937 ms 2020-11-20T11:42:53.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 87574 2.77 MB/sec execute 49 sec latency 21.382 ms 2020-11-20T11:42:54.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 88161 2.82 MB/sec execute 50 sec latency 22.231 ms 2020-11-20T11:42:55.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 88811 2.87 MB/sec execute 51 sec latency 15.844 ms 2020-11-20T11:42:56.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 89108 2.84 MB/sec execute 52 sec latency 21.458 ms 2020-11-20T11:42:57.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 89399 2.79 MB/sec execute 53 sec latency 23.514 ms 2020-11-20T11:42:58.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 89819 2.77 MB/sec execute 54 sec latency 23.460 ms 2020-11-20T11:42:59.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 90375 2.78 MB/sec execute 55 sec latency 15.703 ms 2020-11-20T11:43:00.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 91060 2.76 MB/sec execute 56 sec latency 20.017 ms 2020-11-20T11:43:01.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 91625 2.80 MB/sec execute 57 sec latency 16.917 ms 2020-11-20T11:43:02.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 92251 2.85 MB/sec execute 58 sec latency 27.078 ms 2020-11-20T11:43:03.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 92572 2.82 MB/sec execute 59 sec latency 20.147 ms 2020-11-20T11:43:03.955 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:43:03.957 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:43:04.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 92830 2.78 MB/sec execute 60 sec latency 20.733 ms 2020-11-20T11:43:05.866 INFO:tasks.workunit.client.0.smithi161.stdout: 1 93245 2.75 MB/sec execute 61 sec latency 18.785 ms 2020-11-20T11:43:06.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 93814 2.77 MB/sec execute 62 sec latency 22.205 ms 2020-11-20T11:43:07.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 94429 2.74 MB/sec execute 63 sec latency 16.879 ms 2020-11-20T11:43:08.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 95043 2.78 MB/sec execute 64 sec latency 26.864 ms 2020-11-20T11:43:09.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 95773 2.83 MB/sec execute 65 sec latency 21.133 ms 2020-11-20T11:43:10.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 96129 2.81 MB/sec execute 66 sec latency 18.750 ms 2020-11-20T11:43:11.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 96397 2.77 MB/sec execute 67 sec latency 21.648 ms 2020-11-20T11:43:12.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 96819 2.75 MB/sec execute 68 sec latency 18.658 ms 2020-11-20T11:43:13.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 97404 2.77 MB/sec execute 69 sec latency 26.351 ms 2020-11-20T11:43:14.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 98030 2.74 MB/sec execute 70 sec latency 16.376 ms 2020-11-20T11:43:15.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 98711 2.79 MB/sec execute 71 sec latency 21.443 ms 2020-11-20T11:43:16.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 99353 2.82 MB/sec execute 72 sec latency 19.721 ms 2020-11-20T11:43:17.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 99702 2.81 MB/sec execute 73 sec latency 20.698 ms 2020-11-20T11:43:18.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 99973 2.77 MB/sec execute 74 sec latency 18.299 ms 2020-11-20T11:43:19.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 100420 2.76 MB/sec execute 75 sec latency 59.666 ms 2020-11-20T11:43:20.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 100994 2.77 MB/sec execute 76 sec latency 19.619 ms 2020-11-20T11:43:21.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 101687 2.75 MB/sec execute 77 sec latency 20.077 ms 2020-11-20T11:43:22.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 102288 2.79 MB/sec execute 78 sec latency 25.014 ms 2020-11-20T11:43:23.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 102990 2.82 MB/sec execute 79 sec latency 24.896 ms 2020-11-20T11:43:24.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 103290 2.80 MB/sec execute 80 sec latency 162.098 ms 2020-11-20T11:43:25.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 103633 2.77 MB/sec execute 81 sec latency 21.382 ms 2020-11-20T11:43:26.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 104157 2.76 MB/sec execute 82 sec latency 22.987 ms 2020-11-20T11:43:27.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 104797 2.77 MB/sec execute 83 sec latency 15.067 ms 2020-11-20T11:43:28.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 105466 2.76 MB/sec execute 84 sec latency 20.008 ms 2020-11-20T11:43:29.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 106230 2.81 MB/sec execute 85 sec latency 21.863 ms 2020-11-20T11:43:30.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 106707 2.83 MB/sec execute 86 sec latency 16.304 ms 2020-11-20T11:43:31.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 106994 2.80 MB/sec execute 87 sec latency 18.848 ms 2020-11-20T11:43:32.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 107421 2.77 MB/sec execute 88 sec latency 21.495 ms 2020-11-20T11:43:33.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 108028 2.79 MB/sec execute 89 sec latency 18.591 ms 2020-11-20T11:43:34.003 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:43:34.005 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:43:34.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 108662 2.77 MB/sec execute 90 sec latency 19.411 ms 2020-11-20T11:43:35.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 109348 2.80 MB/sec execute 91 sec latency 23.556 ms 2020-11-20T11:43:36.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 110033 2.83 MB/sec execute 92 sec latency 19.638 ms 2020-11-20T11:43:37.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 110380 2.82 MB/sec execute 93 sec latency 21.104 ms 2020-11-20T11:43:38.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 110711 2.79 MB/sec execute 94 sec latency 18.835 ms 2020-11-20T11:43:39.867 INFO:tasks.workunit.client.0.smithi161.stdout: 1 111205 2.78 MB/sec execute 95 sec latency 17.619 ms 2020-11-20T11:43:40.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 111776 2.79 MB/sec execute 96 sec latency 21.990 ms 2020-11-20T11:43:41.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 112402 2.78 MB/sec execute 97 sec latency 21.637 ms 2020-11-20T11:43:42.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 112992 2.81 MB/sec execute 98 sec latency 23.298 ms 2020-11-20T11:43:43.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 113636 2.83 MB/sec execute 99 sec latency 23.154 ms 2020-11-20T11:43:44.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 113925 2.81 MB/sec execute 100 sec latency 20.699 ms 2020-11-20T11:43:45.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 114220 2.79 MB/sec execute 101 sec latency 21.559 ms 2020-11-20T11:43:46.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 114677 2.78 MB/sec execute 102 sec latency 23.977 ms 2020-11-20T11:43:47.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 115211 2.78 MB/sec execute 103 sec latency 29.513 ms 2020-11-20T11:43:48.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 115903 2.77 MB/sec execute 104 sec latency 17.937 ms 2020-11-20T11:43:49.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 116457 2.80 MB/sec execute 105 sec latency 23.561 ms 2020-11-20T11:43:50.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 117090 2.82 MB/sec execute 106 sec latency 26.453 ms 2020-11-20T11:43:51.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 117410 2.81 MB/sec execute 107 sec latency 20.658 ms 2020-11-20T11:43:52.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 117674 2.78 MB/sec execute 108 sec latency 21.162 ms 2020-11-20T11:43:53.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 118070 2.77 MB/sec execute 109 sec latency 24.896 ms 2020-11-20T11:43:54.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 118625 2.78 MB/sec execute 110 sec latency 24.297 ms 2020-11-20T11:43:55.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 119230 2.76 MB/sec execute 111 sec latency 23.086 ms 2020-11-20T11:43:56.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 119699 2.76 MB/sec execute 112 sec latency 23.420 ms 2020-11-20T11:43:57.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 120449 2.79 MB/sec execute 113 sec latency 26.250 ms 2020-11-20T11:43:58.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 120889 2.80 MB/sec execute 114 sec latency 21.826 ms 2020-11-20T11:43:59.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 121064 2.78 MB/sec execute 115 sec latency 361.542 ms 2020-11-20T11:44:00.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 121431 2.76 MB/sec execute 116 sec latency 21.649 ms 2020-11-20T11:44:01.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 121923 2.75 MB/sec execute 117 sec latency 32.825 ms 2020-11-20T11:44:02.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 122551 2.76 MB/sec execute 118 sec latency 15.000 ms 2020-11-20T11:44:03.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 123190 2.75 MB/sec execute 119 sec latency 25.070 ms 2020-11-20T11:44:04.050 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:44:04.052 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:44:04.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 123955 2.78 MB/sec execute 120 sec latency 21.782 ms 2020-11-20T11:44:05.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 124440 2.80 MB/sec execute 121 sec latency 21.024 ms 2020-11-20T11:44:06.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 124716 2.78 MB/sec execute 122 sec latency 25.224 ms 2020-11-20T11:44:07.868 INFO:tasks.workunit.client.0.smithi161.stdout: 1 125124 2.76 MB/sec execute 123 sec latency 17.632 ms 2020-11-20T11:44:08.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 125705 2.77 MB/sec execute 124 sec latency 35.726 ms 2020-11-20T11:44:09.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 126330 2.76 MB/sec execute 125 sec latency 18.998 ms 2020-11-20T11:44:10.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 126948 2.78 MB/sec execute 126 sec latency 21.633 ms 2020-11-20T11:44:11.869 INFO:tasks.workunit.client.0.smithi161.stdout: 1 127712 2.81 MB/sec execute 127 sec latency 26.789 ms 2020-11-20T11:44:12.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 128086 2.80 MB/sec execute 128 sec latency 28.803 ms 2020-11-20T11:44:13.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 128348 2.78 MB/sec execute 129 sec latency 17.476 ms 2020-11-20T11:44:14.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 128821 2.77 MB/sec execute 130 sec latency 29.116 ms 2020-11-20T11:44:15.870 INFO:tasks.workunit.client.0.smithi161.stdout: 1 129417 2.77 MB/sec execute 131 sec latency 20.624 ms 2020-11-20T11:44:16.871 INFO:tasks.workunit.client.0.smithi161.stdout: 1 130112 2.77 MB/sec execute 132 sec latency 16.742 ms 2020-11-20T11:44:17.871 INFO:tasks.workunit.client.0.smithi161.stdout: 1 130719 2.79 MB/sec execute 133 sec latency 24.062 ms 2020-11-20T11:44:18.871 INFO:tasks.workunit.client.0.smithi161.stdout: 1 131395 2.80 MB/sec execute 134 sec latency 28.537 ms 2020-11-20T11:44:19.872 INFO:tasks.workunit.client.0.smithi161.stdout: 1 131688 2.79 MB/sec execute 135 sec latency 21.092 ms 2020-11-20T11:44:20.872 INFO:tasks.workunit.client.0.smithi161.stdout: 1 132031 2.78 MB/sec execute 136 sec latency 16.879 ms 2020-11-20T11:44:21.872 INFO:tasks.workunit.client.0.smithi161.stdout: 1 132528 2.77 MB/sec execute 137 sec latency 25.741 ms 2020-11-20T11:44:22.872 INFO:tasks.workunit.client.0.smithi161.stdout: 1 133148 2.77 MB/sec execute 138 sec latency 20.739 ms 2020-11-20T11:44:23.872 INFO:tasks.workunit.client.0.smithi161.stdout: 1 133756 2.77 MB/sec execute 139 sec latency 22.191 ms 2020-11-20T11:44:24.873 INFO:tasks.workunit.client.0.smithi161.stdout: 1 134564 2.80 MB/sec execute 140 sec latency 25.731 ms 2020-11-20T11:44:25.873 INFO:tasks.workunit.client.0.smithi161.stdout: 1 135062 2.81 MB/sec execute 141 sec latency 17.884 ms 2020-11-20T11:44:26.873 INFO:tasks.workunit.client.0.smithi161.stdout: 1 135321 2.79 MB/sec execute 142 sec latency 18.852 ms 2020-11-20T11:44:27.873 INFO:tasks.workunit.client.0.smithi161.stdout: 1 135729 2.78 MB/sec execute 143 sec latency 19.864 ms 2020-11-20T11:44:28.873 INFO:tasks.workunit.client.0.smithi161.stdout: 1 136300 2.79 MB/sec execute 144 sec latency 39.014 ms 2020-11-20T11:44:29.874 INFO:tasks.workunit.client.0.smithi161.stdout: 1 136897 2.77 MB/sec execute 145 sec latency 18.776 ms 2020-11-20T11:44:30.874 INFO:tasks.workunit.client.0.smithi161.stdout: 1 137537 2.79 MB/sec execute 146 sec latency 16.487 ms 2020-11-20T11:44:31.874 INFO:tasks.workunit.client.0.smithi161.stdout: 1 138309 2.81 MB/sec execute 147 sec latency 28.751 ms 2020-11-20T11:44:32.874 INFO:tasks.workunit.client.0.smithi161.stdout: 1 138659 2.80 MB/sec execute 148 sec latency 20.104 ms 2020-11-20T11:44:33.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 138930 2.79 MB/sec execute 149 sec latency 20.008 ms 2020-11-20T11:44:34.147 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:44:34.153 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:44:34.874 INFO:tasks.workunit.client.0.smithi161.stdout: 1 139288 2.77 MB/sec execute 150 sec latency 148.624 ms 2020-11-20T11:44:35.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 139860 2.78 MB/sec execute 151 sec latency 52.060 ms 2020-11-20T11:44:36.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 140430 2.77 MB/sec execute 152 sec latency 102.322 ms 2020-11-20T11:44:37.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 140975 2.77 MB/sec execute 153 sec latency 19.553 ms 2020-11-20T11:44:38.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 141708 2.79 MB/sec execute 154 sec latency 31.289 ms 2020-11-20T11:44:39.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 142173 2.80 MB/sec execute 155 sec latency 18.076 ms 2020-11-20T11:44:40.875 INFO:tasks.workunit.client.0.smithi161.stdout: 1 142415 2.79 MB/sec execute 156 sec latency 19.419 ms 2020-11-20T11:44:41.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 142795 2.77 MB/sec execute 157 sec latency 21.867 ms 2020-11-20T11:44:42.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 143317 2.78 MB/sec execute 158 sec latency 32.885 ms 2020-11-20T11:44:43.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 143814 2.77 MB/sec execute 159 sec latency 18.315 ms 2020-11-20T11:44:44.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 144399 2.76 MB/sec execute 160 sec latency 16.138 ms 2020-11-20T11:44:45.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 145111 2.78 MB/sec execute 161 sec latency 29.052 ms 2020-11-20T11:44:46.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 145616 2.79 MB/sec execute 162 sec latency 18.808 ms 2020-11-20T11:44:47.876 INFO:tasks.workunit.client.0.smithi161.stdout: 1 145876 2.78 MB/sec execute 163 sec latency 21.887 ms 2020-11-20T11:44:48.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 146181 2.77 MB/sec execute 164 sec latency 17.620 ms 2020-11-20T11:44:49.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 146627 2.76 MB/sec execute 165 sec latency 23.487 ms 2020-11-20T11:44:50.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 147185 2.76 MB/sec execute 166 sec latency 23.538 ms 2020-11-20T11:44:51.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 147850 2.76 MB/sec execute 167 sec latency 16.357 ms 2020-11-20T11:44:52.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 148432 2.77 MB/sec execute 168 sec latency 24.383 ms 2020-11-20T11:44:53.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 149076 2.79 MB/sec execute 169 sec latency 22.618 ms 2020-11-20T11:44:54.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 149365 2.78 MB/sec execute 170 sec latency 19.757 ms 2020-11-20T11:44:55.877 INFO:tasks.workunit.client.0.smithi161.stdout: 1 149609 2.76 MB/sec execute 171 sec latency 20.339 ms 2020-11-20T11:44:56.878 INFO:tasks.workunit.client.0.smithi161.stdout: 1 149979 2.75 MB/sec execute 172 sec latency 160.653 ms 2020-11-20T11:44:57.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 150558 2.76 MB/sec execute 173 sec latency 22.106 ms 2020-11-20T11:44:58.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 151173 2.75 MB/sec execute 174 sec latency 18.541 ms 2020-11-20T11:44:59.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 151761 2.76 MB/sec execute 175 sec latency 27.996 ms 2020-11-20T11:45:00.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 152378 2.77 MB/sec execute 176 sec latency 26.258 ms 2020-11-20T11:45:01.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 152819 2.78 MB/sec execute 177 sec latency 21.621 ms 2020-11-20T11:45:02.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 153076 2.76 MB/sec execute 178 sec latency 24.412 ms 2020-11-20T11:45:03.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 153431 2.75 MB/sec execute 179 sec latency 27.081 ms 2020-11-20T11:45:04.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 153960 2.76 MB/sec execute 180 sec latency 26.288 ms 2020-11-20T11:45:05.879 INFO:tasks.workunit.client.0.smithi161.stdout: 1 154506 2.75 MB/sec execute 181 sec latency 17.848 ms 2020-11-20T11:45:06.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 155052 2.75 MB/sec execute 182 sec latency 22.724 ms 2020-11-20T11:45:07.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 155822 2.77 MB/sec execute 183 sec latency 27.104 ms 2020-11-20T11:45:08.305 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:45:08.308 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:45:08.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 156312 2.78 MB/sec execute 184 sec latency 17.830 ms 2020-11-20T11:45:09.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 156532 2.76 MB/sec execute 185 sec latency 21.309 ms 2020-11-20T11:45:10.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 156882 2.75 MB/sec execute 186 sec latency 19.965 ms 2020-11-20T11:45:11.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 157277 2.74 MB/sec execute 187 sec latency 187.175 ms 2020-11-20T11:45:12.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 157870 2.75 MB/sec execute 188 sec latency 21.316 ms 2020-11-20T11:45:13.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 158422 2.74 MB/sec execute 189 sec latency 270.092 ms 2020-11-20T11:45:14.880 INFO:tasks.workunit.client.0.smithi161.stdout: 1 159018 2.76 MB/sec execute 190 sec latency 25.788 ms 2020-11-20T11:45:15.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 159664 2.77 MB/sec execute 191 sec latency 25.507 ms 2020-11-20T11:45:16.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 160020 2.76 MB/sec execute 192 sec latency 20.946 ms 2020-11-20T11:45:17.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 160328 2.75 MB/sec execute 193 sec latency 16.697 ms 2020-11-20T11:45:18.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 160806 2.74 MB/sec execute 194 sec latency 25.269 ms 2020-11-20T11:45:19.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 161416 2.75 MB/sec execute 195 sec latency 15.705 ms 2020-11-20T11:45:20.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 162069 2.74 MB/sec execute 196 sec latency 18.203 ms 2020-11-20T11:45:21.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 162808 2.76 MB/sec execute 197 sec latency 36.441 ms 2020-11-20T11:45:22.881 INFO:tasks.workunit.client.0.smithi161.stdout: 1 163335 2.77 MB/sec execute 198 sec latency 15.687 ms 2020-11-20T11:45:23.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 163602 2.76 MB/sec execute 199 sec latency 18.316 ms 2020-11-20T11:45:24.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 163928 2.75 MB/sec execute 200 sec latency 17.485 ms 2020-11-20T11:45:25.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 164422 2.74 MB/sec execute 201 sec latency 25.341 ms 2020-11-20T11:45:26.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 165040 2.75 MB/sec execute 202 sec latency 17.512 ms 2020-11-20T11:45:27.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 165636 2.74 MB/sec execute 203 sec latency 22.585 ms 2020-11-20T11:45:28.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 166411 2.76 MB/sec execute 204 sec latency 20.907 ms 2020-11-20T11:45:29.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 166955 2.77 MB/sec execute 205 sec latency 16.497 ms 2020-11-20T11:45:30.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 167209 2.76 MB/sec execute 206 sec latency 21.486 ms 2020-11-20T11:45:31.882 INFO:tasks.workunit.client.0.smithi161.stdout: 1 167631 2.75 MB/sec execute 207 sec latency 18.402 ms 2020-11-20T11:45:32.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 168186 2.76 MB/sec execute 208 sec latency 17.912 ms 2020-11-20T11:45:33.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 168815 2.75 MB/sec execute 209 sec latency 17.737 ms 2020-11-20T11:45:34.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 169482 2.76 MB/sec execute 210 sec latency 26.590 ms 2020-11-20T11:45:35.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 170235 2.78 MB/sec execute 211 sec latency 19.300 ms 2020-11-20T11:45:36.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 170602 2.77 MB/sec execute 212 sec latency 17.490 ms 2020-11-20T11:45:37.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 170885 2.76 MB/sec execute 213 sec latency 16.702 ms 2020-11-20T11:45:38.343 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:45:38.345 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:45:38.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 171380 2.75 MB/sec execute 214 sec latency 26.527 ms 2020-11-20T11:45:39.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 171996 2.76 MB/sec execute 215 sec latency 19.967 ms 2020-11-20T11:45:40.883 INFO:tasks.workunit.client.0.smithi161.stdout: 1 172675 2.75 MB/sec execute 216 sec latency 17.988 ms 2020-11-20T11:45:41.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 173296 2.77 MB/sec execute 217 sec latency 27.371 ms 2020-11-20T11:45:42.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 173973 2.78 MB/sec execute 218 sec latency 22.043 ms 2020-11-20T11:45:43.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 174268 2.77 MB/sec execute 219 sec latency 21.501 ms 2020-11-20T11:45:44.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 174630 2.76 MB/sec execute 220 sec latency 17.112 ms 2020-11-20T11:45:45.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 175109 2.75 MB/sec execute 221 sec latency 16.951 ms 2020-11-20T11:45:46.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 175779 2.76 MB/sec execute 222 sec latency 15.082 ms 2020-11-20T11:45:47.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 176388 2.76 MB/sec execute 223 sec latency 24.035 ms 2020-11-20T11:45:48.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 177112 2.77 MB/sec execute 224 sec latency 144.233 ms 2020-11-20T11:45:49.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 177619 2.78 MB/sec execute 225 sec latency 17.298 ms 2020-11-20T11:45:50.884 INFO:tasks.workunit.client.0.smithi161.stdout: 1 177920 2.77 MB/sec execute 226 sec latency 18.758 ms 2020-11-20T11:45:51.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 178346 2.76 MB/sec execute 227 sec latency 18.863 ms 2020-11-20T11:45:52.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 178959 2.77 MB/sec execute 228 sec latency 20.284 ms 2020-11-20T11:45:53.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 179626 2.76 MB/sec execute 229 sec latency 15.745 ms 2020-11-20T11:45:54.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 180291 2.77 MB/sec execute 230 sec latency 21.627 ms 2020-11-20T11:45:55.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 180996 2.79 MB/sec execute 231 sec latency 27.124 ms 2020-11-20T11:45:56.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 181311 2.78 MB/sec execute 232 sec latency 18.076 ms 2020-11-20T11:45:57.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 181650 2.77 MB/sec execute 233 sec latency 19.252 ms 2020-11-20T11:45:58.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 182160 2.76 MB/sec execute 234 sec latency 21.206 ms 2020-11-20T11:45:59.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 182827 2.77 MB/sec execute 235 sec latency 14.423 ms 2020-11-20T11:46:00.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 183416 2.77 MB/sec execute 236 sec latency 19.826 ms 2020-11-20T11:46:01.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 184217 2.78 MB/sec execute 237 sec latency 22.256 ms 2020-11-20T11:46:02.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 184700 2.79 MB/sec execute 238 sec latency 22.562 ms 2020-11-20T11:46:03.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 184915 2.78 MB/sec execute 239 sec latency 175.537 ms 2020-11-20T11:46:04.885 INFO:tasks.workunit.client.0.smithi161.stdout: 1 185263 2.77 MB/sec execute 240 sec latency 27.448 ms 2020-11-20T11:46:05.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 185718 2.76 MB/sec execute 241 sec latency 29.154 ms 2020-11-20T11:46:06.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 186321 2.77 MB/sec execute 242 sec latency 21.550 ms 2020-11-20T11:46:07.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 186898 2.76 MB/sec execute 243 sec latency 22.465 ms 2020-11-20T11:46:08.456 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:08.458 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:08.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 187355 2.77 MB/sec execute 244 sec latency 353.599 ms 2020-11-20T11:46:09.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 187734 2.77 MB/sec execute 245 sec latency 824.584 ms 2020-11-20T11:46:10.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 188218 2.78 MB/sec execute 246 sec latency 23.019 ms 2020-11-20T11:46:11.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 188430 2.77 MB/sec execute 247 sec latency 25.337 ms 2020-11-20T11:46:12.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 188764 2.76 MB/sec execute 248 sec latency 20.309 ms 2020-11-20T11:46:13.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 189109 2.75 MB/sec execute 249 sec latency 251.561 ms 2020-11-20T11:46:14.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 189672 2.75 MB/sec execute 250 sec latency 18.887 ms 2020-11-20T11:46:15.886 INFO:tasks.workunit.client.0.smithi161.stdout: 1 190366 2.75 MB/sec execute 251 sec latency 18.502 ms 2020-11-20T11:46:16.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 190934 2.76 MB/sec execute 252 sec latency 27.593 ms 2020-11-20T11:46:17.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 191556 2.77 MB/sec execute 253 sec latency 27.543 ms 2020-11-20T11:46:18.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 191871 2.76 MB/sec execute 254 sec latency 20.064 ms 2020-11-20T11:46:19.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 192127 2.75 MB/sec execute 255 sec latency 21.487 ms 2020-11-20T11:46:20.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 192496 2.75 MB/sec execute 256 sec latency 30.786 ms 2020-11-20T11:46:21.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 193066 2.75 MB/sec execute 257 sec latency 26.500 ms 2020-11-20T11:46:22.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 193604 2.74 MB/sec execute 258 sec latency 27.895 ms 2020-11-20T11:46:23.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 194155 2.74 MB/sec execute 259 sec latency 20.734 ms 2020-11-20T11:46:24.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 194911 2.76 MB/sec execute 260 sec latency 24.251 ms 2020-11-20T11:46:25.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 195373 2.76 MB/sec execute 261 sec latency 21.495 ms 2020-11-20T11:46:26.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 195636 2.75 MB/sec execute 262 sec latency 18.811 ms 2020-11-20T11:46:27.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 196010 2.75 MB/sec execute 263 sec latency 26.346 ms 2020-11-20T11:46:28.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 196549 2.75 MB/sec execute 264 sec latency 67.985 ms 2020-11-20T11:46:29.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 197141 2.74 MB/sec execute 265 sec latency 16.363 ms 2020-11-20T11:46:30.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 197691 2.74 MB/sec execute 266 sec latency 25.049 ms 2020-11-20T11:46:31.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 198436 2.76 MB/sec execute 267 sec latency 26.781 ms 2020-11-20T11:46:32.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 198904 2.76 MB/sec execute 268 sec latency 23.159 ms 2020-11-20T11:46:33.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 199169 2.75 MB/sec execute 269 sec latency 20.928 ms 2020-11-20T11:46:34.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 199522 2.74 MB/sec execute 270 sec latency 19.878 ms 2020-11-20T11:46:35.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 200089 2.75 MB/sec execute 271 sec latency 19.087 ms 2020-11-20T11:46:36.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 200660 2.74 MB/sec execute 272 sec latency 17.084 ms 2020-11-20T11:46:37.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 201230 2.74 MB/sec execute 273 sec latency 27.570 ms 2020-11-20T11:46:38.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 201968 2.75 MB/sec execute 274 sec latency 23.848 ms 2020-11-20T11:46:39.414 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:39.424 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:46:39.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 202435 2.76 MB/sec execute 275 sec latency 21.138 ms 2020-11-20T11:46:40.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 202689 2.75 MB/sec execute 276 sec latency 26.336 ms 2020-11-20T11:46:41.887 INFO:tasks.workunit.client.0.smithi161.stdout: 1 203045 2.74 MB/sec execute 277 sec latency 19.800 ms 2020-11-20T11:46:42.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 203582 2.75 MB/sec execute 278 sec latency 26.477 ms 2020-11-20T11:46:43.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 204080 2.74 MB/sec execute 279 sec latency 19.774 ms 2020-11-20T11:46:44.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 204679 2.74 MB/sec execute 280 sec latency 18.821 ms 2020-11-20T11:46:45.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 205459 2.75 MB/sec execute 281 sec latency 25.119 ms 2020-11-20T11:46:46.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 205946 2.76 MB/sec execute 282 sec latency 20.036 ms 2020-11-20T11:46:47.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 206172 2.75 MB/sec execute 283 sec latency 23.101 ms 2020-11-20T11:46:48.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 206506 2.74 MB/sec execute 284 sec latency 20.532 ms 2020-11-20T11:46:49.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 206937 2.74 MB/sec execute 285 sec latency 19.828 ms 2020-11-20T11:46:50.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 207552 2.74 MB/sec execute 286 sec latency 18.886 ms 2020-11-20T11:46:51.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 208154 2.74 MB/sec execute 287 sec latency 23.362 ms 2020-11-20T11:46:52.888 INFO:tasks.workunit.client.0.smithi161.stdout: 1 208732 2.75 MB/sec execute 288 sec latency 26.095 ms 2020-11-20T11:46:53.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 209363 2.76 MB/sec execute 289 sec latency 27.121 ms 2020-11-20T11:46:54.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 209650 2.75 MB/sec execute 290 sec latency 20.785 ms 2020-11-20T11:46:55.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 209890 2.74 MB/sec execute 291 sec latency 26.104 ms 2020-11-20T11:46:56.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 210316 2.74 MB/sec execute 292 sec latency 20.512 ms 2020-11-20T11:46:57.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 210837 2.74 MB/sec execute 293 sec latency 18.685 ms 2020-11-20T11:46:58.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 211436 2.73 MB/sec execute 294 sec latency 19.669 ms 2020-11-20T11:46:59.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 211996 2.74 MB/sec execute 295 sec latency 24.274 ms 2020-11-20T11:47:00.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 212646 2.74 MB/sec execute 296 sec latency 27.127 ms 2020-11-20T11:47:01.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 213090 2.75 MB/sec execute 297 sec latency 21.326 ms 2020-11-20T11:47:02.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 213331 2.74 MB/sec execute 298 sec latency 22.241 ms 2020-11-20T11:47:03.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 213686 2.73 MB/sec execute 299 sec latency 45.438 ms 2020-11-20T11:47:04.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 214022 2.73 MB/sec execute 300 sec latency 144.168 ms 2020-11-20T11:47:05.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 214596 2.73 MB/sec execute 301 sec latency 30.581 ms 2020-11-20T11:47:06.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 215258 2.73 MB/sec execute 302 sec latency 19.018 ms 2020-11-20T11:47:07.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 215803 2.74 MB/sec execute 303 sec latency 27.724 ms 2020-11-20T11:47:08.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 216420 2.74 MB/sec execute 304 sec latency 29.341 ms 2020-11-20T11:47:09.468 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:09.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 216699 2.74 MB/sec execute 305 sec latency 112.703 ms 2020-11-20T11:47:09.892 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:10.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 216960 2.73 MB/sec execute 306 sec latency 22.516 ms 2020-11-20T11:47:11.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 217335 2.73 MB/sec execute 307 sec latency 20.772 ms 2020-11-20T11:47:12.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 217848 2.73 MB/sec execute 308 sec latency 40.925 ms 2020-11-20T11:47:13.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 218389 2.72 MB/sec execute 309 sec latency 17.345 ms 2020-11-20T11:47:14.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 218926 2.72 MB/sec execute 310 sec latency 25.367 ms 2020-11-20T11:47:15.889 INFO:tasks.workunit.client.0.smithi161.stdout: 1 219632 2.73 MB/sec execute 311 sec latency 31.801 ms 2020-11-20T11:47:16.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 220114 2.74 MB/sec execute 312 sec latency 20.128 ms 2020-11-20T11:47:17.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 220371 2.73 MB/sec execute 313 sec latency 22.030 ms 2020-11-20T11:47:18.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 220663 2.72 MB/sec execute 314 sec latency 19.534 ms 2020-11-20T11:47:19.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 221107 2.72 MB/sec execute 315 sec latency 23.729 ms 2020-11-20T11:47:20.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 221605 2.72 MB/sec execute 316 sec latency 25.989 ms 2020-11-20T11:47:21.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 222215 2.72 MB/sec execute 317 sec latency 18.502 ms 2020-11-20T11:47:22.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 222755 2.72 MB/sec execute 318 sec latency 31.727 ms 2020-11-20T11:47:23.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 223354 2.73 MB/sec execute 319 sec latency 30.872 ms 2020-11-20T11:47:24.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 223785 2.73 MB/sec execute 320 sec latency 19.939 ms 2020-11-20T11:47:25.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 224030 2.72 MB/sec execute 321 sec latency 26.990 ms 2020-11-20T11:47:26.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 224394 2.72 MB/sec execute 322 sec latency 26.142 ms 2020-11-20T11:47:27.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 224933 2.72 MB/sec execute 323 sec latency 31.116 ms 2020-11-20T11:47:28.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 225485 2.72 MB/sec execute 324 sec latency 18.213 ms 2020-11-20T11:47:29.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 226004 2.71 MB/sec execute 325 sec latency 24.602 ms 2020-11-20T11:47:30.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 226720 2.72 MB/sec execute 326 sec latency 24.952 ms 2020-11-20T11:47:31.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 227259 2.73 MB/sec execute 327 sec latency 18.089 ms 2020-11-20T11:47:32.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 227467 2.72 MB/sec execute 328 sec latency 26.748 ms 2020-11-20T11:47:33.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 227750 2.72 MB/sec execute 329 sec latency 18.212 ms 2020-11-20T11:47:34.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 228191 2.71 MB/sec execute 330 sec latency 28.084 ms 2020-11-20T11:47:35.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 228700 2.71 MB/sec execute 331 sec latency 23.852 ms 2020-11-20T11:47:36.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 229239 2.71 MB/sec execute 332 sec latency 223.299 ms 2020-11-20T11:47:37.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 229811 2.72 MB/sec execute 333 sec latency 22.686 ms 2020-11-20T11:47:38.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 230441 2.72 MB/sec execute 334 sec latency 22.220 ms 2020-11-20T11:47:39.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 230900 2.72 MB/sec execute 335 sec latency 18.648 ms 2020-11-20T11:47:40.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 231172 2.72 MB/sec execute 336 sec latency 19.019 ms 2020-11-20T11:47:41.041 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:41.052 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:47:41.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 231594 2.71 MB/sec execute 337 sec latency 21.047 ms 2020-11-20T11:47:42.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 232198 2.72 MB/sec execute 338 sec latency 22.868 ms 2020-11-20T11:47:43.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 232898 2.71 MB/sec execute 339 sec latency 14.522 ms 2020-11-20T11:47:44.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 233534 2.72 MB/sec execute 340 sec latency 19.301 ms 2020-11-20T11:47:45.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 234220 2.73 MB/sec execute 341 sec latency 21.423 ms 2020-11-20T11:47:46.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 234536 2.72 MB/sec execute 342 sec latency 20.549 ms 2020-11-20T11:47:47.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 234860 2.72 MB/sec execute 343 sec latency 19.156 ms 2020-11-20T11:47:48.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 235331 2.71 MB/sec execute 344 sec latency 38.199 ms 2020-11-20T11:47:49.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 235957 2.72 MB/sec execute 345 sec latency 23.718 ms 2020-11-20T11:47:50.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 236595 2.71 MB/sec execute 346 sec latency 19.505 ms 2020-11-20T11:47:51.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 237145 2.72 MB/sec execute 347 sec latency 154.873 ms 2020-11-20T11:47:52.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 237832 2.73 MB/sec execute 348 sec latency 23.386 ms 2020-11-20T11:47:53.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 238120 2.72 MB/sec execute 349 sec latency 25.758 ms 2020-11-20T11:47:54.890 INFO:tasks.workunit.client.0.smithi161.stdout: 1 238431 2.72 MB/sec execute 350 sec latency 16.969 ms 2020-11-20T11:47:55.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 238904 2.71 MB/sec execute 351 sec latency 29.911 ms 2020-11-20T11:47:56.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 239501 2.72 MB/sec execute 352 sec latency 16.568 ms 2020-11-20T11:47:57.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 240098 2.71 MB/sec execute 353 sec latency 23.159 ms 2020-11-20T11:47:58.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 240693 2.72 MB/sec execute 354 sec latency 21.490 ms 2020-11-20T11:47:59.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 241333 2.73 MB/sec execute 355 sec latency 26.036 ms 2020-11-20T11:48:00.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 241613 2.72 MB/sec execute 356 sec latency 25.271 ms 2020-11-20T11:48:01.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 241896 2.72 MB/sec execute 357 sec latency 26.134 ms 2020-11-20T11:48:02.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 242364 2.71 MB/sec execute 358 sec latency 25.742 ms 2020-11-20T11:48:03.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 242927 2.72 MB/sec execute 359 sec latency 21.969 ms 2020-11-20T11:48:04.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 243597 2.71 MB/sec execute 360 sec latency 18.099 ms 2020-11-20T11:48:05.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 244162 2.72 MB/sec execute 361 sec latency 21.965 ms 2020-11-20T11:48:06.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 244795 2.73 MB/sec execute 362 sec latency 24.827 ms 2020-11-20T11:48:07.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 245107 2.72 MB/sec execute 363 sec latency 21.567 ms 2020-11-20T11:48:08.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 245366 2.72 MB/sec execute 364 sec latency 21.576 ms 2020-11-20T11:48:09.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 245695 2.71 MB/sec execute 365 sec latency 184.364 ms 2020-11-20T11:48:10.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 246209 2.72 MB/sec execute 366 sec latency 29.302 ms 2020-11-20T11:48:11.321 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:11.324 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:11.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 246742 2.71 MB/sec execute 367 sec latency 18.531 ms 2020-11-20T11:48:12.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 247345 2.71 MB/sec execute 368 sec latency 23.197 ms 2020-11-20T11:48:13.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 248059 2.72 MB/sec execute 369 sec latency 30.685 ms 2020-11-20T11:48:14.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 248533 2.72 MB/sec execute 370 sec latency 25.549 ms 2020-11-20T11:48:15.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 248787 2.72 MB/sec execute 371 sec latency 21.048 ms 2020-11-20T11:48:16.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 249115 2.71 MB/sec execute 372 sec latency 144.278 ms 2020-11-20T11:48:17.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 249609 2.71 MB/sec execute 373 sec latency 19.400 ms 2020-11-20T11:48:18.891 INFO:tasks.workunit.client.0.smithi161.stdout: 1 250250 2.71 MB/sec execute 374 sec latency 15.370 ms 2020-11-20T11:48:19.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 250886 2.71 MB/sec execute 375 sec latency 19.973 ms 2020-11-20T11:48:20.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 251642 2.72 MB/sec execute 376 sec latency 26.413 ms 2020-11-20T11:48:21.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 252126 2.72 MB/sec execute 377 sec latency 18.483 ms 2020-11-20T11:48:22.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 252389 2.72 MB/sec execute 378 sec latency 25.541 ms 2020-11-20T11:48:23.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 252793 2.71 MB/sec execute 379 sec latency 22.942 ms 2020-11-20T11:48:24.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 253374 2.72 MB/sec execute 380 sec latency 22.311 ms 2020-11-20T11:48:25.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 253991 2.71 MB/sec execute 381 sec latency 14.020 ms 2020-11-20T11:48:26.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 254638 2.72 MB/sec execute 382 sec latency 22.195 ms 2020-11-20T11:48:27.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 255379 2.73 MB/sec execute 383 sec latency 24.344 ms 2020-11-20T11:48:28.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 255735 2.72 MB/sec execute 384 sec latency 18.407 ms 2020-11-20T11:48:29.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 256021 2.72 MB/sec execute 385 sec latency 17.674 ms 2020-11-20T11:48:30.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 256482 2.72 MB/sec execute 386 sec latency 17.355 ms 2020-11-20T11:48:31.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 257042 2.72 MB/sec execute 387 sec latency 20.660 ms 2020-11-20T11:48:32.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 257640 2.71 MB/sec execute 388 sec latency 19.263 ms 2020-11-20T11:48:33.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 258182 2.72 MB/sec execute 389 sec latency 25.842 ms 2020-11-20T11:48:34.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 258782 2.72 MB/sec execute 390 sec latency 20.625 ms 2020-11-20T11:48:35.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 259215 2.72 MB/sec execute 391 sec latency 25.742 ms 2020-11-20T11:48:36.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 259438 2.72 MB/sec execute 392 sec latency 24.597 ms 2020-11-20T11:48:37.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 259775 2.71 MB/sec execute 393 sec latency 18.945 ms 2020-11-20T11:48:38.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 260212 2.71 MB/sec execute 394 sec latency 30.948 ms 2020-11-20T11:48:39.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 260795 2.71 MB/sec execute 395 sec latency 19.159 ms 2020-11-20T11:48:40.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 261382 2.71 MB/sec execute 396 sec latency 20.566 ms 2020-11-20T11:48:41.411 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:41.414 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:48:41.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 261951 2.72 MB/sec execute 397 sec latency 27.543 ms 2020-11-20T11:48:42.892 INFO:tasks.workunit.client.0.smithi161.stdout: 1 262596 2.72 MB/sec execute 398 sec latency 30.500 ms 2020-11-20T11:48:43.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 262882 2.72 MB/sec execute 399 sec latency 19.687 ms 2020-11-20T11:48:44.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 263109 2.71 MB/sec execute 400 sec latency 22.862 ms 2020-11-20T11:48:45.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 263491 2.71 MB/sec execute 401 sec latency 18.875 ms 2020-11-20T11:48:46.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 263962 2.71 MB/sec execute 402 sec latency 129.713 ms 2020-11-20T11:48:47.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 264470 2.70 MB/sec execute 403 sec latency 19.571 ms 2020-11-20T11:48:48.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 264993 2.70 MB/sec execute 404 sec latency 19.441 ms 2020-11-20T11:48:49.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 265685 2.71 MB/sec execute 405 sec latency 30.976 ms 2020-11-20T11:48:50.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 266202 2.72 MB/sec execute 406 sec latency 27.835 ms 2020-11-20T11:48:51.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 266432 2.71 MB/sec execute 407 sec latency 119.872 ms 2020-11-20T11:48:52.893 INFO:tasks.workunit.client.0.smithi161.stdout: 1 266684 2.71 MB/sec execute 408 sec latency 22.930 ms 2020-11-20T11:48:53.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 267070 2.70 MB/sec execute 409 sec latency 28.004 ms 2020-11-20T11:48:54.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 267619 2.70 MB/sec execute 410 sec latency 18.495 ms 2020-11-20T11:48:55.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 268209 2.70 MB/sec execute 411 sec latency 19.160 ms 2020-11-20T11:48:56.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 268668 2.70 MB/sec execute 412 sec latency 39.335 ms 2020-11-20T11:48:57.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 269394 2.71 MB/sec execute 413 sec latency 29.240 ms 2020-11-20T11:48:58.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 269835 2.71 MB/sec execute 414 sec latency 22.587 ms 2020-11-20T11:48:59.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 270047 2.71 MB/sec execute 415 sec latency 26.936 ms 2020-11-20T11:49:00.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 270337 2.70 MB/sec execute 416 sec latency 23.100 ms 2020-11-20T11:49:01.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 270744 2.70 MB/sec execute 417 sec latency 29.321 ms 2020-11-20T11:49:02.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 271263 2.70 MB/sec execute 418 sec latency 24.914 ms 2020-11-20T11:49:03.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 271937 2.70 MB/sec execute 419 sec latency 19.909 ms 2020-11-20T11:49:04.894 INFO:tasks.workunit.client.0.smithi161.stdout: 1 272475 2.70 MB/sec execute 420 sec latency 35.444 ms 2020-11-20T11:49:05.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 272977 2.70 MB/sec execute 421 sec latency 32.560 ms 2020-11-20T11:49:06.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 273407 2.71 MB/sec execute 422 sec latency 23.631 ms 2020-11-20T11:49:07.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 273617 2.70 MB/sec execute 423 sec latency 23.387 ms 2020-11-20T11:49:08.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 273937 2.69 MB/sec execute 424 sec latency 23.427 ms 2020-11-20T11:49:09.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 274339 2.69 MB/sec execute 425 sec latency 33.786 ms 2020-11-20T11:49:10.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 274878 2.69 MB/sec execute 426 sec latency 17.785 ms 2020-11-20T11:49:11.474 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:11.476 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:11.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 275561 2.69 MB/sec execute 427 sec latency 15.532 ms 2020-11-20T11:49:12.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 276161 2.70 MB/sec execute 428 sec latency 22.888 ms 2020-11-20T11:49:13.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 276834 2.70 MB/sec execute 429 sec latency 27.050 ms 2020-11-20T11:49:14.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 277123 2.70 MB/sec execute 430 sec latency 22.464 ms 2020-11-20T11:49:15.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 277445 2.69 MB/sec execute 431 sec latency 20.203 ms 2020-11-20T11:49:16.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 277931 2.69 MB/sec execute 432 sec latency 25.776 ms 2020-11-20T11:49:17.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 278539 2.69 MB/sec execute 433 sec latency 34.065 ms 2020-11-20T11:49:18.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 279147 2.69 MB/sec execute 434 sec latency 28.565 ms 2020-11-20T11:49:19.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 279903 2.70 MB/sec execute 435 sec latency 27.928 ms 2020-11-20T11:49:20.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 280462 2.71 MB/sec execute 436 sec latency 17.323 ms 2020-11-20T11:49:21.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 280700 2.70 MB/sec execute 437 sec latency 27.400 ms 2020-11-20T11:49:22.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 281069 2.70 MB/sec execute 438 sec latency 19.490 ms 2020-11-20T11:49:23.895 INFO:tasks.workunit.client.0.smithi161.stdout: 1 281638 2.70 MB/sec execute 439 sec latency 23.461 ms 2020-11-20T11:49:24.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 282209 2.69 MB/sec execute 440 sec latency 17.541 ms 2020-11-20T11:49:25.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 282803 2.69 MB/sec execute 441 sec latency 32.384 ms 2020-11-20T11:49:26.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 283577 2.70 MB/sec execute 442 sec latency 25.380 ms 2020-11-20T11:49:27.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 284047 2.71 MB/sec execute 443 sec latency 24.276 ms 2020-11-20T11:49:28.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 284322 2.70 MB/sec execute 444 sec latency 24.139 ms 2020-11-20T11:49:29.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 284708 2.70 MB/sec execute 445 sec latency 21.188 ms 2020-11-20T11:49:30.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 285293 2.70 MB/sec execute 446 sec latency 24.151 ms 2020-11-20T11:49:31.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 285767 2.70 MB/sec execute 447 sec latency 172.897 ms 2020-11-20T11:49:32.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 286351 2.69 MB/sec execute 448 sec latency 20.292 ms 2020-11-20T11:49:33.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 287117 2.70 MB/sec execute 449 sec latency 26.863 ms 2020-11-20T11:49:34.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 287593 2.71 MB/sec execute 450 sec latency 22.920 ms 2020-11-20T11:49:35.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 287866 2.70 MB/sec execute 451 sec latency 29.463 ms 2020-11-20T11:49:36.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 288253 2.70 MB/sec execute 452 sec latency 20.010 ms 2020-11-20T11:49:37.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 288826 2.70 MB/sec execute 453 sec latency 25.716 ms 2020-11-20T11:49:38.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 289396 2.70 MB/sec execute 454 sec latency 17.496 ms 2020-11-20T11:49:39.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 289928 2.70 MB/sec execute 455 sec latency 28.407 ms 2020-11-20T11:49:40.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 290675 2.70 MB/sec execute 456 sec latency 32.687 ms 2020-11-20T11:49:41.588 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:41.595 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:49:41.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 291147 2.71 MB/sec execute 457 sec latency 20.210 ms 2020-11-20T11:49:42.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 291420 2.70 MB/sec execute 458 sec latency 24.698 ms 2020-11-20T11:49:43.896 INFO:tasks.workunit.client.0.smithi161.stdout: 1 291796 2.70 MB/sec execute 459 sec latency 29.271 ms 2020-11-20T11:49:44.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 292350 2.70 MB/sec execute 460 sec latency 27.028 ms 2020-11-20T11:49:45.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 292937 2.70 MB/sec execute 461 sec latency 16.087 ms 2020-11-20T11:49:46.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 293475 2.70 MB/sec execute 462 sec latency 26.685 ms 2020-11-20T11:49:47.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 294195 2.70 MB/sec execute 463 sec latency 30.351 ms 2020-11-20T11:49:48.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 294644 2.71 MB/sec execute 464 sec latency 22.683 ms 2020-11-20T11:49:49.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 294854 2.70 MB/sec execute 465 sec latency 23.346 ms 2020-11-20T11:49:50.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 295156 2.70 MB/sec execute 466 sec latency 28.071 ms 2020-11-20T11:49:51.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 295570 2.70 MB/sec execute 467 sec latency 28.077 ms 2020-11-20T11:49:52.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 296074 2.70 MB/sec execute 468 sec latency 28.360 ms 2020-11-20T11:49:53.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 296726 2.69 MB/sec execute 469 sec latency 20.222 ms 2020-11-20T11:49:54.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 297202 2.70 MB/sec execute 470 sec latency 20.480 ms 2020-11-20T11:49:55.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 297793 2.70 MB/sec execute 471 sec latency 38.114 ms 2020-11-20T11:49:56.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 298229 2.70 MB/sec execute 472 sec latency 24.245 ms 2020-11-20T11:49:57.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 298445 2.70 MB/sec execute 473 sec latency 24.327 ms 2020-11-20T11:49:58.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 298756 2.69 MB/sec execute 474 sec latency 28.767 ms 2020-11-20T11:49:59.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 299161 2.69 MB/sec execute 475 sec latency 27.291 ms 2020-11-20T11:50:00.897 INFO:tasks.workunit.client.0.smithi161.stdout: 1 299677 2.69 MB/sec execute 476 sec latency 23.484 ms 2020-11-20T11:50:01.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 300338 2.69 MB/sec execute 477 sec latency 18.933 ms 2020-11-20T11:50:02.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 300875 2.69 MB/sec execute 478 sec latency 31.230 ms 2020-11-20T11:50:03.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 301472 2.70 MB/sec execute 479 sec latency 31.334 ms 2020-11-20T11:50:04.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 301795 2.70 MB/sec execute 480 sec latency 23.939 ms 2020-11-20T11:50:05.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 302036 2.69 MB/sec execute 481 sec latency 29.857 ms 2020-11-20T11:50:06.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 302379 2.69 MB/sec execute 482 sec latency 31.248 ms 2020-11-20T11:50:07.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 302950 2.69 MB/sec execute 483 sec latency 26.284 ms 2020-11-20T11:50:08.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 303528 2.69 MB/sec execute 484 sec latency 22.206 ms 2020-11-20T11:50:09.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 304098 2.69 MB/sec execute 485 sec latency 21.615 ms 2020-11-20T11:50:10.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 304836 2.69 MB/sec execute 486 sec latency 33.147 ms 2020-11-20T11:50:11.628 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:11.631 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:11.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 305230 2.70 MB/sec execute 487 sec latency 203.964 ms 2020-11-20T11:50:12.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 305510 2.69 MB/sec execute 488 sec latency 28.380 ms 2020-11-20T11:50:13.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 305846 2.69 MB/sec execute 489 sec latency 84.689 ms 2020-11-20T11:50:14.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 306287 2.69 MB/sec execute 490 sec latency 24.959 ms 2020-11-20T11:50:15.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 306892 2.69 MB/sec execute 491 sec latency 18.155 ms 2020-11-20T11:50:16.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 307505 2.69 MB/sec execute 492 sec latency 20.660 ms 2020-11-20T11:50:17.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 308233 2.69 MB/sec execute 493 sec latency 30.937 ms 2020-11-20T11:50:18.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 308773 2.70 MB/sec execute 494 sec latency 19.470 ms 2020-11-20T11:50:19.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 309032 2.69 MB/sec execute 495 sec latency 22.053 ms 2020-11-20T11:50:20.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 309350 2.69 MB/sec execute 496 sec latency 19.018 ms 2020-11-20T11:50:21.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 309800 2.69 MB/sec execute 497 sec latency 20.861 ms 2020-11-20T11:50:22.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 310361 2.69 MB/sec execute 498 sec latency 26.444 ms 2020-11-20T11:50:23.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 311006 2.69 MB/sec execute 499 sec latency 16.865 ms 2020-11-20T11:50:24.898 INFO:tasks.workunit.client.0.smithi161.stdout: 1 311598 2.69 MB/sec execute 500 sec latency 32.760 ms 2020-11-20T11:50:25.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 312235 2.70 MB/sec execute 501 sec latency 18.213 ms 2020-11-20T11:50:26.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 312520 2.69 MB/sec execute 502 sec latency 29.965 ms 2020-11-20T11:50:27.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 312756 2.69 MB/sec execute 503 sec latency 25.900 ms 2020-11-20T11:50:28.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 313134 2.68 MB/sec execute 504 sec latency 25.287 ms 2020-11-20T11:50:29.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 313664 2.69 MB/sec execute 505 sec latency 27.837 ms 2020-11-20T11:50:30.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 314256 2.68 MB/sec execute 506 sec latency 19.520 ms 2020-11-20T11:50:31.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 314757 2.68 MB/sec execute 507 sec latency 26.425 ms 2020-11-20T11:50:32.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 315469 2.69 MB/sec execute 508 sec latency 32.197 ms 2020-11-20T11:50:33.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 315922 2.69 MB/sec execute 509 sec latency 18.133 ms 2020-11-20T11:50:34.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 316135 2.69 MB/sec execute 510 sec latency 22.583 ms 2020-11-20T11:50:35.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 316427 2.68 MB/sec execute 511 sec latency 27.219 ms 2020-11-20T11:50:36.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 316859 2.68 MB/sec execute 512 sec latency 43.407 ms 2020-11-20T11:50:37.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 317372 2.68 MB/sec execute 513 sec latency 25.886 ms 2020-11-20T11:50:38.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 318006 2.68 MB/sec execute 514 sec latency 23.792 ms 2020-11-20T11:50:39.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 318580 2.68 MB/sec execute 515 sec latency 27.002 ms 2020-11-20T11:50:40.899 INFO:tasks.workunit.client.0.smithi161.stdout: 1 319195 2.69 MB/sec execute 516 sec latency 28.962 ms 2020-11-20T11:50:41.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 319534 2.69 MB/sec execute 517 sec latency 23.891 ms 2020-11-20T11:50:42.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 319785 2.68 MB/sec execute 518 sec latency 23.462 ms 2020-11-20T11:50:43.896 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:43.899 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:50:43.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 320155 2.68 MB/sec execute 519 sec latency 20.529 ms 2020-11-20T11:50:44.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 320698 2.68 MB/sec execute 520 sec latency 30.218 ms 2020-11-20T11:50:45.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 321254 2.68 MB/sec execute 521 sec latency 15.905 ms 2020-11-20T11:50:46.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 321817 2.68 MB/sec execute 522 sec latency 22.463 ms 2020-11-20T11:50:47.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 322569 2.69 MB/sec execute 523 sec latency 23.721 ms 2020-11-20T11:50:48.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 323027 2.69 MB/sec execute 524 sec latency 17.039 ms 2020-11-20T11:50:49.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 323236 2.69 MB/sec execute 525 sec latency 144.365 ms 2020-11-20T11:50:50.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 323577 2.68 MB/sec execute 526 sec latency 25.168 ms 2020-11-20T11:50:51.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 324027 2.68 MB/sec execute 527 sec latency 23.890 ms 2020-11-20T11:50:52.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 324609 2.68 MB/sec execute 528 sec latency 20.741 ms 2020-11-20T11:50:53.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 325232 2.68 MB/sec execute 529 sec latency 23.385 ms 2020-11-20T11:50:54.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 325815 2.68 MB/sec execute 530 sec latency 26.777 ms 2020-11-20T11:50:55.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 326453 2.69 MB/sec execute 531 sec latency 17.170 ms 2020-11-20T11:50:56.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 326732 2.69 MB/sec execute 532 sec latency 20.666 ms 2020-11-20T11:50:57.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 327023 2.68 MB/sec execute 533 sec latency 22.007 ms 2020-11-20T11:50:58.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 327490 2.68 MB/sec execute 534 sec latency 23.149 ms 2020-11-20T11:50:59.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 328043 2.68 MB/sec execute 535 sec latency 22.868 ms 2020-11-20T11:51:00.900 INFO:tasks.workunit.client.0.smithi161.stdout: 1 328734 2.68 MB/sec execute 536 sec latency 20.497 ms 2020-11-20T11:51:01.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 329324 2.68 MB/sec execute 537 sec latency 30.642 ms 2020-11-20T11:51:02.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 329966 2.69 MB/sec execute 538 sec latency 22.825 ms 2020-11-20T11:51:03.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 330258 2.69 MB/sec execute 539 sec latency 20.276 ms 2020-11-20T11:51:04.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 330505 2.68 MB/sec execute 540 sec latency 21.791 ms 2020-11-20T11:51:05.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 330947 2.68 MB/sec execute 541 sec latency 25.669 ms 2020-11-20T11:51:06.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 331510 2.68 MB/sec execute 542 sec latency 30.083 ms 2020-11-20T11:51:07.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 332220 2.68 MB/sec execute 543 sec latency 16.424 ms 2020-11-20T11:51:08.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 332801 2.68 MB/sec execute 544 sec latency 25.781 ms 2020-11-20T11:51:09.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 333450 2.69 MB/sec execute 545 sec latency 30.710 ms 2020-11-20T11:51:10.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 333768 2.69 MB/sec execute 546 sec latency 25.075 ms 2020-11-20T11:51:11.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 334019 2.68 MB/sec execute 547 sec latency 23.579 ms 2020-11-20T11:51:12.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 334407 2.68 MB/sec execute 548 sec latency 30.264 ms 2020-11-20T11:51:13.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 334967 2.68 MB/sec execute 549 sec latency 19.992 ms 2020-11-20T11:51:14.005 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:14.007 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:14.901 INFO:tasks.workunit.client.0.smithi161.stdout: 1 335477 2.68 MB/sec execute 550 sec latency 210.240 ms 2020-11-20T11:51:15.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 336004 2.68 MB/sec execute 551 sec latency 22.301 ms 2020-11-20T11:51:16.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 336751 2.68 MB/sec execute 552 sec latency 23.924 ms 2020-11-20T11:51:17.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 337217 2.69 MB/sec execute 553 sec latency 22.185 ms 2020-11-20T11:51:18.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 337451 2.68 MB/sec execute 554 sec latency 20.351 ms 2020-11-20T11:51:19.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 337789 2.68 MB/sec execute 555 sec latency 24.309 ms 2020-11-20T11:51:20.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 338371 2.68 MB/sec execute 556 sec latency 21.169 ms 2020-11-20T11:51:21.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 338894 2.68 MB/sec execute 557 sec latency 17.901 ms 2020-11-20T11:51:22.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 339445 2.68 MB/sec execute 558 sec latency 22.554 ms 2020-11-20T11:51:23.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 340163 2.68 MB/sec execute 559 sec latency 25.457 ms 2020-11-20T11:51:24.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 340681 2.69 MB/sec execute 560 sec latency 19.173 ms 2020-11-20T11:51:25.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 340953 2.68 MB/sec execute 561 sec latency 21.316 ms 2020-11-20T11:51:26.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 341268 2.68 MB/sec execute 562 sec latency 25.600 ms 2020-11-20T11:51:27.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 341706 2.68 MB/sec execute 563 sec latency 32.868 ms 2020-11-20T11:51:28.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 342283 2.68 MB/sec execute 564 sec latency 20.980 ms 2020-11-20T11:51:29.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 342893 2.68 MB/sec execute 565 sec latency 135.146 ms 2020-11-20T11:51:30.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 343451 2.68 MB/sec execute 566 sec latency 43.397 ms 2020-11-20T11:51:31.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 344077 2.69 MB/sec execute 567 sec latency 18.536 ms 2020-11-20T11:51:32.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 344404 2.68 MB/sec execute 568 sec latency 27.909 ms 2020-11-20T11:51:33.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 344661 2.68 MB/sec execute 569 sec latency 21.684 ms 2020-11-20T11:51:34.902 INFO:tasks.workunit.client.0.smithi161.stdout: 1 345038 2.68 MB/sec execute 570 sec latency 23.227 ms 2020-11-20T11:51:35.905 INFO:tasks.workunit.client.0.smithi161.stdout: 1 345586 2.68 MB/sec execute 571 sec latency 28.166 ms 2020-11-20T11:51:36.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 346166 2.67 MB/sec execute 572 sec latency 18.010 ms 2020-11-20T11:51:37.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 346673 2.67 MB/sec execute 573 sec latency 26.572 ms 2020-11-20T11:51:38.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 347408 2.68 MB/sec execute 574 sec latency 18.107 ms 2020-11-20T11:51:39.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 347866 2.68 MB/sec execute 575 sec latency 23.845 ms 2020-11-20T11:51:40.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 348087 2.68 MB/sec execute 576 sec latency 23.236 ms 2020-11-20T11:51:41.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 348397 2.68 MB/sec execute 577 sec latency 22.101 ms 2020-11-20T11:51:42.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 348792 2.67 MB/sec execute 578 sec latency 31.457 ms 2020-11-20T11:51:43.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 349302 2.67 MB/sec execute 579 sec latency 22.528 ms 2020-11-20T11:51:44.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 349957 2.67 MB/sec execute 580 sec latency 23.137 ms 2020-11-20T11:51:44.954 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:44.963 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:51:45.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 350503 2.68 MB/sec execute 581 sec latency 20.852 ms 2020-11-20T11:51:46.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 351099 2.68 MB/sec execute 582 sec latency 30.180 ms 2020-11-20T11:51:47.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 351438 2.68 MB/sec execute 583 sec latency 21.761 ms 2020-11-20T11:51:48.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 351689 2.68 MB/sec execute 584 sec latency 25.137 ms 2020-11-20T11:51:49.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 352019 2.67 MB/sec execute 585 sec latency 28.200 ms 2020-11-20T11:51:50.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 352389 2.67 MB/sec execute 586 sec latency 142.430 ms 2020-11-20T11:51:51.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 352933 2.67 MB/sec execute 587 sec latency 21.228 ms 2020-11-20T11:51:52.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 353542 2.67 MB/sec execute 588 sec latency 19.326 ms 2020-11-20T11:51:53.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 354058 2.67 MB/sec execute 589 sec latency 22.607 ms 2020-11-20T11:51:54.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 354649 2.68 MB/sec execute 590 sec latency 28.747 ms 2020-11-20T11:51:55.903 INFO:tasks.workunit.client.0.smithi161.stdout: 1 354988 2.68 MB/sec execute 591 sec latency 23.111 ms 2020-11-20T11:51:56.905 INFO:tasks.workunit.client.0.smithi161.stdout: 1 355233 2.67 MB/sec execute 592 sec latency 28.326 ms 2020-11-20T11:51:57.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 355515 2.67 MB/sec execute 593 sec latency 24.357 ms 2020-11-20T11:51:58.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 355965 2.67 MB/sec execute 594 sec latency 32.329 ms 2020-11-20T11:51:59.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 356615 2.67 MB/sec execute 595 sec latency 23.173 ms 2020-11-20T11:52:00.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 357192 2.67 MB/sec execute 596 sec latency 20.811 ms 2020-11-20T11:52:01.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 357978 2.67 MB/sec execute 597 sec latency 23.315 ms 2020-11-20T11:52:02.905 INFO:tasks.workunit.client.0.smithi161.stdout: 1 358474 2.68 MB/sec execute 598 sec latency 16.621 ms 2020-11-20T11:52:03.905 INFO:tasks.workunit.client.0.smithi161.stdout: 1 358710 2.67 MB/sec execute 599 sec latency 19.888 ms 2020-11-20T11:52:04.904 INFO:tasks.workunit.client.0.smithi161.stdout: 1 cleanup 600 sec 2020-11-20T11:52:05.658 INFO:tasks.workunit.client.0.smithi161.stdout: 0 cleanup 601 sec 2020-11-20T11:52:05.659 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T11:52:05.659 INFO:tasks.workunit.client.0.smithi161.stdout: Operation Count AvgLat MaxLat 2020-11-20T11:52:05.660 INFO:tasks.workunit.client.0.smithi161.stdout: ---------------------------------------- 2020-11-20T11:52:05.660 INFO:tasks.workunit.client.0.smithi161.stdout: NTCreateX 51329 4.827 824.568 2020-11-20T11:52:05.660 INFO:tasks.workunit.client.0.smithi161.stdout: Close 37674 0.104 6.424 2020-11-20T11:52:05.660 INFO:tasks.workunit.client.0.smithi161.stdout: Rename 2175 14.755 203.946 2020-11-20T11:52:05.661 INFO:tasks.workunit.client.0.smithi161.stdout: Unlink 10396 5.174 144.257 2020-11-20T11:52:05.661 INFO:tasks.workunit.client.0.smithi161.stdout: Qpathinfo 46577 3.355 270.070 2020-11-20T11:52:05.661 INFO:tasks.workunit.client.0.smithi161.stdout: Qfileinfo 8118 0.143 3.643 2020-11-20T11:52:05.661 INFO:tasks.workunit.client.0.smithi161.stdout: Qfsinfo 8548 0.523 5.309 2020-11-20T11:52:05.662 INFO:tasks.workunit.client.0.smithi161.stdout: Sfileinfo 4173 1.689 17.846 2020-11-20T11:52:05.662 INFO:tasks.workunit.client.0.smithi161.stdout: Find 18005 2.699 20.266 2020-11-20T11:52:05.662 INFO:tasks.workunit.client.0.smithi161.stdout: WriteX 25372 0.290 21.991 2020-11-20T11:52:05.663 INFO:tasks.workunit.client.0.smithi161.stdout: ReadX 80600 0.008 2.812 2020-11-20T11:52:05.663 INFO:tasks.workunit.client.0.smithi161.stdout: LockX 168 1.067 3.760 2020-11-20T11:52:05.663 INFO:tasks.workunit.client.0.smithi161.stdout: UnlockX 168 1.005 3.491 2020-11-20T11:52:05.664 INFO:tasks.workunit.client.0.smithi161.stdout: Flush 3602 9.738 184.353 2020-11-20T11:52:05.664 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T11:52:05.665 INFO:tasks.workunit.client.0.smithi161.stdout:Throughput 2.67248 MB/sec 1 clients 1 procs max_latency=824.584 ms 2020-11-20T11:52:05.672 INFO:tasks.workunit.client.0.smithi161.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2020-11-20T11:52:05.672 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T11:52:05.673 INFO:tasks.workunit.client.0.smithi161.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2020-11-20T11:52:05.674 INFO:tasks.workunit.client.0.smithi161.stdout:7 of 10 processes prepared for launch 0 sec 2020-11-20T11:52:05.774 INFO:tasks.workunit.client.0.smithi161.stdout:10 of 10 processes prepared for launch 0 sec 2020-11-20T11:52:05.776 INFO:tasks.workunit.client.0.smithi161.stdout:releasing clients 2020-11-20T11:52:06.773 INFO:tasks.workunit.client.0.smithi161.stdout: 10 182 73.43 MB/sec warmup 1 sec latency 98.679 ms 2020-11-20T11:52:07.773 INFO:tasks.workunit.client.0.smithi161.stdout: 10 320 58.44 MB/sec warmup 2 sec latency 79.968 ms 2020-11-20T11:52:08.773 INFO:tasks.workunit.client.0.smithi161.stdout: 10 427 50.23 MB/sec warmup 3 sec latency 303.290 ms 2020-11-20T11:52:09.773 INFO:tasks.workunit.client.0.smithi161.stdout: 10 636 52.55 MB/sec warmup 4 sec latency 89.728 ms 2020-11-20T11:52:10.774 INFO:tasks.workunit.client.0.smithi161.stdout: 10 751 42.69 MB/sec warmup 5 sec latency 98.125 ms 2020-11-20T11:52:11.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 890 36.13 MB/sec warmup 6 sec latency 156.949 ms 2020-11-20T11:52:12.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1029 32.14 MB/sec warmup 7 sec latency 178.169 ms 2020-11-20T11:52:13.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1167 28.76 MB/sec warmup 8 sec latency 142.051 ms 2020-11-20T11:52:14.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1342 27.60 MB/sec warmup 9 sec latency 136.561 ms 2020-11-20T11:52:15.150 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:15.159 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:15.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1506 26.06 MB/sec warmup 10 sec latency 57.994 ms 2020-11-20T11:52:16.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1632 23.80 MB/sec warmup 11 sec latency 57.904 ms 2020-11-20T11:52:17.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1780 21.92 MB/sec warmup 12 sec latency 90.516 ms 2020-11-20T11:52:18.775 INFO:tasks.workunit.client.0.smithi161.stdout: 10 1927 20.32 MB/sec warmup 13 sec latency 61.153 ms 2020-11-20T11:52:19.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2094 19.03 MB/sec warmup 14 sec latency 62.135 ms 2020-11-20T11:52:20.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2229 17.89 MB/sec warmup 15 sec latency 181.854 ms 2020-11-20T11:52:21.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2381 17.46 MB/sec warmup 16 sec latency 160.386 ms 2020-11-20T11:52:22.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2475 16.77 MB/sec warmup 17 sec latency 203.687 ms 2020-11-20T11:52:23.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2617 16.28 MB/sec warmup 18 sec latency 307.401 ms 2020-11-20T11:52:24.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 2920 17.48 MB/sec warmup 19 sec latency 88.190 ms 2020-11-20T11:52:25.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3131 17.04 MB/sec warmup 20 sec latency 102.450 ms 2020-11-20T11:52:26.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3335 16.85 MB/sec warmup 21 sec latency 184.590 ms 2020-11-20T11:52:27.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3516 17.43 MB/sec warmup 22 sec latency 181.543 ms 2020-11-20T11:52:28.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3656 16.81 MB/sec warmup 23 sec latency 94.055 ms 2020-11-20T11:52:29.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3778 16.57 MB/sec warmup 24 sec latency 114.702 ms 2020-11-20T11:52:30.776 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3849 15.92 MB/sec warmup 25 sec latency 119.829 ms 2020-11-20T11:52:31.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 3939 15.41 MB/sec warmup 26 sec latency 136.128 ms 2020-11-20T11:52:32.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4009 14.84 MB/sec warmup 27 sec latency 120.217 ms 2020-11-20T11:52:33.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4098 14.31 MB/sec warmup 28 sec latency 91.338 ms 2020-11-20T11:52:34.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4183 13.84 MB/sec warmup 29 sec latency 113.058 ms 2020-11-20T11:52:35.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4290 13.46 MB/sec warmup 30 sec latency 133.700 ms 2020-11-20T11:52:36.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4390 13.10 MB/sec warmup 31 sec latency 109.669 ms 2020-11-20T11:52:37.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4534 12.83 MB/sec warmup 32 sec latency 81.167 ms 2020-11-20T11:52:38.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4684 12.75 MB/sec warmup 33 sec latency 127.683 ms 2020-11-20T11:52:39.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 4840 12.58 MB/sec warmup 34 sec latency 89.943 ms 2020-11-20T11:52:40.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5022 12.90 MB/sec warmup 35 sec latency 179.005 ms 2020-11-20T11:52:41.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5156 12.57 MB/sec warmup 36 sec latency 52.903 ms 2020-11-20T11:52:42.779 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5296 12.26 MB/sec warmup 37 sec latency 102.344 ms 2020-11-20T11:52:43.778 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5450 11.98 MB/sec warmup 38 sec latency 85.917 ms 2020-11-20T11:52:44.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5613 11.72 MB/sec warmup 39 sec latency 54.747 ms 2020-11-20T11:52:45.398 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:45.401 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:52:45.777 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5760 11.51 MB/sec warmup 40 sec latency 118.076 ms 2020-11-20T11:52:46.780 INFO:tasks.workunit.client.0.smithi161.stdout: 10 5926 11.47 MB/sec warmup 41 sec latency 80.633 ms 2020-11-20T11:52:47.779 INFO:tasks.workunit.client.0.smithi161.stdout: 10 6027 11.30 MB/sec warmup 42 sec latency 197.035 ms 2020-11-20T11:52:48.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 6219 11.43 MB/sec warmup 43 sec latency 84.657 ms 2020-11-20T11:52:49.779 INFO:tasks.workunit.client.0.smithi161.stdout: 10 6509 11.90 MB/sec warmup 44 sec latency 80.483 ms 2020-11-20T11:52:50.780 INFO:tasks.workunit.client.0.smithi161.stdout: 10 6751 11.91 MB/sec warmup 45 sec latency 85.492 ms 2020-11-20T11:52:51.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 6923 11.98 MB/sec warmup 46 sec latency 149.031 ms 2020-11-20T11:52:52.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7021 11.93 MB/sec warmup 47 sec latency 286.478 ms 2020-11-20T11:52:53.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7176 12.04 MB/sec warmup 48 sec latency 154.854 ms 2020-11-20T11:52:54.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7293 11.91 MB/sec warmup 49 sec latency 74.920 ms 2020-11-20T11:52:55.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7381 11.78 MB/sec warmup 50 sec latency 108.292 ms 2020-11-20T11:52:56.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7460 11.58 MB/sec warmup 51 sec latency 85.611 ms 2020-11-20T11:52:57.781 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7540 11.38 MB/sec warmup 52 sec latency 73.009 ms 2020-11-20T11:52:58.782 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7626 11.17 MB/sec warmup 53 sec latency 90.750 ms 2020-11-20T11:52:59.784 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7718 10.98 MB/sec warmup 54 sec latency 86.359 ms 2020-11-20T11:53:00.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7817 10.81 MB/sec warmup 55 sec latency 167.355 ms 2020-11-20T11:53:01.784 INFO:tasks.workunit.client.0.smithi161.stdout: 10 7921 10.66 MB/sec warmup 56 sec latency 114.750 ms 2020-11-20T11:53:02.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8035 10.56 MB/sec warmup 57 sec latency 120.003 ms 2020-11-20T11:53:03.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8167 10.45 MB/sec warmup 58 sec latency 98.512 ms 2020-11-20T11:53:04.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8348 10.53 MB/sec warmup 59 sec latency 67.913 ms 2020-11-20T11:53:05.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8470 10.42 MB/sec warmup 60 sec latency 251.384 ms 2020-11-20T11:53:06.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8648 10.55 MB/sec warmup 61 sec latency 74.611 ms 2020-11-20T11:53:07.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8772 10.39 MB/sec warmup 62 sec latency 111.040 ms 2020-11-20T11:53:08.788 INFO:tasks.workunit.client.0.smithi161.stdout: 10 8914 10.25 MB/sec warmup 63 sec latency 53.736 ms 2020-11-20T11:53:09.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9060 10.11 MB/sec warmup 64 sec latency 90.051 ms 2020-11-20T11:53:10.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9221 10.01 MB/sec warmup 65 sec latency 144.867 ms 2020-11-20T11:53:11.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9373 9.92 MB/sec warmup 66 sec latency 57.212 ms 2020-11-20T11:53:12.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9529 9.92 MB/sec warmup 67 sec latency 90.516 ms 2020-11-20T11:53:13.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9673 9.95 MB/sec warmup 68 sec latency 166.728 ms 2020-11-20T11:53:14.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 9851 9.99 MB/sec warmup 69 sec latency 87.206 ms 2020-11-20T11:53:15.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10127 10.28 MB/sec warmup 70 sec latency 114.911 ms 2020-11-20T11:53:16.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10289 10.30 MB/sec warmup 71 sec latency 95.560 ms 2020-11-20T11:53:17.788 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10505 10.39 MB/sec warmup 72 sec latency 124.017 ms 2020-11-20T11:53:18.305 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:18.648 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:18.787 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10614 10.33 MB/sec warmup 73 sec latency 99.442 ms 2020-11-20T11:53:19.785 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10768 10.44 MB/sec warmup 74 sec latency 90.717 ms 2020-11-20T11:53:20.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10838 10.32 MB/sec warmup 75 sec latency 326.226 ms 2020-11-20T11:53:21.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 10933 10.27 MB/sec warmup 76 sec latency 406.664 ms 2020-11-20T11:53:22.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11000 10.14 MB/sec warmup 77 sec latency 103.504 ms 2020-11-20T11:53:23.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11076 10.04 MB/sec warmup 78 sec latency 97.941 ms 2020-11-20T11:53:24.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11142 9.91 MB/sec warmup 79 sec latency 205.275 ms 2020-11-20T11:53:25.786 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11240 9.80 MB/sec warmup 80 sec latency 96.681 ms 2020-11-20T11:53:26.787 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11319 9.69 MB/sec warmup 81 sec latency 162.112 ms 2020-11-20T11:53:27.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11420 9.60 MB/sec warmup 82 sec latency 139.099 ms 2020-11-20T11:53:28.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11521 9.53 MB/sec warmup 83 sec latency 140.007 ms 2020-11-20T11:53:29.965 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11611 9.46 MB/sec warmup 84 sec latency 308.629 ms 2020-11-20T11:53:30.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11770 9.47 MB/sec warmup 85 sec latency 90.899 ms 2020-11-20T11:53:31.793 INFO:tasks.workunit.client.0.smithi161.stdout: 10 11931 9.48 MB/sec warmup 86 sec latency 86.967 ms 2020-11-20T11:53:32.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12070 9.45 MB/sec warmup 87 sec latency 166.775 ms 2020-11-20T11:53:33.793 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12231 9.49 MB/sec warmup 88 sec latency 238.853 ms 2020-11-20T11:53:34.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12367 9.39 MB/sec warmup 89 sec latency 165.441 ms 2020-11-20T11:53:35.792 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12513 9.30 MB/sec warmup 90 sec latency 147.038 ms 2020-11-20T11:53:36.795 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12679 9.24 MB/sec warmup 91 sec latency 56.132 ms 2020-11-20T11:53:37.796 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12836 9.18 MB/sec warmup 92 sec latency 69.129 ms 2020-11-20T11:53:38.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 12993 9.14 MB/sec warmup 93 sec latency 75.444 ms 2020-11-20T11:53:39.797 INFO:tasks.workunit.client.0.smithi161.stdout: 10 13028 9.05 MB/sec warmup 94 sec latency 826.954 ms 2020-11-20T11:53:40.797 INFO:tasks.workunit.client.0.smithi161.stdout: 10 13202 9.11 MB/sec warmup 95 sec latency 146.071 ms 2020-11-20T11:53:41.803 INFO:tasks.workunit.client.0.smithi161.stdout: 10 13364 9.19 MB/sec warmup 96 sec latency 153.203 ms 2020-11-20T11:53:42.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 13593 9.28 MB/sec warmup 97 sec latency 144.806 ms 2020-11-20T11:53:43.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 13829 9.40 MB/sec warmup 98 sec latency 194.814 ms 2020-11-20T11:53:44.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14004 9.44 MB/sec warmup 99 sec latency 219.124 ms 2020-11-20T11:53:45.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14152 9.47 MB/sec warmup 100 sec latency 379.073 ms 2020-11-20T11:53:46.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14300 9.54 MB/sec warmup 101 sec latency 98.662 ms 2020-11-20T11:53:47.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14400 9.48 MB/sec warmup 102 sec latency 233.657 ms 2020-11-20T11:53:48.761 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:48.769 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:53:48.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14492 9.44 MB/sec warmup 103 sec latency 105.714 ms 2020-11-20T11:53:49.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14561 9.35 MB/sec warmup 104 sec latency 164.378 ms 2020-11-20T11:53:50.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14633 9.27 MB/sec warmup 105 sec latency 204.881 ms 2020-11-20T11:53:51.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14703 9.19 MB/sec warmup 106 sec latency 104.655 ms 2020-11-20T11:53:52.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14787 9.12 MB/sec warmup 107 sec latency 124.077 ms 2020-11-20T11:53:53.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14883 9.04 MB/sec warmup 108 sec latency 139.707 ms 2020-11-20T11:53:54.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 14991 8.99 MB/sec warmup 109 sec latency 90.296 ms 2020-11-20T11:53:55.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15124 8.95 MB/sec warmup 110 sec latency 76.080 ms 2020-11-20T11:53:56.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15259 8.94 MB/sec warmup 111 sec latency 127.942 ms 2020-11-20T11:53:57.799 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15403 8.93 MB/sec warmup 112 sec latency 98.703 ms 2020-11-20T11:53:58.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15573 8.97 MB/sec warmup 113 sec latency 94.727 ms 2020-11-20T11:54:00.218 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15692 8.92 MB/sec warmup 114 sec latency 278.334 ms 2020-11-20T11:54:00.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15854 8.93 MB/sec warmup 115 sec latency 142.055 ms 2020-11-20T11:54:01.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 15996 8.86 MB/sec warmup 116 sec latency 64.801 ms 2020-11-20T11:54:02.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 16144 8.81 MB/sec warmup 117 sec latency 106.045 ms 2020-11-20T11:54:03.805 INFO:tasks.workunit.client.0.smithi161.stdout: 10 16302 8.76 MB/sec warmup 118 sec latency 124.182 ms 2020-11-20T11:54:04.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 16403 8.72 MB/sec warmup 119 sec latency 458.991 ms 2020-11-20T11:54:06.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 16737 11.29 MB/sec execute 1 sec latency 152.436 ms 2020-11-20T11:54:07.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 16950 15.42 MB/sec execute 2 sec latency 86.710 ms 2020-11-20T11:54:08.803 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17131 14.05 MB/sec execute 3 sec latency 135.480 ms 2020-11-20T11:54:09.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17362 16.00 MB/sec execute 4 sec latency 120.252 ms 2020-11-20T11:54:10.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17526 16.07 MB/sec execute 5 sec latency 100.685 ms 2020-11-20T11:54:11.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17707 15.33 MB/sec execute 6 sec latency 123.680 ms 2020-11-20T11:54:12.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17833 14.71 MB/sec execute 7 sec latency 103.971 ms 2020-11-20T11:54:13.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 17938 13.96 MB/sec execute 8 sec latency 171.722 ms 2020-11-20T11:54:14.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18010 12.63 MB/sec execute 9 sec latency 274.132 ms 2020-11-20T11:54:15.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18102 11.81 MB/sec execute 10 sec latency 108.528 ms 2020-11-20T11:54:16.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18189 10.81 MB/sec execute 11 sec latency 87.834 ms 2020-11-20T11:54:17.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18288 10.00 MB/sec execute 12 sec latency 80.291 ms 2020-11-20T11:54:18.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18367 9.31 MB/sec execute 13 sec latency 141.736 ms 2020-11-20T11:54:19.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18418 8.71 MB/sec execute 14 sec latency 452.300 ms 2020-11-20T11:54:20.800 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18511 8.28 MB/sec execute 15 sec latency 124.439 ms 2020-11-20T11:54:20.843 INFO:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:20.846 INFO:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T11:54:21.053 INFO:tasks.ceph.mds.a.smithi161.stderr:2020-11-20T11:54:21.048+0000 7f8755e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 21455) UID: 0 2020-11-20T11:54:21.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18641 7.99 MB/sec execute 16 sec latency 95.225 ms 2020-11-20T11:54:22.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18765 7.98 MB/sec execute 17 sec latency 113.610 ms 2020-11-20T11:54:23.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 18911 7.90 MB/sec execute 18 sec latency 113.414 ms 2020-11-20T11:54:24.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19059 8.11 MB/sec execute 19 sec latency 117.951 ms 2020-11-20T11:54:25.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19207 8.09 MB/sec execute 20 sec latency 80.651 ms 2020-11-20T11:54:26.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19337 7.89 MB/sec execute 21 sec latency 194.289 ms 2020-11-20T11:54:27.801 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19495 7.85 MB/sec execute 22 sec latency 109.742 ms 2020-11-20T11:54:28.802 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19641 7.61 MB/sec execute 23 sec latency 87.521 ms 2020-11-20T11:54:30.306 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19767 7.37 MB/sec execute 24 sec latency 202.675 ms 2020-11-20T11:54:30.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 19929 7.27 MB/sec execute 25 sec latency 117.172 ms 2020-11-20T11:54:31.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20089 7.31 MB/sec execute 26 sec latency 94.848 ms 2020-11-20T11:54:32.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20257 7.40 MB/sec execute 27 sec latency 123.584 ms 2020-11-20T11:54:33.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20390 7.44 MB/sec execute 28 sec latency 181.729 ms 2020-11-20T11:54:34.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20533 7.60 MB/sec execute 29 sec latency 211.096 ms 2020-11-20T11:54:35.805 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20736 7.93 MB/sec execute 30 sec latency 155.678 ms 2020-11-20T11:54:36.805 INFO:tasks.workunit.client.0.smithi161.stdout: 10 20993 8.35 MB/sec execute 31 sec latency 69.611 ms 2020-11-20T11:54:37.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21169 8.55 MB/sec execute 32 sec latency 80.988 ms 2020-11-20T11:54:38.804 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21336 8.75 MB/sec execute 33 sec latency 101.945 ms 2020-11-20T11:54:39.805 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21475 8.89 MB/sec execute 34 sec latency 135.479 ms 2020-11-20T11:54:40.805 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21573 8.73 MB/sec execute 35 sec latency 102.774 ms 2020-11-20T11:54:42.010 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21657 8.59 MB/sec execute 36 sec latency 212.954 ms 2020-11-20T11:54:42.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21733 8.39 MB/sec execute 37 sec latency 108.731 ms 2020-11-20T11:54:43.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21793 8.19 MB/sec execute 38 sec latency 147.411 ms 2020-11-20T11:54:44.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21877 7.99 MB/sec execute 39 sec latency 104.241 ms 2020-11-20T11:54:45.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 21957 7.81 MB/sec execute 40 sec latency 138.672 ms 2020-11-20T11:54:46.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22028 7.67 MB/sec execute 41 sec latency 216.562 ms 2020-11-20T11:54:47.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22118 7.53 MB/sec execute 42 sec latency 124.622 ms 2020-11-20T11:54:48.807 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22218 7.47 MB/sec execute 43 sec latency 149.913 ms 2020-11-20T11:54:49.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22329 7.37 MB/sec execute 44 sec latency 167.665 ms 2020-11-20T11:54:50.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22472 7.36 MB/sec execute 45 sec latency 88.103 ms 2020-11-20T11:54:51.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22619 7.35 MB/sec execute 46 sec latency 129.815 ms 2020-11-20T11:54:52.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22784 7.52 MB/sec execute 47 sec latency 138.079 ms 2020-11-20T11:54:53.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 22935 7.59 MB/sec execute 48 sec latency 236.538 ms 2020-11-20T11:54:54.834 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23038 7.45 MB/sec execute 49 sec latency 231.179 ms 2020-11-20T11:54:55.902 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23177 7.34 MB/sec execute 50 sec latency 280.043 ms 2020-11-20T11:54:56.808 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23326 7.23 MB/sec execute 51 sec latency 89.589 ms 2020-11-20T11:54:57.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23502 7.22 MB/sec execute 52 sec latency 90.991 ms 2020-11-20T11:54:58.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23684 7.20 MB/sec execute 53 sec latency 100.859 ms 2020-11-20T11:54:59.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23826 7.21 MB/sec execute 54 sec latency 85.538 ms 2020-11-20T11:55:00.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 23925 7.21 MB/sec execute 55 sec latency 263.789 ms 2020-11-20T11:55:01.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24113 7.40 MB/sec execute 56 sec latency 91.458 ms 2020-11-20T11:55:02.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24345 7.71 MB/sec execute 57 sec latency 110.997 ms 2020-11-20T11:55:03.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24507 7.75 MB/sec execute 58 sec latency 184.230 ms 2020-11-20T11:55:04.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24702 7.81 MB/sec execute 59 sec latency 115.170 ms 2020-11-20T11:55:05.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24851 7.93 MB/sec execute 60 sec latency 87.774 ms 2020-11-20T11:55:06.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 24997 8.03 MB/sec execute 61 sec latency 129.852 ms 2020-11-20T11:55:07.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25093 7.97 MB/sec execute 62 sec latency 205.069 ms 2020-11-20T11:55:08.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25193 7.94 MB/sec execute 63 sec latency 80.581 ms 2020-11-20T11:55:09.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25261 7.83 MB/sec execute 64 sec latency 91.790 ms 2020-11-20T11:55:10.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25348 7.74 MB/sec execute 65 sec latency 73.357 ms 2020-11-20T11:55:11.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25426 7.64 MB/sec execute 66 sec latency 136.878 ms 2020-11-20T11:55:12.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25501 7.53 MB/sec execute 67 sec latency 120.019 ms 2020-11-20T11:55:13.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25577 7.44 MB/sec execute 68 sec latency 390.307 ms 2020-11-20T11:55:14.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25639 7.38 MB/sec execute 69 sec latency 947.337 ms 2020-11-20T11:55:15.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25719 7.30 MB/sec execute 70 sec latency 160.634 ms 2020-11-20T11:55:16.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25802 7.23 MB/sec execute 71 sec latency 143.261 ms 2020-11-20T11:55:17.809 INFO:tasks.workunit.client.0.smithi161.stdout: 10 25927 7.17 MB/sec execute 72 sec latency 127.475 ms 2020-11-20T11:55:18.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26084 7.22 MB/sec execute 73 sec latency 130.396 ms 2020-11-20T11:55:19.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26223 7.18 MB/sec execute 74 sec latency 97.522 ms 2020-11-20T11:55:20.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26379 7.29 MB/sec execute 75 sec latency 147.808 ms 2020-11-20T11:55:21.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26530 7.32 MB/sec execute 76 sec latency 125.488 ms 2020-11-20T11:55:22.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26662 7.28 MB/sec execute 77 sec latency 117.060 ms 2020-11-20T11:55:23.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26799 7.23 MB/sec execute 78 sec latency 206.728 ms 2020-11-20T11:55:24.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26833 7.15 MB/sec execute 79 sec latency 791.935 ms 2020-11-20T11:55:25.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26833 7.06 MB/sec execute 80 sec latency 1792.029 ms 2020-11-20T11:55:26.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 26892 6.98 MB/sec execute 81 sec latency 2702.275 ms 2020-11-20T11:55:27.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27058 6.94 MB/sec execute 82 sec latency 95.100 ms 2020-11-20T11:55:28.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27218 6.92 MB/sec execute 83 sec latency 89.478 ms 2020-11-20T11:55:29.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27399 6.99 MB/sec execute 84 sec latency 66.508 ms 2020-11-20T11:55:30.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27494 6.95 MB/sec execute 85 sec latency 154.950 ms 2020-11-20T11:55:31.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27645 7.00 MB/sec execute 86 sec latency 110.474 ms 2020-11-20T11:55:32.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 27893 7.26 MB/sec execute 87 sec latency 76.141 ms 2020-11-20T11:55:33.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28081 7.29 MB/sec execute 88 sec latency 112.667 ms 2020-11-20T11:55:34.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28279 7.34 MB/sec execute 89 sec latency 141.995 ms 2020-11-20T11:55:35.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28394 7.39 MB/sec execute 90 sec latency 208.739 ms 2020-11-20T11:55:36.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28487 7.41 MB/sec execute 91 sec latency 477.837 ms 2020-11-20T11:55:37.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28614 7.43 MB/sec execute 92 sec latency 111.755 ms 2020-11-20T11:55:38.810 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28715 7.41 MB/sec execute 93 sec latency 141.691 ms 2020-11-20T11:55:39.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28810 7.36 MB/sec execute 94 sec latency 105.209 ms 2020-11-20T11:55:40.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28900 7.32 MB/sec execute 95 sec latency 176.566 ms 2020-11-20T11:55:41.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 28975 7.25 MB/sec execute 96 sec latency 166.100 ms 2020-11-20T11:55:42.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29067 7.21 MB/sec execute 97 sec latency 92.903 ms 2020-11-20T11:55:43.811 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29164 7.14 MB/sec execute 98 sec latency 206.804 ms 2020-11-20T11:55:44.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29254 7.10 MB/sec execute 99 sec latency 108.548 ms 2020-11-20T11:55:45.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29352 7.04 MB/sec execute 100 sec latency 169.101 ms 2020-11-20T11:55:46.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29468 7.02 MB/sec execute 101 sec latency 150.792 ms 2020-11-20T11:55:47.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29584 7.00 MB/sec execute 102 sec latency 165.575 ms 2020-11-20T11:55:48.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29700 6.98 MB/sec execute 103 sec latency 114.689 ms 2020-11-20T11:55:49.812 INFO:tasks.workunit.client.0.smithi161.stdout: 10 29851 7.01 MB/sec execute 104 sec latency 105.073 ms 2020-11-20T11:55:50.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30023 7.08 MB/sec execute 105 sec latency 111.798 ms 2020-11-20T11:55:51.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30154 7.08 MB/sec execute 106 sec latency 295.716 ms 2020-11-20T11:55:52.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30213 7.05 MB/sec execute 107 sec latency 841.337 ms 2020-11-20T11:55:53.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30356 7.01 MB/sec execute 108 sec latency 424.129 ms 2020-11-20T11:55:54.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30499 6.97 MB/sec execute 109 sec latency 78.264 ms 2020-11-20T11:55:55.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30656 6.97 MB/sec execute 110 sec latency 205.920 ms 2020-11-20T11:55:56.817 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30815 6.95 MB/sec execute 111 sec latency 132.491 ms 2020-11-20T11:55:57.816 INFO:tasks.workunit.client.0.smithi161.stdout: 10 30971 6.95 MB/sec execute 112 sec latency 106.952 ms 2020-11-20T11:55:58.817 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31100 6.95 MB/sec execute 113 sec latency 115.757 ms 2020-11-20T11:55:59.820 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31259 7.02 MB/sec execute 114 sec latency 100.572 ms 2020-11-20T11:56:00.817 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31456 7.11 MB/sec execute 115 sec latency 196.187 ms 2020-11-20T11:56:01.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31636 7.19 MB/sec execute 116 sec latency 123.929 ms 2020-11-20T11:56:02.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31833 7.23 MB/sec execute 117 sec latency 164.754 ms 2020-11-20T11:56:03.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 31984 7.28 MB/sec execute 118 sec latency 181.679 ms 2020-11-20T11:56:04.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32106 7.32 MB/sec execute 119 sec latency 127.335 ms 2020-11-20T11:56:05.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32227 7.31 MB/sec execute 120 sec latency 124.383 ms 2020-11-20T11:56:06.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32336 7.31 MB/sec execute 121 sec latency 87.498 ms 2020-11-20T11:56:07.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32423 7.26 MB/sec execute 122 sec latency 90.392 ms 2020-11-20T11:56:08.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32504 7.24 MB/sec execute 123 sec latency 119.998 ms 2020-11-20T11:56:09.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32583 7.18 MB/sec execute 124 sec latency 151.571 ms 2020-11-20T11:56:10.820 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32679 7.13 MB/sec execute 125 sec latency 239.158 ms 2020-11-20T11:56:11.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32789 7.09 MB/sec execute 126 sec latency 300.875 ms 2020-11-20T11:56:12.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32919 7.08 MB/sec execute 127 sec latency 154.236 ms 2020-11-20T11:56:13.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 32987 7.03 MB/sec execute 128 sec latency 178.497 ms 2020-11-20T11:56:14.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33077 7.00 MB/sec execute 129 sec latency 145.550 ms 2020-11-20T11:56:15.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33193 6.97 MB/sec execute 130 sec latency 141.715 ms 2020-11-20T11:56:16.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33334 6.99 MB/sec execute 131 sec latency 121.467 ms 2020-11-20T11:56:17.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33482 6.99 MB/sec execute 132 sec latency 153.208 ms 2020-11-20T11:56:18.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33667 7.07 MB/sec execute 133 sec latency 154.464 ms 2020-11-20T11:56:19.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33796 7.07 MB/sec execute 134 sec latency 151.135 ms 2020-11-20T11:56:20.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 33926 7.05 MB/sec execute 135 sec latency 101.725 ms 2020-11-20T11:56:21.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34078 7.03 MB/sec execute 136 sec latency 134.912 ms 2020-11-20T11:56:22.818 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34229 7.02 MB/sec execute 137 sec latency 75.240 ms 2020-11-20T11:56:23.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34376 6.98 MB/sec execute 138 sec latency 144.763 ms 2020-11-20T11:56:24.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34523 6.97 MB/sec execute 139 sec latency 116.262 ms 2020-11-20T11:56:25.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34659 7.01 MB/sec execute 140 sec latency 145.659 ms 2020-11-20T11:56:26.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34763 7.00 MB/sec execute 141 sec latency 203.082 ms 2020-11-20T11:56:27.820 INFO:tasks.workunit.client.0.smithi161.stdout: 10 34945 7.05 MB/sec execute 142 sec latency 135.091 ms 2020-11-20T11:56:28.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35159 7.14 MB/sec execute 143 sec latency 84.601 ms 2020-11-20T11:56:29.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35329 7.18 MB/sec execute 144 sec latency 149.580 ms 2020-11-20T11:56:30.819 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35496 7.19 MB/sec execute 145 sec latency 176.893 ms 2020-11-20T11:56:31.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35618 7.21 MB/sec execute 146 sec latency 133.295 ms 2020-11-20T11:56:32.821 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35752 7.26 MB/sec execute 147 sec latency 131.366 ms 2020-11-20T11:56:33.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35843 7.24 MB/sec execute 148 sec latency 198.732 ms 2020-11-20T11:56:34.821 INFO:tasks.workunit.client.0.smithi161.stdout: 10 35940 7.24 MB/sec execute 149 sec latency 114.357 ms 2020-11-20T11:56:35.821 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36023 7.20 MB/sec execute 150 sec latency 135.991 ms 2020-11-20T11:56:36.830 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36107 7.16 MB/sec execute 151 sec latency 127.628 ms 2020-11-20T11:56:37.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36194 7.13 MB/sec execute 152 sec latency 432.206 ms 2020-11-20T11:56:38.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36284 7.09 MB/sec execute 153 sec latency 124.489 ms 2020-11-20T11:56:39.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36391 7.07 MB/sec execute 154 sec latency 159.954 ms 2020-11-20T11:56:40.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36464 7.03 MB/sec execute 155 sec latency 154.299 ms 2020-11-20T11:56:41.822 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36555 7.01 MB/sec execute 156 sec latency 155.438 ms 2020-11-20T11:56:42.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36679 7.00 MB/sec execute 157 sec latency 138.418 ms 2020-11-20T11:56:43.827 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36787 7.00 MB/sec execute 158 sec latency 198.077 ms 2020-11-20T11:56:44.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 36918 6.99 MB/sec execute 159 sec latency 137.478 ms 2020-11-20T11:56:45.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37069 7.00 MB/sec execute 160 sec latency 104.393 ms 2020-11-20T11:56:46.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37206 7.00 MB/sec execute 161 sec latency 124.676 ms 2020-11-20T11:56:47.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37368 7.04 MB/sec execute 162 sec latency 120.253 ms 2020-11-20T11:56:48.825 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37524 7.04 MB/sec execute 163 sec latency 95.976 ms 2020-11-20T11:56:50.720 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37660 7.02 MB/sec execute 164 sec latency 93.871 ms 2020-11-20T11:56:50.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37807 7.00 MB/sec execute 165 sec latency 117.640 ms 2020-11-20T11:56:51.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 37946 6.98 MB/sec execute 166 sec latency 113.450 ms 2020-11-20T11:56:52.825 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38120 7.00 MB/sec execute 167 sec latency 144.945 ms 2020-11-20T11:56:53.823 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38245 6.99 MB/sec execute 168 sec latency 195.293 ms 2020-11-20T11:56:54.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38378 7.00 MB/sec execute 169 sec latency 126.002 ms 2020-11-20T11:56:55.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38533 7.03 MB/sec execute 170 sec latency 166.049 ms 2020-11-20T11:56:56.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38727 7.11 MB/sec execute 171 sec latency 160.546 ms 2020-11-20T11:56:57.825 INFO:tasks.workunit.client.0.smithi161.stdout: 10 38907 7.13 MB/sec execute 172 sec latency 125.040 ms 2020-11-20T11:56:58.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39072 7.14 MB/sec execute 173 sec latency 122.502 ms 2020-11-20T11:56:59.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39219 7.17 MB/sec execute 174 sec latency 130.933 ms 2020-11-20T11:57:00.826 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39343 7.21 MB/sec execute 175 sec latency 160.501 ms 2020-11-20T11:57:01.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39432 7.19 MB/sec execute 176 sec latency 195.074 ms 2020-11-20T11:57:02.825 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39532 7.18 MB/sec execute 177 sec latency 135.830 ms 2020-11-20T11:57:03.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39599 7.14 MB/sec execute 178 sec latency 222.475 ms 2020-11-20T11:57:04.824 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39689 7.12 MB/sec execute 179 sec latency 111.823 ms 2020-11-20T11:57:05.828 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39789 7.08 MB/sec execute 180 sec latency 113.749 ms 2020-11-20T11:57:06.830 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39874 7.07 MB/sec execute 181 sec latency 232.128 ms 2020-11-20T11:57:07.838 INFO:tasks.workunit.client.0.smithi161.stdout: 10 39964 7.04 MB/sec execute 182 sec latency 144.145 ms 2020-11-20T11:57:08.828 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40070 7.01 MB/sec execute 183 sec latency 119.582 ms 2020-11-20T11:57:09.828 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40168 7.00 MB/sec execute 184 sec latency 183.312 ms 2020-11-20T11:57:10.831 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40294 7.00 MB/sec execute 185 sec latency 182.767 ms 2020-11-20T11:57:11.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40412 6.98 MB/sec execute 186 sec latency 172.149 ms 2020-11-20T11:57:12.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40519 6.97 MB/sec execute 187 sec latency 131.659 ms 2020-11-20T11:57:13.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40634 6.99 MB/sec execute 188 sec latency 393.055 ms 2020-11-20T11:57:14.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40761 6.96 MB/sec execute 189 sec latency 146.478 ms 2020-11-20T11:57:15.829 INFO:tasks.workunit.client.0.smithi161.stdout: 10 40917 7.00 MB/sec execute 190 sec latency 157.450 ms 2020-11-20T11:57:16.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41050 7.02 MB/sec execute 191 sec latency 226.497 ms 2020-11-20T11:57:17.834 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41164 7.00 MB/sec execute 192 sec latency 196.705 ms 2020-11-20T11:57:18.830 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41291 6.97 MB/sec execute 193 sec latency 213.932 ms 2020-11-20T11:57:19.831 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41447 6.98 MB/sec execute 194 sec latency 162.884 ms 2020-11-20T11:57:20.831 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41591 6.96 MB/sec execute 195 sec latency 133.297 ms 2020-11-20T11:57:21.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41733 6.94 MB/sec execute 196 sec latency 144.556 ms 2020-11-20T11:57:22.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41860 6.95 MB/sec execute 197 sec latency 391.787 ms 2020-11-20T11:57:23.834 INFO:tasks.workunit.client.0.smithi161.stdout: 10 41955 6.94 MB/sec execute 198 sec latency 623.073 ms 2020-11-20T11:57:24.949 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42085 6.97 MB/sec execute 199 sec latency 132.948 ms 2020-11-20T11:57:25.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42262 7.00 MB/sec execute 200 sec latency 192.390 ms 2020-11-20T11:57:26.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42393 7.03 MB/sec execute 201 sec latency 218.984 ms 2020-11-20T11:57:27.833 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42538 7.04 MB/sec execute 202 sec latency 158.314 ms 2020-11-20T11:57:28.837 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42719 7.06 MB/sec execute 203 sec latency 193.319 ms 2020-11-20T11:57:29.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42836 7.08 MB/sec execute 204 sec latency 135.744 ms 2020-11-20T11:57:30.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 42973 7.10 MB/sec execute 205 sec latency 148.667 ms 2020-11-20T11:57:31.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43072 7.09 MB/sec execute 206 sec latency 205.338 ms 2020-11-20T11:57:32.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43168 7.07 MB/sec execute 207 sec latency 278.139 ms 2020-11-20T11:57:33.837 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43256 7.04 MB/sec execute 208 sec latency 112.528 ms 2020-11-20T11:57:34.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43350 7.03 MB/sec execute 209 sec latency 160.495 ms 2020-11-20T11:57:35.836 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43432 7.01 MB/sec execute 210 sec latency 148.828 ms 2020-11-20T11:57:36.837 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43535 6.98 MB/sec execute 211 sec latency 140.224 ms 2020-11-20T11:57:37.839 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43646 6.97 MB/sec execute 212 sec latency 287.453 ms 2020-11-20T11:57:38.838 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43776 6.97 MB/sec execute 213 sec latency 176.111 ms 2020-11-20T11:57:39.838 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43871 6.95 MB/sec execute 214 sec latency 680.181 ms 2020-11-20T11:57:40.839 INFO:tasks.workunit.client.0.smithi161.stdout: 10 43960 6.93 MB/sec execute 215 sec latency 156.688 ms 2020-11-20T11:57:41.838 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44084 6.92 MB/sec execute 216 sec latency 128.375 ms 2020-11-20T11:57:42.838 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44205 6.93 MB/sec execute 217 sec latency 222.666 ms 2020-11-20T11:57:43.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44330 6.94 MB/sec execute 218 sec latency 172.279 ms 2020-11-20T11:57:44.839 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44470 6.96 MB/sec execute 219 sec latency 105.956 ms 2020-11-20T11:57:45.839 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44642 6.98 MB/sec execute 220 sec latency 112.358 ms 2020-11-20T11:57:46.839 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44773 6.97 MB/sec execute 221 sec latency 112.527 ms 2020-11-20T11:57:47.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44880 6.96 MB/sec execute 222 sec latency 435.720 ms 2020-11-20T11:57:48.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 44945 6.93 MB/sec execute 223 sec latency 821.815 ms 2020-11-20T11:57:49.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45118 6.92 MB/sec execute 224 sec latency 82.994 ms 2020-11-20T11:57:50.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45255 6.90 MB/sec execute 225 sec latency 118.222 ms 2020-11-20T11:57:51.927 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45402 6.90 MB/sec execute 226 sec latency 132.168 ms 2020-11-20T11:57:52.842 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45527 6.91 MB/sec execute 227 sec latency 136.032 ms 2020-11-20T11:57:53.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45625 6.90 MB/sec execute 228 sec latency 167.029 ms 2020-11-20T11:57:54.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45812 6.95 MB/sec execute 229 sec latency 134.924 ms 2020-11-20T11:57:55.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 45970 6.97 MB/sec execute 230 sec latency 122.756 ms 2020-11-20T11:57:57.170 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46144 7.00 MB/sec execute 231 sec latency 107.234 ms 2020-11-20T11:57:57.840 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46284 7.00 MB/sec execute 232 sec latency 225.460 ms 2020-11-20T11:57:58.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46411 7.02 MB/sec execute 233 sec latency 133.952 ms 2020-11-20T11:57:59.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46531 7.03 MB/sec execute 234 sec latency 171.251 ms 2020-11-20T11:58:00.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46636 7.02 MB/sec execute 235 sec latency 143.831 ms 2020-11-20T11:58:01.849 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46743 7.00 MB/sec execute 236 sec latency 119.595 ms 2020-11-20T11:58:02.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46822 6.99 MB/sec execute 237 sec latency 276.842 ms 2020-11-20T11:58:03.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 46913 6.99 MB/sec execute 238 sec latency 183.739 ms 2020-11-20T11:58:04.844 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47014 6.97 MB/sec execute 239 sec latency 85.070 ms 2020-11-20T11:58:05.846 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47143 6.97 MB/sec execute 240 sec latency 86.836 ms 2020-11-20T11:58:06.846 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47239 6.94 MB/sec execute 241 sec latency 121.144 ms 2020-11-20T11:58:07.849 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47351 6.93 MB/sec execute 242 sec latency 240.066 ms 2020-11-20T11:58:08.846 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47463 6.91 MB/sec execute 243 sec latency 108.620 ms 2020-11-20T11:58:09.847 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47580 6.91 MB/sec execute 244 sec latency 157.259 ms 2020-11-20T11:58:10.849 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47691 6.91 MB/sec execute 245 sec latency 151.749 ms 2020-11-20T11:58:11.847 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47796 6.91 MB/sec execute 246 sec latency 171.084 ms 2020-11-20T11:58:12.847 INFO:tasks.workunit.client.0.smithi161.stdout: 10 47890 6.90 MB/sec execute 247 sec latency 291.513 ms 2020-11-20T11:58:13.847 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48005 6.90 MB/sec execute 248 sec latency 210.422 ms 2020-11-20T11:58:14.848 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48160 6.92 MB/sec execute 249 sec latency 126.798 ms 2020-11-20T11:58:15.849 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48282 6.90 MB/sec execute 250 sec latency 117.967 ms 2020-11-20T11:58:16.848 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48443 6.93 MB/sec execute 251 sec latency 158.986 ms 2020-11-20T11:58:17.854 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48550 6.90 MB/sec execute 252 sec latency 241.699 ms 2020-11-20T11:58:18.853 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48587 6.88 MB/sec execute 253 sec latency 776.065 ms 2020-11-20T11:58:19.857 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48652 6.86 MB/sec execute 254 sec latency 1187.902 ms 2020-11-20T11:58:20.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48812 6.85 MB/sec execute 255 sec latency 85.212 ms 2020-11-20T11:58:21.855 INFO:tasks.workunit.client.0.smithi161.stdout: 10 48924 6.85 MB/sec execute 256 sec latency 299.917 ms 2020-11-20T11:58:22.854 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49055 6.84 MB/sec execute 257 sec latency 182.668 ms 2020-11-20T11:58:23.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49170 6.85 MB/sec execute 258 sec latency 216.684 ms 2020-11-20T11:58:24.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49315 6.87 MB/sec execute 259 sec latency 171.936 ms 2020-11-20T11:58:25.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49461 6.87 MB/sec execute 260 sec latency 133.834 ms 2020-11-20T11:58:26.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49611 6.91 MB/sec execute 261 sec latency 224.451 ms 2020-11-20T11:58:27.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49758 6.92 MB/sec execute 262 sec latency 123.747 ms 2020-11-20T11:58:28.853 INFO:tasks.workunit.client.0.smithi161.stdout: 10 49904 6.92 MB/sec execute 263 sec latency 114.939 ms 2020-11-20T11:58:29.852 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50042 6.93 MB/sec execute 264 sec latency 89.968 ms 2020-11-20T11:58:30.853 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50174 6.95 MB/sec execute 265 sec latency 138.629 ms 2020-11-20T11:58:31.854 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50264 6.93 MB/sec execute 266 sec latency 274.369 ms 2020-11-20T11:58:32.853 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50362 6.93 MB/sec execute 267 sec latency 118.325 ms 2020-11-20T11:58:33.857 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50444 6.92 MB/sec execute 268 sec latency 211.334 ms 2020-11-20T11:58:34.858 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50557 6.91 MB/sec execute 269 sec latency 105.592 ms 2020-11-20T11:58:35.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50680 6.90 MB/sec execute 270 sec latency 109.136 ms 2020-11-20T11:58:36.857 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50776 6.88 MB/sec execute 271 sec latency 190.545 ms 2020-11-20T11:58:37.857 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50863 6.86 MB/sec execute 272 sec latency 273.452 ms 2020-11-20T11:58:38.858 INFO:tasks.workunit.client.0.smithi161.stdout: 10 50905 6.84 MB/sec execute 273 sec latency 759.738 ms 2020-11-20T11:58:39.858 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51013 6.84 MB/sec execute 274 sec latency 163.396 ms 2020-11-20T11:58:40.859 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51111 6.82 MB/sec execute 275 sec latency 218.275 ms 2020-11-20T11:58:41.860 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51211 6.81 MB/sec execute 276 sec latency 162.672 ms 2020-11-20T11:58:42.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51331 6.82 MB/sec execute 277 sec latency 227.873 ms 2020-11-20T11:58:43.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51427 6.82 MB/sec execute 278 sec latency 316.171 ms 2020-11-20T11:58:44.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51569 6.82 MB/sec execute 279 sec latency 107.132 ms 2020-11-20T11:58:45.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51705 6.83 MB/sec execute 280 sec latency 202.186 ms 2020-11-20T11:58:46.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51834 6.83 MB/sec execute 281 sec latency 190.528 ms 2020-11-20T11:58:47.862 INFO:tasks.workunit.client.0.smithi161.stdout: 10 51976 6.84 MB/sec execute 282 sec latency 212.268 ms 2020-11-20T11:58:48.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52101 6.82 MB/sec execute 283 sec latency 178.369 ms 2020-11-20T11:58:49.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52229 6.82 MB/sec execute 284 sec latency 186.456 ms 2020-11-20T11:58:50.861 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52354 6.80 MB/sec execute 285 sec latency 179.404 ms 2020-11-20T11:58:51.862 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52493 6.80 MB/sec execute 286 sec latency 94.985 ms 2020-11-20T11:58:52.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52608 6.80 MB/sec execute 287 sec latency 222.129 ms 2020-11-20T11:58:53.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52757 6.81 MB/sec execute 288 sec latency 171.816 ms 2020-11-20T11:58:54.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 52875 6.81 MB/sec execute 289 sec latency 121.191 ms 2020-11-20T11:58:55.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53049 6.84 MB/sec execute 290 sec latency 115.101 ms 2020-11-20T11:58:56.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53194 6.85 MB/sec execute 291 sec latency 153.612 ms 2020-11-20T11:58:57.865 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53328 6.86 MB/sec execute 292 sec latency 151.656 ms 2020-11-20T11:58:58.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53445 6.86 MB/sec execute 293 sec latency 238.732 ms 2020-11-20T11:58:59.864 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53594 6.87 MB/sec execute 294 sec latency 149.642 ms 2020-11-20T11:59:00.868 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53703 6.87 MB/sec execute 295 sec latency 193.960 ms 2020-11-20T11:59:01.872 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53807 6.87 MB/sec execute 296 sec latency 144.184 ms 2020-11-20T11:59:02.878 INFO:tasks.workunit.client.0.smithi161.stdout: 10 53891 6.86 MB/sec execute 297 sec latency 179.890 ms 2020-11-20T11:59:03.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54000 6.86 MB/sec execute 298 sec latency 254.733 ms 2020-11-20T11:59:04.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54125 6.87 MB/sec execute 299 sec latency 94.903 ms 2020-11-20T11:59:05.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54227 6.85 MB/sec execute 300 sec latency 134.269 ms 2020-11-20T11:59:06.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54343 6.84 MB/sec execute 301 sec latency 102.505 ms 2020-11-20T11:59:07.878 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54443 6.82 MB/sec execute 302 sec latency 134.592 ms 2020-11-20T11:59:08.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54564 6.82 MB/sec execute 303 sec latency 148.968 ms 2020-11-20T11:59:09.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54670 6.81 MB/sec execute 304 sec latency 126.885 ms 2020-11-20T11:59:10.877 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54778 6.80 MB/sec execute 305 sec latency 106.407 ms 2020-11-20T11:59:11.884 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54893 6.81 MB/sec execute 306 sec latency 175.027 ms 2020-11-20T11:59:12.881 INFO:tasks.workunit.client.0.smithi161.stdout: 10 54981 6.81 MB/sec execute 307 sec latency 323.793 ms 2020-11-20T11:59:13.882 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55086 6.79 MB/sec execute 308 sec latency 200.796 ms 2020-11-20T11:59:14.881 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55210 6.78 MB/sec execute 309 sec latency 111.567 ms 2020-11-20T11:59:15.882 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55371 6.80 MB/sec execute 310 sec latency 153.452 ms 2020-11-20T11:59:16.881 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55485 6.79 MB/sec execute 311 sec latency 172.381 ms 2020-11-20T11:59:17.881 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55644 6.81 MB/sec execute 312 sec latency 103.233 ms 2020-11-20T11:59:18.884 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55778 6.81 MB/sec execute 313 sec latency 111.960 ms 2020-11-20T11:59:19.884 INFO:tasks.workunit.client.0.smithi161.stdout: 10 55906 6.80 MB/sec execute 314 sec latency 328.287 ms 2020-11-20T11:59:20.884 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56031 6.79 MB/sec execute 315 sec latency 164.526 ms 2020-11-20T11:59:21.884 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56194 6.80 MB/sec execute 316 sec latency 99.746 ms 2020-11-20T11:59:22.885 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56296 6.79 MB/sec execute 317 sec latency 215.041 ms 2020-11-20T11:59:23.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56420 6.80 MB/sec execute 318 sec latency 235.023 ms 2020-11-20T11:59:24.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56563 6.81 MB/sec execute 319 sec latency 164.130 ms 2020-11-20T11:59:25.889 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56708 6.82 MB/sec execute 320 sec latency 147.285 ms 2020-11-20T11:59:26.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56848 6.83 MB/sec execute 321 sec latency 116.555 ms 2020-11-20T11:59:27.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 56959 6.83 MB/sec execute 322 sec latency 185.567 ms 2020-11-20T11:59:28.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57054 6.83 MB/sec execute 323 sec latency 167.951 ms 2020-11-20T11:59:29.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57201 6.83 MB/sec execute 324 sec latency 186.242 ms 2020-11-20T11:59:30.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57304 6.83 MB/sec execute 325 sec latency 195.407 ms 2020-11-20T11:59:31.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57406 6.84 MB/sec execute 326 sec latency 142.998 ms 2020-11-20T11:59:32.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57492 6.82 MB/sec execute 327 sec latency 178.781 ms 2020-11-20T11:59:33.886 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57574 6.82 MB/sec execute 328 sec latency 223.363 ms 2020-11-20T11:59:34.888 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57694 6.82 MB/sec execute 329 sec latency 154.801 ms 2020-11-20T11:59:35.892 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57781 6.81 MB/sec execute 330 sec latency 125.335 ms 2020-11-20T11:59:36.894 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57903 6.80 MB/sec execute 331 sec latency 121.311 ms 2020-11-20T11:59:37.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 57983 6.78 MB/sec execute 332 sec latency 212.138 ms 2020-11-20T11:59:38.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58090 6.77 MB/sec execute 333 sec latency 155.864 ms 2020-11-20T11:59:39.892 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58194 6.77 MB/sec execute 334 sec latency 182.653 ms 2020-11-20T11:59:40.892 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58283 6.76 MB/sec execute 335 sec latency 185.849 ms 2020-11-20T11:59:41.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58343 6.75 MB/sec execute 336 sec latency 276.996 ms 2020-11-20T11:59:42.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58435 6.74 MB/sec execute 337 sec latency 221.590 ms 2020-11-20T11:59:43.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58537 6.74 MB/sec execute 338 sec latency 224.961 ms 2020-11-20T11:59:44.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58646 6.74 MB/sec execute 339 sec latency 243.404 ms 2020-11-20T11:59:45.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58749 6.73 MB/sec execute 340 sec latency 287.449 ms 2020-11-20T11:59:46.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58855 6.72 MB/sec execute 341 sec latency 284.457 ms 2020-11-20T11:59:47.897 INFO:tasks.workunit.client.0.smithi161.stdout: 10 58953 6.72 MB/sec execute 342 sec latency 349.774 ms 2020-11-20T11:59:48.893 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59078 6.72 MB/sec execute 343 sec latency 146.475 ms 2020-11-20T11:59:49.896 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59180 6.73 MB/sec execute 344 sec latency 340.167 ms 2020-11-20T11:59:50.896 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59296 6.73 MB/sec execute 345 sec latency 280.569 ms 2020-11-20T11:59:51.896 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59397 6.72 MB/sec execute 346 sec latency 338.057 ms 2020-11-20T11:59:52.897 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59458 6.70 MB/sec execute 347 sec latency 546.808 ms 2020-11-20T11:59:53.897 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59530 6.69 MB/sec execute 348 sec latency 317.799 ms 2020-11-20T11:59:54.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59671 6.69 MB/sec execute 349 sec latency 259.287 ms 2020-11-20T11:59:55.897 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.69 MB/sec execute 350 sec latency 208.290 ms 2020-11-20T11:59:56.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.67 MB/sec execute 351 sec latency 1208.346 ms 2020-11-20T11:59:57.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.65 MB/sec execute 352 sec latency 2208.428 ms 2020-11-20T11:59:58.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.63 MB/sec execute 353 sec latency 3208.483 ms 2020-11-20T11:59:59.901 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.61 MB/sec execute 354 sec latency 4208.602 ms 2020-11-20T12:00:00.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.59 MB/sec execute 355 sec latency 5208.717 ms 2020-11-20T12:00:01.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59786 6.58 MB/sec execute 356 sec latency 6208.794 ms 2020-11-20T12:00:02.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59808 6.56 MB/sec execute 357 sec latency 7063.463 ms 2020-11-20T12:00:03.910 INFO:tasks.workunit.client.0.smithi161.stdout: 10 59949 6.57 MB/sec execute 358 sec latency 214.209 ms 2020-11-20T12:00:04.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60065 6.57 MB/sec execute 359 sec latency 215.625 ms 2020-11-20T12:00:05.900 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60234 6.59 MB/sec execute 360 sec latency 79.016 ms 2020-11-20T12:00:06.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60397 6.61 MB/sec execute 361 sec latency 112.946 ms 2020-11-20T12:00:07.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60552 6.61 MB/sec execute 362 sec latency 102.125 ms 2020-11-20T12:00:08.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60669 6.61 MB/sec execute 363 sec latency 274.941 ms 2020-11-20T12:00:09.900 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60787 6.61 MB/sec execute 364 sec latency 116.076 ms 2020-11-20T12:00:10.899 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60903 6.62 MB/sec execute 365 sec latency 110.421 ms 2020-11-20T12:00:11.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 60992 6.62 MB/sec execute 366 sec latency 125.053 ms 2020-11-20T12:00:12.898 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61078 6.61 MB/sec execute 367 sec latency 166.389 ms 2020-11-20T12:00:13.899 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61147 6.61 MB/sec execute 368 sec latency 301.233 ms 2020-11-20T12:00:14.899 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61250 6.60 MB/sec execute 369 sec latency 111.308 ms 2020-11-20T12:00:15.899 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61369 6.59 MB/sec execute 370 sec latency 117.601 ms 2020-11-20T12:00:16.899 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61456 6.58 MB/sec execute 371 sec latency 146.913 ms 2020-11-20T12:00:17.901 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61546 6.56 MB/sec execute 372 sec latency 161.675 ms 2020-11-20T12:00:18.901 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61665 6.56 MB/sec execute 373 sec latency 201.509 ms 2020-11-20T12:00:19.906 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61753 6.56 MB/sec execute 374 sec latency 177.866 ms 2020-11-20T12:00:20.906 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61846 6.55 MB/sec execute 375 sec latency 216.387 ms 2020-11-20T12:00:21.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 61921 6.54 MB/sec execute 376 sec latency 251.457 ms 2020-11-20T12:00:22.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62030 6.53 MB/sec execute 377 sec latency 129.504 ms 2020-11-20T12:00:23.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62137 6.53 MB/sec execute 378 sec latency 233.849 ms 2020-11-20T12:00:24.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62252 6.54 MB/sec execute 379 sec latency 231.686 ms 2020-11-20T12:00:25.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62355 6.54 MB/sec execute 380 sec latency 319.415 ms 2020-11-20T12:00:26.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62501 6.54 MB/sec execute 381 sec latency 120.860 ms 2020-11-20T12:00:27.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62653 6.55 MB/sec execute 382 sec latency 117.840 ms 2020-11-20T12:00:28.915 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62781 6.56 MB/sec execute 383 sec latency 116.065 ms 2020-11-20T12:00:29.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 62892 6.55 MB/sec execute 384 sec latency 259.920 ms 2020-11-20T12:00:30.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63017 6.54 MB/sec execute 385 sec latency 155.613 ms 2020-11-20T12:00:31.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63163 6.54 MB/sec execute 386 sec latency 103.123 ms 2020-11-20T12:00:32.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63292 6.53 MB/sec execute 387 sec latency 121.077 ms 2020-11-20T12:00:33.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63433 6.54 MB/sec execute 388 sec latency 248.931 ms 2020-11-20T12:00:34.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63544 6.55 MB/sec execute 389 sec latency 236.180 ms 2020-11-20T12:00:35.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63662 6.54 MB/sec execute 390 sec latency 618.129 ms 2020-11-20T12:00:36.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63811 6.55 MB/sec execute 391 sec latency 146.922 ms 2020-11-20T12:00:37.911 INFO:tasks.workunit.client.0.smithi161.stdout: 10 63980 6.57 MB/sec execute 392 sec latency 164.440 ms 2020-11-20T12:00:38.913 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64096 6.57 MB/sec execute 393 sec latency 200.345 ms 2020-11-20T12:00:39.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64206 6.57 MB/sec execute 394 sec latency 206.815 ms 2020-11-20T12:00:40.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64328 6.57 MB/sec execute 395 sec latency 164.541 ms 2020-11-20T12:00:41.913 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64444 6.59 MB/sec execute 396 sec latency 147.586 ms 2020-11-20T12:00:42.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64536 6.58 MB/sec execute 397 sec latency 149.673 ms 2020-11-20T12:00:43.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64622 6.58 MB/sec execute 398 sec latency 389.288 ms 2020-11-20T12:00:44.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64717 6.58 MB/sec execute 399 sec latency 197.667 ms 2020-11-20T12:00:45.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64810 6.57 MB/sec execute 400 sec latency 145.935 ms 2020-11-20T12:00:46.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64903 6.56 MB/sec execute 401 sec latency 165.301 ms 2020-11-20T12:00:47.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 64967 6.55 MB/sec execute 402 sec latency 321.808 ms 2020-11-20T12:00:48.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65074 6.54 MB/sec execute 403 sec latency 143.011 ms 2020-11-20T12:00:49.912 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65146 6.53 MB/sec execute 404 sec latency 211.923 ms 2020-11-20T12:00:50.920 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65251 6.53 MB/sec execute 405 sec latency 211.025 ms 2020-11-20T12:00:51.920 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65345 6.52 MB/sec execute 406 sec latency 101.563 ms 2020-11-20T12:00:52.920 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65429 6.51 MB/sec execute 407 sec latency 175.886 ms 2020-11-20T12:00:53.920 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65526 6.51 MB/sec execute 408 sec latency 400.211 ms 2020-11-20T12:00:54.920 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65621 6.50 MB/sec execute 409 sec latency 242.991 ms 2020-11-20T12:00:55.924 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65748 6.50 MB/sec execute 410 sec latency 172.712 ms 2020-11-20T12:00:56.924 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65872 6.51 MB/sec execute 411 sec latency 159.091 ms 2020-11-20T12:00:57.928 INFO:tasks.workunit.client.0.smithi161.stdout: 10 65992 6.51 MB/sec execute 412 sec latency 274.101 ms 2020-11-20T12:00:58.928 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66109 6.51 MB/sec execute 413 sec latency 300.494 ms 2020-11-20T12:00:59.930 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66228 6.51 MB/sec execute 414 sec latency 213.529 ms 2020-11-20T12:01:00.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66334 6.52 MB/sec execute 415 sec latency 253.141 ms 2020-11-20T12:01:01.930 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66437 6.51 MB/sec execute 416 sec latency 273.162 ms 2020-11-20T12:01:02.930 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66542 6.50 MB/sec execute 417 sec latency 303.484 ms 2020-11-20T12:01:03.930 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66580 6.49 MB/sec execute 418 sec latency 458.713 ms 2020-11-20T12:01:04.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66699 6.48 MB/sec execute 419 sec latency 148.885 ms 2020-11-20T12:01:05.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66805 6.47 MB/sec execute 420 sec latency 277.159 ms 2020-11-20T12:01:06.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66885 6.46 MB/sec execute 421 sec latency 684.079 ms 2020-11-20T12:01:07.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 66974 6.46 MB/sec execute 422 sec latency 415.342 ms 2020-11-20T12:01:08.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67048 6.46 MB/sec execute 423 sec latency 417.258 ms 2020-11-20T12:01:09.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67121 6.46 MB/sec execute 424 sec latency 297.702 ms 2020-11-20T12:01:10.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67172 6.45 MB/sec execute 425 sec latency 283.278 ms 2020-11-20T12:01:11.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67241 6.44 MB/sec execute 426 sec latency 390.557 ms 2020-11-20T12:01:12.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67344 6.44 MB/sec execute 427 sec latency 276.888 ms 2020-11-20T12:01:13.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67374 6.43 MB/sec execute 428 sec latency 756.580 ms 2020-11-20T12:01:14.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67505 6.45 MB/sec execute 429 sec latency 805.361 ms 2020-11-20T12:01:15.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67611 6.45 MB/sec execute 430 sec latency 317.305 ms 2020-11-20T12:01:16.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67682 6.44 MB/sec execute 431 sec latency 407.998 ms 2020-11-20T12:01:17.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67778 6.43 MB/sec execute 432 sec latency 408.710 ms 2020-11-20T12:01:18.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67865 6.43 MB/sec execute 433 sec latency 244.033 ms 2020-11-20T12:01:19.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 67946 6.43 MB/sec execute 434 sec latency 190.678 ms 2020-11-20T12:01:20.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68048 6.44 MB/sec execute 435 sec latency 183.831 ms 2020-11-20T12:01:21.931 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68115 6.43 MB/sec execute 436 sec latency 248.082 ms 2020-11-20T12:01:22.933 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68192 6.43 MB/sec execute 437 sec latency 283.143 ms 2020-11-20T12:01:23.934 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68226 6.42 MB/sec execute 438 sec latency 474.849 ms 2020-11-20T12:01:24.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68304 6.42 MB/sec execute 439 sec latency 310.484 ms 2020-11-20T12:01:25.933 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68367 6.41 MB/sec execute 440 sec latency 360.889 ms 2020-11-20T12:01:26.932 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68476 6.40 MB/sec execute 441 sec latency 132.821 ms 2020-11-20T12:01:27.936 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68558 6.39 MB/sec execute 442 sec latency 224.001 ms 2020-11-20T12:01:28.936 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68668 6.39 MB/sec execute 443 sec latency 379.499 ms 2020-11-20T12:01:29.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68757 6.38 MB/sec execute 444 sec latency 201.892 ms 2020-11-20T12:01:30.938 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68820 6.37 MB/sec execute 445 sec latency 371.942 ms 2020-11-20T12:01:31.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 68919 6.36 MB/sec execute 446 sec latency 128.722 ms 2020-11-20T12:01:32.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69036 6.36 MB/sec execute 447 sec latency 124.870 ms 2020-11-20T12:01:33.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69099 6.35 MB/sec execute 448 sec latency 304.022 ms 2020-11-20T12:01:34.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69237 6.36 MB/sec execute 449 sec latency 126.636 ms 2020-11-20T12:01:35.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69363 6.36 MB/sec execute 450 sec latency 117.589 ms 2020-11-20T12:01:36.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69465 6.35 MB/sec execute 451 sec latency 191.095 ms 2020-11-20T12:01:37.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69602 6.36 MB/sec execute 452 sec latency 115.333 ms 2020-11-20T12:01:38.937 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69733 6.36 MB/sec execute 453 sec latency 132.504 ms 2020-11-20T12:01:39.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 69897 6.38 MB/sec execute 454 sec latency 129.755 ms 2020-11-20T12:01:40.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70032 6.38 MB/sec execute 455 sec latency 117.795 ms 2020-11-20T12:01:41.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70117 6.37 MB/sec execute 456 sec latency 213.264 ms 2020-11-20T12:01:42.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70246 6.37 MB/sec execute 457 sec latency 155.279 ms 2020-11-20T12:01:43.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70348 6.36 MB/sec execute 458 sec latency 281.147 ms 2020-11-20T12:01:44.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70492 6.36 MB/sec execute 459 sec latency 171.193 ms 2020-11-20T12:01:45.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70600 6.36 MB/sec execute 460 sec latency 230.643 ms 2020-11-20T12:01:46.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70633 6.35 MB/sec execute 461 sec latency 1197.925 ms 2020-11-20T12:01:47.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70680 6.34 MB/sec execute 462 sec latency 1999.789 ms 2020-11-20T12:01:48.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70774 6.34 MB/sec execute 463 sec latency 266.740 ms 2020-11-20T12:01:49.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70839 6.33 MB/sec execute 464 sec latency 269.604 ms 2020-11-20T12:01:50.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 70925 6.33 MB/sec execute 465 sec latency 193.924 ms 2020-11-20T12:01:51.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71030 6.33 MB/sec execute 466 sec latency 284.961 ms 2020-11-20T12:01:52.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71153 6.34 MB/sec execute 467 sec latency 250.714 ms 2020-11-20T12:01:53.942 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71307 6.35 MB/sec execute 468 sec latency 173.238 ms 2020-11-20T12:01:54.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71442 6.34 MB/sec execute 469 sec latency 103.552 ms 2020-11-20T12:01:55.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71587 6.36 MB/sec execute 470 sec latency 139.328 ms 2020-11-20T12:01:56.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71686 6.36 MB/sec execute 471 sec latency 309.274 ms 2020-11-20T12:01:57.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71814 6.37 MB/sec execute 472 sec latency 88.804 ms 2020-11-20T12:01:58.943 INFO:tasks.workunit.client.0.smithi161.stdout: 10 71917 6.36 MB/sec execute 473 sec latency 115.621 ms 2020-11-20T12:01:59.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72053 6.36 MB/sec execute 474 sec latency 185.962 ms 2020-11-20T12:02:00.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72129 6.35 MB/sec execute 475 sec latency 209.052 ms 2020-11-20T12:02:01.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72207 6.34 MB/sec execute 476 sec latency 282.197 ms 2020-11-20T12:02:02.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72286 6.34 MB/sec execute 477 sec latency 336.276 ms 2020-11-20T12:02:03.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72310 6.33 MB/sec execute 478 sec latency 603.310 ms 2020-11-20T12:02:04.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72366 6.32 MB/sec execute 479 sec latency 466.189 ms 2020-11-20T12:02:05.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72445 6.31 MB/sec execute 480 sec latency 230.997 ms 2020-11-20T12:02:06.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72514 6.30 MB/sec execute 481 sec latency 330.112 ms 2020-11-20T12:02:07.946 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72592 6.30 MB/sec execute 482 sec latency 201.373 ms 2020-11-20T12:02:08.945 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72684 6.30 MB/sec execute 483 sec latency 182.138 ms 2020-11-20T12:02:09.946 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72774 6.29 MB/sec execute 484 sec latency 146.613 ms 2020-11-20T12:02:10.946 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72901 6.30 MB/sec execute 485 sec latency 349.217 ms 2020-11-20T12:02:11.949 INFO:tasks.workunit.client.0.smithi161.stdout: 10 72978 6.30 MB/sec execute 486 sec latency 273.552 ms 2020-11-20T12:02:12.950 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73033 6.29 MB/sec execute 487 sec latency 328.888 ms 2020-11-20T12:02:13.949 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73089 6.28 MB/sec execute 488 sec latency 454.029 ms 2020-11-20T12:02:14.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73205 6.28 MB/sec execute 489 sec latency 340.107 ms 2020-11-20T12:02:15.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73317 6.28 MB/sec execute 490 sec latency 185.733 ms 2020-11-20T12:02:16.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73415 6.27 MB/sec execute 491 sec latency 292.266 ms 2020-11-20T12:02:17.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73532 6.28 MB/sec execute 492 sec latency 169.824 ms 2020-11-20T12:02:18.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73653 6.28 MB/sec execute 493 sec latency 162.368 ms 2020-11-20T12:02:19.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73751 6.28 MB/sec execute 494 sec latency 141.021 ms 2020-11-20T12:02:20.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 73884 6.28 MB/sec execute 495 sec latency 90.740 ms 2020-11-20T12:02:21.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74021 6.27 MB/sec execute 496 sec latency 140.240 ms 2020-11-20T12:02:22.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74173 6.27 MB/sec execute 497 sec latency 131.087 ms 2020-11-20T12:02:23.956 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74316 6.27 MB/sec execute 498 sec latency 222.322 ms 2020-11-20T12:02:24.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74445 6.27 MB/sec execute 499 sec latency 126.562 ms 2020-11-20T12:02:25.953 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74546 6.27 MB/sec execute 500 sec latency 185.564 ms 2020-11-20T12:02:26.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74668 6.28 MB/sec execute 501 sec latency 144.009 ms 2020-11-20T12:02:27.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74739 6.27 MB/sec execute 502 sec latency 312.905 ms 2020-11-20T12:02:28.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74846 6.28 MB/sec execute 503 sec latency 233.292 ms 2020-11-20T12:02:29.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 74924 6.28 MB/sec execute 504 sec latency 307.457 ms 2020-11-20T12:02:30.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75010 6.27 MB/sec execute 505 sec latency 204.311 ms 2020-11-20T12:02:31.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75158 6.28 MB/sec execute 506 sec latency 315.317 ms 2020-11-20T12:02:32.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75262 6.29 MB/sec execute 507 sec latency 185.567 ms 2020-11-20T12:02:33.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75306 6.28 MB/sec execute 508 sec latency 500.984 ms 2020-11-20T12:02:34.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75385 6.27 MB/sec execute 509 sec latency 530.641 ms 2020-11-20T12:02:35.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75486 6.27 MB/sec execute 510 sec latency 327.089 ms 2020-11-20T12:02:36.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75574 6.27 MB/sec execute 511 sec latency 279.529 ms 2020-11-20T12:02:37.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75615 6.26 MB/sec execute 512 sec latency 460.396 ms 2020-11-20T12:02:38.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75704 6.25 MB/sec execute 513 sec latency 218.367 ms 2020-11-20T12:02:39.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75791 6.25 MB/sec execute 514 sec latency 280.370 ms 2020-11-20T12:02:40.956 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75861 6.25 MB/sec execute 515 sec latency 229.597 ms 2020-11-20T12:02:41.955 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75913 6.23 MB/sec execute 516 sec latency 194.836 ms 2020-11-20T12:02:42.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 75996 6.23 MB/sec execute 517 sec latency 274.983 ms 2020-11-20T12:02:43.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76040 6.22 MB/sec execute 518 sec latency 404.154 ms 2020-11-20T12:02:44.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76126 6.22 MB/sec execute 519 sec latency 252.923 ms 2020-11-20T12:02:45.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76218 6.22 MB/sec execute 520 sec latency 223.099 ms 2020-11-20T12:02:46.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76279 6.21 MB/sec execute 521 sec latency 306.298 ms 2020-11-20T12:02:47.954 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76351 6.21 MB/sec execute 522 sec latency 245.498 ms 2020-11-20T12:02:48.955 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76447 6.20 MB/sec execute 523 sec latency 275.707 ms 2020-11-20T12:02:49.955 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76520 6.20 MB/sec execute 524 sec latency 274.090 ms 2020-11-20T12:02:50.955 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76594 6.19 MB/sec execute 525 sec latency 253.111 ms 2020-11-20T12:02:51.955 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76696 6.20 MB/sec execute 526 sec latency 190.763 ms 2020-11-20T12:02:52.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76788 6.19 MB/sec execute 527 sec latency 388.972 ms 2020-11-20T12:02:53.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76822 6.18 MB/sec execute 528 sec latency 529.986 ms 2020-11-20T12:02:54.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76909 6.18 MB/sec execute 529 sec latency 276.969 ms 2020-11-20T12:02:55.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 76991 6.17 MB/sec execute 530 sec latency 359.861 ms 2020-11-20T12:02:56.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77119 6.18 MB/sec execute 531 sec latency 128.246 ms 2020-11-20T12:02:57.959 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77208 6.18 MB/sec execute 532 sec latency 354.968 ms 2020-11-20T12:02:58.958 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77329 6.19 MB/sec execute 533 sec latency 204.943 ms 2020-11-20T12:02:59.959 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77405 6.18 MB/sec execute 534 sec latency 348.650 ms 2020-11-20T12:03:00.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77529 6.18 MB/sec execute 535 sec latency 254.772 ms 2020-11-20T12:03:01.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77657 6.17 MB/sec execute 536 sec latency 145.146 ms 2020-11-20T12:03:02.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77756 6.17 MB/sec execute 537 sec latency 303.747 ms 2020-11-20T12:03:03.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77826 6.16 MB/sec execute 538 sec latency 342.060 ms 2020-11-20T12:03:04.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 77937 6.16 MB/sec execute 539 sec latency 232.860 ms 2020-11-20T12:03:05.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78043 6.16 MB/sec execute 540 sec latency 194.139 ms 2020-11-20T12:03:06.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78123 6.15 MB/sec execute 541 sec latency 235.293 ms 2020-11-20T12:03:07.961 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78186 6.14 MB/sec execute 542 sec latency 345.452 ms 2020-11-20T12:03:08.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78265 6.15 MB/sec execute 543 sec latency 394.901 ms 2020-11-20T12:03:09.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78357 6.14 MB/sec execute 544 sec latency 271.252 ms 2020-11-20T12:03:10.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78460 6.15 MB/sec execute 545 sec latency 208.781 ms 2020-11-20T12:03:11.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78584 6.16 MB/sec execute 546 sec latency 222.420 ms 2020-11-20T12:03:12.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78689 6.16 MB/sec execute 547 sec latency 245.642 ms 2020-11-20T12:03:13.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78743 6.15 MB/sec execute 548 sec latency 384.983 ms 2020-11-20T12:03:14.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78833 6.15 MB/sec execute 549 sec latency 266.477 ms 2020-11-20T12:03:15.962 INFO:tasks.workunit.client.0.smithi161.stdout: 10 78957 6.15 MB/sec execute 550 sec latency 308.141 ms 2020-11-20T12:03:16.973 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79033 6.15 MB/sec execute 551 sec latency 330.357 ms 2020-11-20T12:03:17.969 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79158 6.15 MB/sec execute 552 sec latency 181.634 ms 2020-11-20T12:03:18.969 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79253 6.15 MB/sec execute 553 sec latency 181.430 ms 2020-11-20T12:03:19.969 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79335 6.15 MB/sec execute 554 sec latency 203.818 ms 2020-11-20T12:03:20.969 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79414 6.14 MB/sec execute 555 sec latency 187.547 ms 2020-11-20T12:03:21.973 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79499 6.14 MB/sec execute 556 sec latency 170.710 ms 2020-11-20T12:03:22.973 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79568 6.13 MB/sec execute 557 sec latency 313.611 ms 2020-11-20T12:03:23.973 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79642 6.13 MB/sec execute 558 sec latency 452.390 ms 2020-11-20T12:03:24.973 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79766 6.13 MB/sec execute 559 sec latency 117.013 ms 2020-11-20T12:03:25.977 INFO:tasks.workunit.client.0.smithi161.stdout: 10 79905 6.13 MB/sec execute 560 sec latency 115.255 ms 2020-11-20T12:03:26.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80010 6.12 MB/sec execute 561 sec latency 163.682 ms 2020-11-20T12:03:27.977 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80111 6.13 MB/sec execute 562 sec latency 257.449 ms 2020-11-20T12:03:28.977 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80202 6.12 MB/sec execute 563 sec latency 367.155 ms 2020-11-20T12:03:29.977 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80329 6.12 MB/sec execute 564 sec latency 145.724 ms 2020-11-20T12:03:30.977 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80435 6.12 MB/sec execute 565 sec latency 173.728 ms 2020-11-20T12:03:31.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80547 6.12 MB/sec execute 566 sec latency 129.752 ms 2020-11-20T12:03:32.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80636 6.12 MB/sec execute 567 sec latency 208.677 ms 2020-11-20T12:03:33.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80694 6.12 MB/sec execute 568 sec latency 489.144 ms 2020-11-20T12:03:34.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80783 6.12 MB/sec execute 569 sec latency 238.207 ms 2020-11-20T12:03:35.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80864 6.12 MB/sec execute 570 sec latency 281.253 ms 2020-11-20T12:03:36.985 INFO:tasks.workunit.client.0.smithi161.stdout: 10 80984 6.12 MB/sec execute 571 sec latency 287.688 ms 2020-11-20T12:03:37.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81068 6.11 MB/sec execute 572 sec latency 258.662 ms 2020-11-20T12:03:38.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81165 6.11 MB/sec execute 573 sec latency 264.249 ms 2020-11-20T12:03:39.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81293 6.11 MB/sec execute 574 sec latency 157.257 ms 2020-11-20T12:03:40.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81388 6.10 MB/sec execute 575 sec latency 339.556 ms 2020-11-20T12:03:41.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81479 6.09 MB/sec execute 576 sec latency 195.402 ms 2020-11-20T12:03:42.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81571 6.09 MB/sec execute 577 sec latency 270.168 ms 2020-11-20T12:03:43.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81612 6.09 MB/sec execute 578 sec latency 685.980 ms 2020-11-20T12:03:44.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81681 6.08 MB/sec execute 579 sec latency 253.206 ms 2020-11-20T12:03:45.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81772 6.08 MB/sec execute 580 sec latency 226.394 ms 2020-11-20T12:03:46.979 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81873 6.08 MB/sec execute 581 sec latency 186.261 ms 2020-11-20T12:03:47.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 81969 6.08 MB/sec execute 582 sec latency 267.968 ms 2020-11-20T12:03:48.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82080 6.09 MB/sec execute 583 sec latency 228.545 ms 2020-11-20T12:03:49.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82156 6.08 MB/sec execute 584 sec latency 226.864 ms 2020-11-20T12:03:50.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82279 6.09 MB/sec execute 585 sec latency 240.509 ms 2020-11-20T12:03:51.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82399 6.09 MB/sec execute 586 sec latency 229.771 ms 2020-11-20T12:03:52.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82450 6.08 MB/sec execute 587 sec latency 278.842 ms 2020-11-20T12:03:53.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82491 6.08 MB/sec execute 588 sec latency 503.789 ms 2020-11-20T12:03:54.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82602 6.08 MB/sec execute 589 sec latency 288.262 ms 2020-11-20T12:03:55.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82660 6.07 MB/sec execute 590 sec latency 554.203 ms 2020-11-20T12:03:56.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82725 6.07 MB/sec execute 591 sec latency 508.280 ms 2020-11-20T12:03:57.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82813 6.07 MB/sec execute 592 sec latency 219.051 ms 2020-11-20T12:03:58.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82868 6.06 MB/sec execute 593 sec latency 300.092 ms 2020-11-20T12:03:59.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 82933 6.06 MB/sec execute 594 sec latency 259.288 ms 2020-11-20T12:04:00.980 INFO:tasks.workunit.client.0.smithi161.stdout: 10 83005 6.05 MB/sec execute 595 sec latency 234.390 ms 2020-11-20T12:04:01.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 83092 6.05 MB/sec execute 596 sec latency 185.754 ms 2020-11-20T12:04:02.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 83213 6.05 MB/sec execute 597 sec latency 268.433 ms 2020-11-20T12:04:03.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 83324 6.05 MB/sec execute 598 sec latency 120.012 ms 2020-11-20T12:04:04.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 83452 6.05 MB/sec execute 599 sec latency 145.779 ms 2020-11-20T12:04:05.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 cleanup 600 sec 2020-11-20T12:04:06.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 cleanup 601 sec 2020-11-20T12:04:07.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 cleanup 602 sec 2020-11-20T12:04:08.981 INFO:tasks.workunit.client.0.smithi161.stdout: 10 cleanup 603 sec 2020-11-20T12:04:09.981 INFO:tasks.workunit.client.0.smithi161.stdout: 1 cleanup 604 sec 2020-11-20T12:04:10.082 INFO:tasks.workunit.client.0.smithi161.stdout: 0 cleanup 604 sec 2020-11-20T12:04:10.083 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T12:04:10.083 INFO:tasks.workunit.client.0.smithi161.stdout: Operation Count AvgLat MaxLat 2020-11-20T12:04:10.083 INFO:tasks.workunit.client.0.smithi161.stdout: ---------------------------------------- 2020-11-20T12:04:10.083 INFO:tasks.workunit.client.0.smithi161.stdout: NTCreateX 115670 19.875 7063.456 2020-11-20T12:04:10.083 INFO:tasks.workunit.client.0.smithi161.stdout: Close 84811 0.307 153.129 2020-11-20T12:04:10.084 INFO:tasks.workunit.client.0.smithi161.stdout: Rename 4917 73.472 7050.594 2020-11-20T12:04:10.084 INFO:tasks.workunit.client.0.smithi161.stdout: Unlink 23507 14.780 345.169 2020-11-20T12:04:10.084 INFO:tasks.workunit.client.0.smithi161.stdout: Qpathinfo 104737 16.820 6912.299 2020-11-20T12:04:10.084 INFO:tasks.workunit.client.0.smithi161.stdout: Qfileinfo 18282 0.488 203.700 2020-11-20T12:04:10.084 INFO:tasks.workunit.client.0.smithi161.stdout: Qfsinfo 19374 2.796 1999.776 2020-11-20T12:04:10.085 INFO:tasks.workunit.client.0.smithi161.stdout: Sfileinfo 9372 6.996 536.869 2020-11-20T12:04:10.085 INFO:tasks.workunit.client.0.smithi161.stdout: Find 40614 8.475 2027.379 2020-11-20T12:04:10.085 INFO:tasks.workunit.client.0.smithi161.stdout: WriteX 57131 2.230 6854.700 2020-11-20T12:04:10.085 INFO:tasks.workunit.client.0.smithi161.stdout: ReadX 182908 0.010 261.664 2020-11-20T12:04:10.085 INFO:tasks.workunit.client.0.smithi161.stdout: LockX 386 6.453 163.222 2020-11-20T12:04:10.086 INFO:tasks.workunit.client.0.smithi161.stdout: UnlockX 386 4.997 29.566 2020-11-20T12:04:10.086 INFO:tasks.workunit.client.0.smithi161.stdout: Flush 8074 73.976 1187.889 2020-11-20T12:04:10.086 INFO:tasks.workunit.client.0.smithi161.stdout: 2020-11-20T12:04:10.086 INFO:tasks.workunit.client.0.smithi161.stdout:Throughput 6.05138 MB/sec 10 clients 10 procs max_latency=7063.463 ms 2020-11-20T12:04:10.223 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T12:04:10.224 INFO:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T12:04:17.705 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2020-11-20T12:04:17.706 INFO:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T12:04:18.245 DEBUG:teuthology.parallel:result is None 2020-11-20T12:04:18.247 INFO:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:04:18.267 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:04:18.268 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-11-20T12:04:18.276 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2020-11-20T12:04:18.276 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2020-11-20T12:04:18.277 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T12:04:18.277 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:04:19.471 INFO:teuthology.orchestra.run:waiting for 900 2020-11-20T12:04:19.473 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[18759]: fuse finished with error 0 and tester_r 0 2020-11-20T12:04:25.572 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T12:04:25.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:04:25.573 INFO:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:04:26.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:04:26.376 INFO:teuthology.orchestra.run.smithi161:> ip netns list 2020-11-20T12:04:26.540 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T12:04:26.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:04:26.542 INFO:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:04:26.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:04:26.577 INFO:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2020-11-20T12:04:26.687 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T12:04:26.697 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T12:04:26.698 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:04:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.066+0000 7fbc01e40700 1 Processor -- start 2020-11-20T12:04:35.077 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.066+0000 7fbc01e40700 1 -- start start 2020-11-20T12:04:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 0x7fbbf80c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 0x7fbbf80c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf803a110 con 0x7fbbf8008090 2020-11-20T12:04:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf803bc90 con 0x7fbbf8038220 2020-11-20T12:04:35.084 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf8039f00 con 0x7fbbf8006a70 2020-11-20T12:04:35.084 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc00e3e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 0x7fbbf80c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.084 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 0x7fbbf80c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.084 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc038a3700 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fbbf8008090 0x7fbbf80c2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.161:47262/0 (socket says 172.21.15.161:47262) 2020-11-20T12:04:35.085 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc038a3700 1 -- 172.21.15.161:0/291874143 learned_addr learned my addr 172.21.15.161:0/291874143 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:35.085 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 -- 172.21.15.161:0/291874143 >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 msgr2=0x7fbbf80c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.085 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 --2- 172.21.15.161:0/291874143 >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 0x7fbbf80c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.085 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 -- 172.21.15.161:0/291874143 >> v1:172.21.15.186:6789/0 conn(0x7fbbf8008090 legacy=0x7fbbf80c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.085 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 -- 172.21.15.161:0/291874143 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8006f80 con 0x7fbbf8006a70 2020-11-20T12:04:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc00e3e700 1 --2- 172.21.15.161:0/291874143 >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 0x7fbbf80c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc02641700 1 --2- 172.21.15.161:0/291874143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 0x7fbbf80c8e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbbf4009cc0 tx=0x7fbbf4009220).ready entity=mon.2 client_cookie=c2fc27e5e5515155 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbbf3fff700 1 -- 172.21.15.161:0/291874143 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400bad0 con 0x7fbbf8006a70 2020-11-20T12:04:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbbf3fff700 1 -- 172.21.15.161:0/291874143 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400bc30 con 0x7fbbf8006a70 2020-11-20T12:04:35.086 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbbf3fff700 1 -- 172.21.15.161:0/291874143 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4011400 con 0x7fbbf8006a70 2020-11-20T12:04:35.087 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- 172.21.15.161:0/291874143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 msgr2=0x7fbbf80c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.087 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 --2- 172.21.15.161:0/291874143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 0x7fbbf80c8e80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbbf4009cc0 tx=0x7fbbf4009220).stop 2020-11-20T12:04:35.087 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- 172.21.15.161:0/291874143 shutdown_connections 2020-11-20T12:04:35.087 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 --2- 172.21.15.161:0/291874143 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8006a70 0x7fbbf80c8e80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.088 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 --2- 172.21.15.161:0/291874143 >> v2:172.21.15.186:3300/0 conn(0x7fbbf8038220 0x7fbbf80c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.088 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- 172.21.15.161:0/291874143 >> 172.21.15.161:0/291874143 conn(0x7fbbf800cee0 msgr2=0x7fbbf80077e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:35.088 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- 172.21.15.161:0/291874143 shutdown_connections 2020-11-20T12:04:35.088 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.070+0000 7fbc01e40700 1 -- 172.21.15.161:0/291874143 wait complete. 2020-11-20T12:04:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 Processor -- start 2020-11-20T12:04:35.090 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 -- start start 2020-11-20T12:04:35.091 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.091 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8008090 0x7fbbf80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.091 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf8038220 0x7fbbf80d7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.091 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80ca7b0 con 0x7fbbf8006a70 2020-11-20T12:04:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80ca510 con 0x7fbbf8038220 2020-11-20T12:04:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc01e40700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80d7b30 con 0x7fbbf8008090 2020-11-20T12:04:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37512/0 (socket says 172.21.15.161:37512) 2020-11-20T12:04:35.092 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 -- 172.21.15.161:0/608682117 learned_addr learned my addr 172.21.15.161:0/608682117 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:35.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc00e3e700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8008090 0x7fbbf80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc02641700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf8038220 0x7fbbf80d7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 -- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8008090 msgr2=0x7fbbf80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8008090 0x7fbbf80c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.093 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 -- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf8038220 msgr2=0x7fbbf80d7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.094 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf8038220 0x7fbbf80d7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.094 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 -- 172.21.15.161:0/608682117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80cf0e0 con 0x7fbbf8006a70 2020-11-20T12:04:35.094 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbc038a3700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbbfc026ed0 tx=0x7fbbfc05d9c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.094 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.074+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc0687f0 con 0x7fbbf8006a70 2020-11-20T12:04:35.094 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc068a30 con 0x7fbbf8006a70 2020-11-20T12:04:35.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80ca080 con 0x7fbbf8006a70 2020-11-20T12:04:35.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc068df0 con 0x7fbbf8006a70 2020-11-20T12:04:35.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80d86e0 con 0x7fbbf8006a70 2020-11-20T12:04:35.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf80d8930 con 0x7fbbf8006a70 2020-11-20T12:04:35.095 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fbbfc0691a0 con 0x7fbbf8006a70 2020-11-20T12:04:35.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbbf17fa700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 0x7fbbd4057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbbfc0df490 con 0x7fbbf8006a70 2020-11-20T12:04:35.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbc00e3e700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 0x7fbbd4057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.096 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.078+0000 7fbc00e3e700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 0x7fbbd4057c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbbf80cebe0 tx=0x7fbbec008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.097 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.086+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbbfc0b51b0 con 0x7fbbf8006a70 2020-11-20T12:04:35.256 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.246+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbf80055a0 con 0x7fbbf8006a70 2020-11-20T12:04:35.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbbf17fa700 1 -- 172.21.15.161:0/608682117 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7fbbfc0b87d0 con 0x7fbbf8006a70 2020-11-20T12:04:35.259 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T12:04:35.259 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:04:35.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 msgr2=0x7fbbd4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 0x7fbbd4057c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fbbf80cebe0 tx=0x7fbbec008040).stop 2020-11-20T12:04:35.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 msgr2=0x7fbbf80cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbbfc026ed0 tx=0x7fbbfc05d9c0).stop 2020-11-20T12:04:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 shutdown_connections 2020-11-20T12:04:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbbd40557c0 0x7fbbd4057c80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbbf8038220 0x7fbbf80d7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbf8006a70 0x7fbbf80cad20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 --2- 172.21.15.161:0/608682117 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbbf8008090 0x7fbbf80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 >> 172.21.15.161:0/608682117 conn(0x7fbbf800cee0 msgr2=0x7fbbf80077e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 shutdown_connections 2020-11-20T12:04:35.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.250+0000 7fbc01e40700 1 -- 172.21.15.161:0/608682117 wait complete. 2020-11-20T12:04:35.280 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:04:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 Processor -- start 2020-11-20T12:04:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 -- start start 2020-11-20T12:04:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0eb013e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0eb00a9200 0x7f0eb013e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb00a96a0 con 0x7f0eb00b1b00 2020-11-20T12:04:35.549 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00a9940 con 0x7f0eb00a9200 2020-11-20T12:04:35.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eb4b35700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00aaea0 con 0x7f0eb00b1ee0 2020-11-20T12:04:35.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eae59c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0eb00b1b00 0x7f0eb00ab340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47762/0 (socket says 172.21.15.161:47762) 2020-11-20T12:04:35.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eae59c700 1 -- 172.21.15.161:0/749033876 learned_addr learned my addr 172.21.15.161:0/749033876 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:35.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0eb013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.550 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/749033876 >> v2:172.21.15.186:3300/0 conn(0x7f0eb00a9200 0x7f0eb013e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432733423 0 0) 0x7f0eb00a96a0 con 0x7f0eb00b1b00 2020-11-20T12:04:35.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e94003240 con 0x7f0eb00b1b00 2020-11-20T12:04:35.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1556156842 0 0) 0x7f0e94003240 con 0x7f0eb00b1b00 2020-11-20T12:04:35.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 msgr2=0x7f0eb013e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.551 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0eb013e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 >> v2:172.21.15.186:3300/0 conn(0x7f0eb00a9200 msgr2=0x7f0eb013e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 --2- 172.21.15.161:0/749033876 >> v2:172.21.15.186:3300/0 conn(0x7f0eb00a9200 0x7f0eb013e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00ad2c0 con 0x7f0eb00b1b00 2020-11-20T12:04:35.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f0ea00014e0 con 0x7f0eb00b1b00 2020-11-20T12:04:35.552 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 >> v1:172.21.15.161:6789/0 conn(0x7f0eb00b1b00 legacy=0x7f0eb00ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e94003730 0x7f0e94003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0e940044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e940049d0 0x7f0e94004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.557 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00a9940 con 0x7f0e940049d0 2020-11-20T12:04:35.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb00aaea0 con 0x7f0e94003730 2020-11-20T12:04:35.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940041d0 con 0x7f0eb00b1ee0 2020-11-20T12:04:35.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e940049d0 0x7f0e94004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.558 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eae59c700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e94003730 0x7f0e94003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0e940044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 -- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 msgr2=0x7f0e940044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0e940044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.559 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 -- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e94003730 msgr2=0x7f0e94003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0e94003730 0x7f0e94003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 -- 172.21.15.161:0/749033876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94003240 con 0x7f0e940049d0 2020-11-20T12:04:35.560 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb00b1ee0 0x7f0e940044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:35.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.538+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e940049d0 0x7f0e94004e50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0ea8009e70 tx=0x7f0ea80091d0).ready entity=mon.0 client_cookie=9dd54a8144ca3b60 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80095c0 con 0x7f0e940049d0 2020-11-20T12:04:35.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800ec40 con 0x7f0e940049d0 2020-11-20T12:04:35.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0ead59a700 1 -- 172.21.15.161:0/749033876 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80123f0 con 0x7f0e940049d0 2020-11-20T12:04:35.561 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- 172.21.15.161:0/749033876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e940049d0 msgr2=0x7f0e94004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/749033876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e940049d0 0x7f0e94004e50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0ea8009e70 tx=0x7f0ea80091d0).stop 2020-11-20T12:04:35.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eaed9d700 1 -- 172.21.15.161:0/749033876 reap_dead start 2020-11-20T12:04:35.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- 172.21.15.161:0/749033876 shutdown_connections 2020-11-20T12:04:35.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- 172.21.15.161:0/749033876 >> 172.21.15.161:0/749033876 conn(0x7f0eb0068310 msgr2=0x7f0eb00b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:35.562 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- 172.21.15.161:0/749033876 shutdown_connections 2020-11-20T12:04:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- 172.21.15.161:0/749033876 wait complete. 2020-11-20T12:04:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 Processor -- start 2020-11-20T12:04:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- start start 2020-11-20T12:04:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.563 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 0x7f0eb013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb013f840 con 0x7f0eb013dc10 2020-11-20T12:04:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb0141d50 con 0x7f0eb00a7930 2020-11-20T12:04:35.564 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eb4b35700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb013eeb0 con 0x7f0eb0141180 2020-11-20T12:04:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eadd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.542+0000 7f0eae59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.565 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37534/0 (socket says 172.21.15.161:37534) 2020-11-20T12:04:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eae59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:43000/0 (socket says 172.21.15.161:43000) 2020-11-20T12:04:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 -- 172.21.15.161:0/4028453274 learned_addr learned my addr 172.21.15.161:0/4028453274 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eaed9d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 0x7f0eb013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 -- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 msgr2=0x7f0eb013bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.566 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 0x7f0eb013bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 -- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 msgr2=0x7f0eb0141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 -- 172.21.15.161:0/4028453274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00a7d10 con 0x7f0eb013dc10 2020-11-20T12:04:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eae59c700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:35.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eaed9d700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 0x7f0eb013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:35.568 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eadd9b700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0ea4006d00 tx=0x7f0ea4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.568 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea400fc80 con 0x7f0eb013dc10 2020-11-20T12:04:35.568 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400fde0 con 0x7f0eb013dc10 2020-11-20T12:04:35.568 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4014650 con 0x7f0eb013dc10 2020-11-20T12:04:35.568 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb013c460 con 0x7f0eb013dc10 2020-11-20T12:04:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb013c960 con 0x7f0eb013dc10 2020-11-20T12:04:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb0141b80 con 0x7f0eb013dc10 2020-11-20T12:04:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f0ea4014a00 con 0x7f0eb013dc10 2020-11-20T12:04:35.569 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.546+0000 7f0e9e7fc700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 0x7f0e84057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.550+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0ea406f490 con 0x7f0eb013dc10 2020-11-20T12:04:35.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.550+0000 7f0eae59c700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 0x7f0e84057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.550+0000 7f0eae59c700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 0x7f0e84057c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0ea0001610 tx=0x7f0ea0009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.554+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0ea40451d0 con 0x7f0eb013dc10 2020-11-20T12:04:35.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.702+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0eb013ed30 con 0x7f0e840557c0 2020-11-20T12:04:35.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0e9e7fc700 1 -- 172.21.15.161:0/4028453274 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+106600 (secure 0 0 0) 0x7f0ea0004a50 con 0x7f0e840557c0 2020-11-20T12:04:35.723 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T12:04:35.728 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 msgr2=0x7f0e84057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 0x7f0e84057c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f0ea0001610 tx=0x7f0ea0009040).stop 2020-11-20T12:04:35.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 msgr2=0x7f0eb013f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.729 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0ea4006d00 tx=0x7f0ea4006df0).stop 2020-11-20T12:04:35.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 shutdown_connections 2020-11-20T12:04:35.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f0e840557c0 0x7f0e84057c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0eb0141180 0x7f0eb013bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0eb00a7930 0x7f0eb0141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.730 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 --2- 172.21.15.161:0/4028453274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0eb013dc10 0x7f0eb013f350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 >> 172.21.15.161:0/4028453274 conn(0x7f0eb0068310 msgr2=0x7f0eb0068a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:35.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 shutdown_connections 2020-11-20T12:04:35.731 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.714+0000 7f0eb4b35700 1 -- 172.21.15.161:0/4028453274 wait complete. 2020-11-20T12:04:35.731 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2020-11-20T12:04:35.736 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":794,"stamp":"2020-11-20T12:04:34.929194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240879681,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":175131,"num_write_kb":3344890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158227,"ondisk_log_size":158227,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2557440,"kb_used_data":472512,"kb_used_omap":0,"kb_used_meta":2084864,"kb_avail":752417280,"statfs":{"total":773094113280,"available":770475294720,"internally_reserved":0,"allocated":483852288,"data_stored":482565482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2134900736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1704,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003364"},"pg_stats":[{"pgid":"4.2","version":"24'11613","reported_seq":"11624","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:15.013750+0000","last_change":"2020-11-20T11:38:53.592096+0000","last_active":"2020-11-20T12:04:15.013750+0000","last_peered":"2020-11-20T12:04:15.013750+0000","last_clean":"2020-11-20T12:04:15.013750+0000","last_became_active":"2020-11-20T11:38:53.591457+0000","last_became_peered":"2020-11-20T11:38:53.591457+0000","last_unstale":"2020-11-20T12:04:15.013750+0000","last_undegraded":"2020-11-20T12:04:15.013750+0000","last_fullsized":"2020-11-20T12:04:15.013750+0000","mapping_epoch":22,"log_start":"24'1601","ondisk_log_start":"24'1601","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8925,"num_write_kb":345594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585163+0000","last_change":"2020-11-20T11:38:48.023124+0000","last_active":"2020-11-20T11:38:53.585163+0000","last_peered":"2020-11-20T11:38:53.585163+0000","last_clean":"2020-11-20T11:38:53.585163+0000","last_became_active":"2020-11-20T11:38:48.022698+0000","last_became_peered":"2020-11-20T11:38:48.022698+0000","last_unstale":"2020-11-20T11:38:53.585163+0000","last_undegraded":"2020-11-20T11:38:53.585163+0000","last_fullsized":"2020-11-20T11:38:53.585163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'18652","reported_seq":"18664","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.727423+0000","last_change":"2020-11-20T11:38:50.587036+0000","last_active":"2020-11-20T12:04:19.727423+0000","last_peered":"2020-11-20T12:04:19.727423+0000","last_clean":"2020-11-20T12:04:19.727423+0000","last_became_active":"2020-11-20T11:38:50.586189+0000","last_became_peered":"2020-11-20T11:38:50.586189+0000","last_unstale":"2020-11-20T12:04:19.727423+0000","last_undegraded":"2020-11-20T12:04:19.727423+0000","last_fullsized":"2020-11-20T12:04:19.727423+0000","mapping_epoch":19,"log_start":"24'8600","ondisk_log_start":"24'8600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10052,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748896,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18671,"num_write_kb":107323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"24'12047","reported_seq":"12058","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.982363+0000","last_change":"2020-11-20T11:38:53.598885+0000","last_active":"2020-11-20T12:04:14.982363+0000","last_peered":"2020-11-20T12:04:14.982363+0000","last_clean":"2020-11-20T12:04:14.982363+0000","last_became_active":"2020-11-20T11:38:53.597636+0000","last_became_peered":"2020-11-20T11:38:53.597636+0000","last_unstale":"2020-11-20T12:04:14.982363+0000","last_undegraded":"2020-11-20T12:04:14.982363+0000","last_fullsized":"2020-11-20T12:04:14.982363+0000","mapping_epoch":22,"log_start":"24'2000","ondisk_log_start":"24'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9313,"num_write_kb":332205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582700+0000","last_change":"2020-11-20T11:38:47.415676+0000","last_active":"2020-11-20T11:38:53.582700+0000","last_peered":"2020-11-20T11:38:53.582700+0000","last_clean":"2020-11-20T11:38:53.582700+0000","last_became_active":"2020-11-20T11:38:47.415243+0000","last_became_peered":"2020-11-20T11:38:47.415243+0000","last_unstale":"2020-11-20T11:38:53.582700+0000","last_undegraded":"2020-11-20T11:38:53.582700+0000","last_fullsized":"2020-11-20T11:38:53.582700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'12178","reported_seq":"12190","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.592685+0000","last_change":"2020-11-20T11:38:50.584681+0000","last_active":"2020-11-20T12:04:19.592685+0000","last_peered":"2020-11-20T12:04:19.592685+0000","last_clean":"2020-11-20T12:04:19.592685+0000","last_became_active":"2020-11-20T11:38:50.584020+0000","last_became_peered":"2020-11-20T11:38:50.584020+0000","last_unstale":"2020-11-20T12:04:19.592685+0000","last_undegraded":"2020-11-20T12:04:19.592685+0000","last_fullsized":"2020-11-20T12:04:19.592685+0000","mapping_epoch":19,"log_start":"24'2100","ondisk_log_start":"24'2100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10078,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12185,"num_write_kb":70894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"24'11355","reported_seq":"11366","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.898117+0000","last_change":"2020-11-20T11:38:53.592129+0000","last_active":"2020-11-20T12:04:14.898117+0000","last_peered":"2020-11-20T12:04:14.898117+0000","last_clean":"2020-11-20T12:04:14.898117+0000","last_became_active":"2020-11-20T11:38:53.591694+0000","last_became_peered":"2020-11-20T11:38:53.591694+0000","last_unstale":"2020-11-20T12:04:14.898117+0000","last_undegraded":"2020-11-20T12:04:14.898117+0000","last_fullsized":"2020-11-20T12:04:14.898117+0000","mapping_epoch":22,"log_start":"24'1301","ondisk_log_start":"24'1301","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10054,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":328628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.596154+0000","last_change":"2020-11-20T11:38:47.412146+0000","last_active":"2020-11-20T11:38:53.596154+0000","last_peered":"2020-11-20T11:38:53.596154+0000","last_clean":"2020-11-20T11:38:53.596154+0000","last_became_active":"2020-11-20T11:38:47.411779+0000","last_became_peered":"2020-11-20T11:38:47.411779+0000","last_unstale":"2020-11-20T11:38:53.596154+0000","last_undegraded":"2020-11-20T11:38:53.596154+0000","last_fullsized":"2020-11-20T11:38:53.596154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'14444","reported_seq":"14456","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:22.931108+0000","last_change":"2020-11-20T11:38:51.086358+0000","last_active":"2020-11-20T12:04:22.931108+0000","last_peered":"2020-11-20T12:04:22.931108+0000","last_clean":"2020-11-20T12:04:22.931108+0000","last_became_active":"2020-11-20T11:38:51.085703+0000","last_became_peered":"2020-11-20T11:38:51.085703+0000","last_unstale":"2020-11-20T12:04:22.931108+0000","last_undegraded":"2020-11-20T12:04:22.931108+0000","last_fullsized":"2020-11-20T12:04:22.931108+0000","mapping_epoch":19,"log_start":"24'4400","ondisk_log_start":"24'4400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10044,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35293517,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14475,"num_write_kb":86024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"24'11375","reported_seq":"11386","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.867600+0000","last_change":"2020-11-20T11:38:53.602580+0000","last_active":"2020-11-20T12:04:14.867600+0000","last_peered":"2020-11-20T12:04:14.867600+0000","last_clean":"2020-11-20T12:04:14.867600+0000","last_became_active":"2020-11-20T11:38:53.601406+0000","last_became_peered":"2020-11-20T11:38:53.601406+0000","last_unstale":"2020-11-20T12:04:14.867600+0000","last_undegraded":"2020-11-20T12:04:14.867600+0000","last_fullsized":"2020-11-20T12:04:14.867600+0000","mapping_epoch":22,"log_start":"24'1300","ondisk_log_start":"24'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":269399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582779+0000","last_change":"2020-11-20T11:38:47.415730+0000","last_active":"2020-11-20T11:38:53.582779+0000","last_peered":"2020-11-20T11:38:53.582779+0000","last_clean":"2020-11-20T11:38:53.582779+0000","last_became_active":"2020-11-20T11:38:47.415074+0000","last_became_peered":"2020-11-20T11:38:47.415074+0000","last_unstale":"2020-11-20T11:38:53.582779+0000","last_undegraded":"2020-11-20T11:38:53.582779+0000","last_fullsized":"2020-11-20T11:38:53.582779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598756+0000","last_change":"2020-11-20T11:38:42.662573+0000","last_active":"2020-11-20T11:38:53.598756+0000","last_peered":"2020-11-20T11:38:53.598756+0000","last_clean":"2020-11-20T11:38:53.598756+0000","last_became_active":"2020-11-20T11:38:42.661151+0000","last_became_peered":"2020-11-20T11:38:42.661151+0000","last_unstale":"2020-11-20T11:38:53.598756+0000","last_undegraded":"2020-11-20T11:38:53.598756+0000","last_fullsized":"2020-11-20T11:38:53.598756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_clean_scrub_stamp":"2020-11-20T11:38:39.267196+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'14770","reported_seq":"14782","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.667369+0000","last_change":"2020-11-20T11:38:50.576907+0000","last_active":"2020-11-20T12:04:19.667369+0000","last_peered":"2020-11-20T12:04:19.667369+0000","last_clean":"2020-11-20T12:04:19.667369+0000","last_became_active":"2020-11-20T11:38:50.576462+0000","last_became_peered":"2020-11-20T11:38:50.576462+0000","last_unstale":"2020-11-20T12:04:19.667369+0000","last_undegraded":"2020-11-20T12:04:19.667369+0000","last_fullsized":"2020-11-20T12:04:19.667369+0000","mapping_epoch":19,"log_start":"24'4700","ondisk_log_start":"24'4700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14791,"num_write_kb":88474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"24'11037","reported_seq":"11048","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.787435+0000","last_change":"2020-11-20T11:38:53.608371+0000","last_active":"2020-11-20T12:04:14.787435+0000","last_peered":"2020-11-20T12:04:14.787435+0000","last_clean":"2020-11-20T12:04:14.787435+0000","last_became_active":"2020-11-20T11:38:53.607661+0000","last_became_peered":"2020-11-20T11:38:53.607661+0000","last_unstale":"2020-11-20T12:04:14.787435+0000","last_undegraded":"2020-11-20T12:04:14.787435+0000","last_fullsized":"2020-11-20T12:04:14.787435+0000","mapping_epoch":22,"log_start":"24'1001","ondisk_log_start":"24'1001","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8436,"num_write_kb":207231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598787+0000","last_change":"2020-11-20T11:38:47.412658+0000","last_active":"2020-11-20T11:38:53.598787+0000","last_peered":"2020-11-20T11:38:53.598787+0000","last_clean":"2020-11-20T11:38:53.598787+0000","last_became_active":"2020-11-20T11:38:47.412241+0000","last_became_peered":"2020-11-20T11:38:47.412241+0000","last_unstale":"2020-11-20T11:38:53.598787+0000","last_undegraded":"2020-11-20T11:38:53.598787+0000","last_fullsized":"2020-11-20T11:38:53.598787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10893","reported_seq":"13336","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.542830+0000","last_change":"2020-11-20T11:38:50.579983+0000","last_active":"2020-11-20T12:04:19.542830+0000","last_peered":"2020-11-20T12:04:19.542830+0000","last_clean":"2020-11-20T12:04:19.542830+0000","last_became_active":"2020-11-20T11:38:50.579603+0000","last_became_peered":"2020-11-20T11:38:50.579603+0000","last_unstale":"2020-11-20T12:04:19.542830+0000","last_undegraded":"2020-11-20T12:04:19.542830+0000","last_fullsized":"2020-11-20T12:04:19.542830+0000","mapping_epoch":19,"log_start":"24'800","ondisk_log_start":"24'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10093,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2431,"num_read_kb":5766,"num_write":10900,"num_write_kb":58738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"24'11812","reported_seq":"11823","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.898523+0000","last_change":"2020-11-20T11:38:53.600590+0000","last_active":"2020-11-20T12:04:14.898523+0000","last_peered":"2020-11-20T12:04:14.898523+0000","last_clean":"2020-11-20T12:04:14.898523+0000","last_became_active":"2020-11-20T11:38:53.599863+0000","last_became_peered":"2020-11-20T11:38:53.599863+0000","last_unstale":"2020-11-20T12:04:14.898523+0000","last_undegraded":"2020-11-20T12:04:14.898523+0000","last_fullsized":"2020-11-20T12:04:14.898523+0000","mapping_epoch":22,"log_start":"24'1800","ondisk_log_start":"24'1800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9018,"num_write_kb":558745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598714+0000","last_change":"2020-11-20T11:38:48.027432+0000","last_active":"2020-11-20T11:38:53.598714+0000","last_peered":"2020-11-20T11:38:53.598714+0000","last_clean":"2020-11-20T11:38:53.598714+0000","last_became_active":"2020-11-20T11:38:48.026363+0000","last_became_peered":"2020-11-20T11:38:48.026363+0000","last_unstale":"2020-11-20T11:38:53.598714+0000","last_undegraded":"2020-11-20T11:38:53.598714+0000","last_fullsized":"2020-11-20T11:38:53.598714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'11552","reported_seq":"11564","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:22.931248+0000","last_change":"2020-11-20T11:38:51.087122+0000","last_active":"2020-11-20T12:04:22.931248+0000","last_peered":"2020-11-20T12:04:22.931248+0000","last_clean":"2020-11-20T12:04:22.931248+0000","last_became_active":"2020-11-20T11:38:51.086037+0000","last_became_peered":"2020-11-20T11:38:51.086037+0000","last_unstale":"2020-11-20T12:04:22.931248+0000","last_undegraded":"2020-11-20T12:04:22.931248+0000","last_fullsized":"2020-11-20T12:04:22.931248+0000","mapping_epoch":19,"log_start":"24'1500","ondisk_log_start":"24'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10052,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33555075,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11581,"num_write_kb":66598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"24'11671","reported_seq":"11682","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:15.023708+0000","last_change":"2020-11-20T11:38:53.599915+0000","last_active":"2020-11-20T12:04:15.023708+0000","last_peered":"2020-11-20T12:04:15.023708+0000","last_clean":"2020-11-20T12:04:15.023708+0000","last_became_active":"2020-11-20T11:38:53.599001+0000","last_became_peered":"2020-11-20T11:38:53.599001+0000","last_unstale":"2020-11-20T12:04:15.023708+0000","last_undegraded":"2020-11-20T12:04:15.023708+0000","last_fullsized":"2020-11-20T12:04:15.023708+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10071,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8874,"num_write_kb":388797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7451","reported_seq":"7474","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:20.291206+0000","last_change":"2020-11-20T11:38:51.328159+0000","last_active":"2020-11-20T12:04:20.291206+0000","last_peered":"2020-11-20T12:04:20.291206+0000","last_clean":"2020-11-20T12:04:20.291206+0000","last_became_active":"2020-11-20T11:38:51.327330+0000","last_became_peered":"2020-11-20T11:38:51.327330+0000","last_unstale":"2020-11-20T12:04:20.291206+0000","last_undegraded":"2020-11-20T12:04:20.291206+0000","last_fullsized":"2020-11-20T12:04:20.291206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":7451,"ondisk_log_size":7451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21035951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":11,"num_read_kb":70,"num_write":7501,"num_write_kb":44392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585363+0000","last_change":"2020-11-20T11:38:47.411462+0000","last_active":"2020-11-20T11:38:53.585363+0000","last_peered":"2020-11-20T11:38:53.585363+0000","last_clean":"2020-11-20T11:38:53.585363+0000","last_became_active":"2020-11-20T11:38:47.411044+0000","last_became_peered":"2020-11-20T11:38:47.411044+0000","last_unstale":"2020-11-20T11:38:53.585363+0000","last_undegraded":"2020-11-20T11:38:53.585363+0000","last_fullsized":"2020-11-20T11:38:53.585363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"24'11668","reported_seq":"11679","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.929843+0000","last_change":"2020-11-20T11:38:53.602316+0000","last_active":"2020-11-20T12:04:14.929843+0000","last_peered":"2020-11-20T12:04:14.929843+0000","last_clean":"2020-11-20T12:04:14.929843+0000","last_became_active":"2020-11-20T11:38:53.601560+0000","last_became_peered":"2020-11-20T11:38:53.601560+0000","last_unstale":"2020-11-20T12:04:14.929843+0000","last_undegraded":"2020-11-20T12:04:14.929843+0000","last_fullsized":"2020-11-20T12:04:14.929843+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10068,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8969,"num_write_kb":306187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.580277+0000","last_change":"2020-11-20T11:38:47.414164+0000","last_active":"2020-11-20T11:38:53.580277+0000","last_peered":"2020-11-20T11:38:53.580277+0000","last_clean":"2020-11-20T11:38:53.580277+0000","last_became_active":"2020-11-20T11:38:47.413633+0000","last_became_peered":"2020-11-20T11:38:47.413633+0000","last_unstale":"2020-11-20T11:38:53.580277+0000","last_undegraded":"2020-11-20T11:38:53.580277+0000","last_fullsized":"2020-11-20T11:38:53.580277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'13610","reported_seq":"13622","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.700036+0000","last_change":"2020-11-20T11:38:50.583562+0000","last_active":"2020-11-20T12:04:19.700036+0000","last_peered":"2020-11-20T12:04:19.700036+0000","last_clean":"2020-11-20T12:04:19.700036+0000","last_became_active":"2020-11-20T11:38:50.583037+0000","last_became_peered":"2020-11-20T11:38:50.583037+0000","last_unstale":"2020-11-20T12:04:19.700036+0000","last_undegraded":"2020-11-20T12:04:19.700036+0000","last_fullsized":"2020-11-20T12:04:19.700036+0000","mapping_epoch":19,"log_start":"24'3600","ondisk_log_start":"24'3600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10010,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14212,"num_write_kb":85659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70813,"num_write_kb":2736786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80375,"ondisk_log_size":80375,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":240879681,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":104316,"num_write_kb":608102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":481820672,"data_stored":481759362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77850,"ondisk_log_size":77850,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575160,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200968,"kb_used_data":20800,"kb_used_omap":0,"kb_used_meta":180160,"kb_avail":94170872,"statfs":{"total":96636764160,"available":96430972928,"internally_reserved":0,"allocated":21299200,"data_stored":21136716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":184483840},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":32.453000000000003,"15min":11.872},"min":{"1min":0.70699999999999996,"5min":0.52600000000000002,"15min":0.50800000000000001},"max":{"1min":2.0649999999999999,"5min":2116.4740000000002,"15min":2116.4740000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.883,"5min":32.752000000000002,"15min":12.205},"min":{"1min":0.92300000000000004,"5min":0.71199999999999997,"15min":0.53600000000000003},"max":{"1min":3.8119999999999998,"5min":2116.5169999999998,"15min":2116.5169999999998},"last":2.0640000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":3.0510000000000002,"5min":4.7969999999999997,"15min":2.649},"min":{"1min":0.621,"5min":0.58799999999999997,"15min":0.52700000000000002},"max":{"1min":18.414999999999999,"5min":52.777000000000001,"15min":52.777000000000001},"last":1.6399999999999999},{"interface":"front","average":{"1min":4.7770000000000001,"5min":7.157,"15min":3.4569999999999999},"min":{"1min":0.94799999999999995,"5min":0.59499999999999997,"15min":0.58499999999999996},"max":{"1min":23.556999999999999,"5min":207.23400000000001,"15min":207.23400000000001},"last":1.526}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.591,"15min":1.6850000000000001},"min":{"1min":0.98099999999999998,"5min":0.71199999999999997,"15min":0.60199999999999998},"max":{"1min":2.7549999999999999,"5min":6.6840000000000002,"15min":7.742},"last":2.2090000000000001},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.8140000000000001,"15min":1.9419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.60099999999999998},"max":{"1min":4.1100000000000003,"5min":5.4749999999999996,"15min":8.1899999999999995},"last":2.5299999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":5.1130000000000004,"15min":3.097},"min":{"1min":1.056,"5min":0.876,"15min":0.69099999999999995},"max":{"1min":4.2220000000000004,"5min":212.76300000000001,"15min":212.76300000000001},"last":2.6360000000000001},{"interface":"front","average":{"1min":2.306,"5min":5.2370000000000001,"15min":3.2530000000000001},"min":{"1min":0.93700000000000006,"5min":0.88200000000000001,"15min":0.85699999999999998},"max":{"1min":4.1980000000000004,"5min":212.83799999999999,"15min":212.83799999999999},"last":2.7389999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.7170000000000001,"15min":1.9179999999999999},"min":{"1min":0.88,"5min":0.79900000000000004,"15min":0.72799999999999998},"max":{"1min":3.4849999999999999,"5min":8.9629999999999992,"15min":13.430999999999999},"last":2.3069999999999999},{"interface":"front","average":{"1min":1.8859999999999999,"5min":2.137,"15min":2.1970000000000001},"min":{"1min":1.0569999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"max":{"1min":3.048,"5min":8.6210000000000004,"15min":9.3109999999999999},"last":3.048}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.4169999999999998,"5min":2.645,"15min":2.4140000000000001},"min":{"1min":1.0269999999999999,"5min":0.81699999999999995,"15min":0.78600000000000003},"max":{"1min":4.2510000000000003,"5min":24.559000000000001,"15min":24.559000000000001},"last":2.931},{"interface":"front","average":{"1min":2.3100000000000001,"5min":2.593,"15min":2.48},"min":{"1min":1.014,"5min":0.94399999999999995,"15min":0.88100000000000001},"max":{"1min":3.6360000000000001,"5min":24.847999999999999,"15min":24.847999999999999},"last":2.964}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":2.3109999999999999,"15min":2.512},"min":{"1min":1.103,"5min":1.103,"15min":0.98099999999999998},"max":{"1min":3.782,"5min":9.2739999999999991,"15min":13.81},"last":3.2559999999999998},{"interface":"front","average":{"1min":2.1859999999999999,"5min":2.3039999999999998,"15min":2.4279999999999999},"min":{"1min":1.1639999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.4630000000000001,"5min":7.1020000000000003,"15min":8.9559999999999995},"last":3.4529999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91072,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":90816,"kb_avail":94280768,"statfs":{"total":96636764160,"available":96543506432,"internally_reserved":0,"allocated":253952,"data_stored":100765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92995584},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":21.507999999999999,"15min":10.375999999999999},"min":{"1min":0.63300000000000001,"5min":0.54200000000000004,"15min":0.52200000000000002},"max":{"1min":8.5190000000000001,"5min":1335.944,"15min":1335.944},"last":1.7729999999999999},{"interface":"front","average":{"1min":2.2679999999999998,"5min":21.878,"15min":10.737},"min":{"1min":0.64600000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":8.468,"5min":1336.0409999999999,"15min":1336.0409999999999},"last":2.3450000000000002}]},{"osd":1,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":3.1589999999999998,"5min":3.9529999999999998,"15min":5.7770000000000001},"min":{"1min":0.67300000000000004,"5min":0.59499999999999997,"15min":0.56399999999999995},"max":{"1min":12.664,"5min":66.885999999999996,"15min":725.73900000000003},"last":1.7130000000000001},{"interface":"front","average":{"1min":4.2910000000000004,"5min":4.4800000000000004,"15min":6.242},"min":{"1min":0.81899999999999995,"5min":0.54500000000000004,"15min":0.53600000000000003},"max":{"1min":30.75,"5min":66.608999999999995,"15min":721.18799999999999},"last":1.6259999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.776,"15min":4.1449999999999996},"min":{"1min":0.64900000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.0459999999999998,"5min":8.7579999999999991,"15min":720.64499999999998},"last":3.2120000000000002},{"interface":"front","average":{"1min":2.46,"5min":1.984,"15min":4.2089999999999996},"min":{"1min":0.746,"5min":0.70699999999999996,"15min":0.68999999999999995},"max":{"1min":11.244999999999999,"5min":11.244999999999999,"15min":725.26999999999998},"last":2.2490000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.0139999999999998,"5min":3.5019999999999998,"15min":4.8620000000000001},"min":{"1min":0.86899999999999999,"5min":0.73099999999999998,"15min":0.65200000000000002},"max":{"1min":5.9199999999999999,"5min":131.03200000000001,"15min":722.21600000000001},"last":3.1139999999999999},{"interface":"front","average":{"1min":2.3450000000000002,"5min":3.4580000000000002,"15min":4.9210000000000003},"min":{"1min":0.879,"5min":0.879,"15min":0.79700000000000004},"max":{"1min":7.8140000000000001,"5min":130.99700000000001,"15min":720.30899999999997},"last":3.4260000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":1.7250000000000001,"5min":1.946,"15min":4.3449999999999998},"min":{"1min":0.97599999999999998,"5min":0.75800000000000001,"15min":0.69399999999999995},"max":{"1min":2.9910000000000001,"5min":8.6799999999999997,"15min":726.67999999999995},"last":2.637},{"interface":"front","average":{"1min":2.081,"5min":2.3799999999999999,"15min":4.7469999999999999},"min":{"1min":1.343,"5min":0.94799999999999995,"15min":0.748},"max":{"1min":3.1920000000000002,"5min":8.8480000000000008,"15min":724.88699999999994},"last":2.7429999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.302,"15min":4.7750000000000004},"min":{"1min":1.2010000000000001,"5min":0.92100000000000004,"15min":0.872},"max":{"1min":4.8410000000000002,"5min":9.2699999999999996,"15min":721.94000000000005},"last":3.8199999999999998},{"interface":"front","average":{"1min":2.1899999999999999,"5min":2.3660000000000001,"15min":4.8090000000000002},"min":{"1min":1.0740000000000001,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":4.8689999999999998,"5min":9.3070000000000004,"15min":728.56399999999996},"last":3}]},{"osd":7,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":2.754,"15min":4.9269999999999996},"min":{"1min":1.2190000000000001,"5min":0.97199999999999998,"15min":0.81100000000000005},"max":{"1min":3.423,"5min":30.501999999999999,"15min":729},"last":3.48},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.4969999999999999,"15min":4.859},"min":{"1min":1.153,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":5.5170000000000003,"5min":30.692,"15min":728.80600000000004},"last":3.617}]}]},{"osd":1,"up_from":13,"seq":55834575160,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":485740,"kb_used_data":100260,"kb_used_omap":0,"kb_used_meta":385472,"kb_avail":93886100,"statfs":{"total":96636764160,"available":96139366400,"internally_reserved":0,"allocated":102666240,"data_stored":102503789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":394723328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":3.8530000000000002,"5min":41.131999999999998,"15min":15.066000000000001},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":22.218,"5min":2981.1959999999999,"15min":2981.1959999999999},"last":1.8460000000000001},{"interface":"front","average":{"1min":5.5380000000000003,"5min":41.920000000000002,"15min":15.09},"min":{"1min":0.64700000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":23.253,"5min":2972.6509999999998,"15min":2972.6509999999998},"last":1.7030000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":3.3799999999999999,"5min":4.1609999999999996,"15min":2.5939999999999999},"min":{"1min":0.77500000000000002,"5min":0.52800000000000002,"15min":0.50700000000000001},"max":{"1min":23.337,"5min":74.406000000000006,"15min":74.406000000000006},"last":1.335},{"interface":"front","average":{"1min":3.3250000000000002,"5min":4.0549999999999997,"15min":2.3780000000000001},"min":{"1min":0.58099999999999996,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":23.634,"5min":48.393000000000001,"15min":48.393000000000001},"last":1.569}]},{"osd":3,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":2.9350000000000001,"5min":6.1950000000000003,"15min":3.621},"min":{"1min":0.72999999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":23.289999999999999,"5min":89.393000000000001,"15min":89.393000000000001},"last":1.296},{"interface":"front","average":{"1min":6.3390000000000004,"5min":5.4980000000000002,"15min":2.907},"min":{"1min":0.76600000000000001,"5min":0.624,"15min":0.58999999999999997},"max":{"1min":23.661000000000001,"5min":87.826999999999998,"15min":87.826999999999998},"last":2.2789999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":3.8359999999999999,"5min":4.4530000000000003,"15min":2.7149999999999999},"min":{"1min":0.98199999999999998,"5min":0.66900000000000004,"15min":0.60399999999999998},"max":{"1min":24.053000000000001,"5min":48.536999999999999,"15min":48.536999999999999},"last":1.79},{"interface":"front","average":{"1min":5.5659999999999998,"5min":4.7359999999999998,"15min":3.1659999999999999},"min":{"1min":0.84199999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":37.384999999999998,"5min":60.997999999999998,"15min":60.997999999999998},"last":2.452}]},{"osd":5,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":5.2359999999999998,"5min":5.0860000000000003,"15min":3.504},"min":{"1min":1.0780000000000001,"5min":0.95499999999999996,"15min":0.72899999999999998},"max":{"1min":23.838999999999999,"5min":59.052999999999997,"15min":98.697999999999993},"last":2.9780000000000002},{"interface":"front","average":{"1min":5.5439999999999996,"5min":5.7670000000000003,"15min":4.0960000000000001},"min":{"1min":1.1619999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":37.563000000000002,"5min":61.18,"15min":98.759},"last":2.7189999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":3.9740000000000002,"5min":4.8719999999999999,"15min":3.48},"min":{"1min":1.1870000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":24.207999999999998,"5min":48.417000000000002,"15min":82.400999999999996},"last":2.3799999999999999},{"interface":"front","average":{"1min":6.532,"5min":6.6180000000000003,"15min":3.6240000000000001},"min":{"1min":1.399,"5min":1.0389999999999999,"15min":0.98099999999999998},"max":{"1min":23.724,"5min":59.18,"15min":59.18},"last":2.7730000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:03:29 2020","interfaces":[{"interface":"back","average":{"1min":5.7320000000000002,"5min":7.6429999999999998,"15min":4.3869999999999996},"min":{"1min":1.391,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":37.192999999999998,"5min":162.124,"15min":162.124},"last":2.9039999999999999},{"interface":"front","average":{"1min":4.0119999999999996,"5min":6.9509999999999996,"15min":3.9700000000000002},"min":{"1min":1.3049999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":24.146000000000001,"5min":160.29499999999999,"15min":160.29499999999999},"last":2.5670000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575159,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421636,"kb_used_data":78076,"kb_used_omap":0,"kb_used_meta":343552,"kb_avail":93950204,"statfs":{"total":96636764160,"available":96205008896,"internally_reserved":0,"allocated":79949824,"data_stored":79792575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351797248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":6.0469999999999997,"5min":5.7089999999999996,"15min":3.1520000000000001},"min":{"1min":0.73599999999999999,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":32.566000000000003,"5min":35.283000000000001,"15min":81.277000000000001},"last":2.5009999999999999},{"interface":"front","average":{"1min":5.54,"5min":6.9889999999999999,"15min":3.8570000000000002},"min":{"1min":0.60099999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":32.427,"5min":40.186999999999998,"15min":81.471000000000004},"last":2.2599999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":2.1139999999999999,"15min":1.847},"min":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.48999999999999999},"max":{"1min":6.3360000000000003,"5min":38.624000000000002,"15min":38.624000000000002},"last":1.76},{"interface":"front","average":{"1min":2.1669999999999998,"5min":2.8359999999999999,"15min":2.0649999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.47899999999999998},"max":{"1min":8.8130000000000006,"5min":40.667999999999999,"15min":40.667999999999999},"last":1.8149999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":2.5350000000000001,"15min":1.9970000000000001},"min":{"1min":0.68600000000000005,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":8.7089999999999996,"5min":22.062999999999999,"15min":22.062999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.645,"15min":2.214},"min":{"1min":0.80200000000000005,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":5.9329999999999998,"5min":29.331,"15min":29.331},"last":2.0939999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":3.3999999999999999,"15min":4.9660000000000002},"min":{"1min":0.75800000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":5.7119999999999997,"5min":40.356999999999999,"15min":737.07799999999997},"last":2.452},{"interface":"front","average":{"1min":2.7650000000000001,"5min":2.6139999999999999,"15min":4.6360000000000001},"min":{"1min":1.107,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":8.8520000000000003,"5min":22.334,"15min":736.77800000000002},"last":2.2959999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":6.4359999999999999,"15min":4.4699999999999998},"min":{"1min":0.99199999999999999,"5min":0.79000000000000004,"15min":0.72799999999999998},"max":{"1min":6.5190000000000001,"5min":300.21800000000002,"15min":300.21800000000002},"last":1.452},{"interface":"front","average":{"1min":2.1709999999999998,"5min":6.6600000000000001,"15min":4.7060000000000004},"min":{"1min":0.95099999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":5.7910000000000004,"5min":300.31799999999998,"15min":300.31799999999998},"last":2.6469999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.9039999999999999,"5min":3.649,"15min":3.2679999999999998},"min":{"1min":1.1919999999999999,"5min":0.89800000000000002,"15min":0.86499999999999999},"max":{"1min":8.9740000000000002,"5min":52.329000000000001,"15min":144.44200000000001},"last":2.8039999999999998},{"interface":"front","average":{"1min":2.1899999999999999,"5min":3.2360000000000002,"15min":3.1589999999999998},"min":{"1min":1.23,"5min":0.96099999999999997,"15min":0.82199999999999995},"max":{"1min":6.133,"5min":29.690999999999999,"15min":143.72399999999999},"last":1.929}]},{"osd":7,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":3.75,"15min":2.891},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":0.95399999999999996},"max":{"1min":5.9699999999999998,"5min":40.509,"15min":40.509},"last":2.8570000000000002},{"interface":"front","average":{"1min":3.004,"5min":3.4300000000000002,"15min":2.629},"min":{"1min":1.2070000000000001,"5min":1.0449999999999999,"15min":1.034},"max":{"1min":8.9130000000000003,"5min":30.167999999999999,"15min":30.167999999999999},"last":3.2469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575160,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283756,"kb_used_data":67492,"kb_used_omap":0,"kb_used_meta":216256,"kb_avail":94088084,"statfs":{"total":96636764160,"available":96346198016,"internally_reserved":0,"allocated":69111808,"data_stored":68949357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221446144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":80.144999999999996,"15min":28.204000000000001},"min":{"1min":0.63200000000000001,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":11.33,"5min":5512.3900000000003,"15min":5512.3900000000003},"last":1.6659999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":79.501000000000005,"15min":27.98},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.02,"5min":5508.7870000000003,"15min":5508.7870000000003},"last":1.861}]},{"osd":1,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":8.0440000000000005,"5min":6.569,"15min":7.0469999999999997},"min":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.49299999999999999},"max":{"1min":30.960999999999999,"5min":71.078999999999994,"15min":812.93899999999996},"last":1.5309999999999999},{"interface":"front","average":{"1min":8.6359999999999992,"5min":6.6500000000000004,"15min":7.3159999999999998},"min":{"1min":0.71099999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":31.152999999999999,"5min":71.881,"15min":824.13699999999994},"last":2.1760000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.597,"15min":1.9750000000000001},"min":{"1min":0.80000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.0629999999999997,"5min":7.8460000000000001,"15min":100.506},"last":2.319},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.7849999999999999,"15min":2.1320000000000001},"min":{"1min":0.88700000000000001,"5min":0.68300000000000005,"15min":0.58999999999999997},"max":{"1min":4.6109999999999998,"5min":6.8300000000000001,"15min":101.16800000000001},"last":1.9450000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":2.4969999999999999,"15min":3.8690000000000002},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67600000000000005},"max":{"1min":3.7000000000000002,"5min":74.609999999999999,"15min":277.25},"last":2.3929999999999998},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6869999999999998,"15min":4.0970000000000004},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.2060000000000004,"5min":79.671999999999997,"15min":278.44600000000003},"last":2.698}]},{"osd":5,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":2.4590000000000001,"15min":6.3259999999999996},"min":{"1min":1.228,"5min":0.88300000000000001,"15min":0.69999999999999996},"max":{"1min":4.9790000000000001,"5min":7.4989999999999997,"15min":486.85599999999999},"last":3.2759999999999998},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1800000000000002,"15min":6.202},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"max":{"1min":6.0380000000000003,"5min":8.3320000000000007,"15min":487.04700000000003},"last":3.1850000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":2.7269999999999999,"15min":4.2050000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":4.532,"5min":70.768000000000001,"15min":277.32400000000001},"last":3.1150000000000002},{"interface":"front","average":{"1min":2.3109999999999999,"5min":3.016,"15min":4.3650000000000002},"min":{"1min":1.296,"5min":1.0649999999999999,"15min":0.81100000000000005},"max":{"1min":4.7359999999999998,"5min":70.599999999999994,"15min":276.94499999999999},"last":3.5230000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":3.6419999999999999,"15min":4.5499999999999998},"min":{"1min":1.153,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":5.9139999999999997,"5min":74.421999999999997,"15min":282.084},"last":2.8210000000000002},{"interface":"front","average":{"1min":2.2429999999999999,"5min":3.738,"15min":4.6689999999999996},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":4.3319999999999999,"5min":74.719999999999999,"15min":281.82299999999998},"last":3.391}]}]},{"osd":3,"up_from":13,"seq":55834575160,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438032,"kb_used_data":90440,"kb_used_omap":0,"kb_used_meta":347584,"kb_avail":93933808,"statfs":{"total":96636764160,"available":96188219392,"internally_reserved":0,"allocated":92610560,"data_stored":92440044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355926016},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":31.047999999999998,"15min":11.473000000000001},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":11.35,"5min":2604.2579999999998,"15min":2604.2579999999998},"last":1.7050000000000001},{"interface":"front","average":{"1min":2.101,"5min":30.957000000000001,"15min":11.455},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.210000000000001,"5min":2602.6849999999999,"15min":2602.6849999999999},"last":1.7909999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.3849999999999998,"5min":4.282,"15min":2.395},"min":{"1min":0.68500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":23.425999999999998,"5min":49.542999999999999,"15min":49.542999999999999},"last":1.8680000000000001},{"interface":"front","average":{"1min":3.7000000000000002,"5min":4.4710000000000001,"15min":2.6120000000000001},"min":{"1min":0.68999999999999995,"5min":0.57299999999999995,"15min":0.56399999999999995},"max":{"1min":20.125,"5min":31.414000000000001,"15min":31.414000000000001},"last":2.1549999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":2.1960000000000002,"15min":1.823},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"max":{"1min":6.1710000000000003,"5min":16.135999999999999,"15min":16.135999999999999},"last":2.2400000000000002},{"interface":"front","average":{"1min":1.794,"5min":2.3420000000000001,"15min":1.988},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.61199999999999999},"max":{"1min":4.3550000000000004,"5min":16.859000000000002,"15min":16.859000000000002},"last":2.883}]},{"osd":4,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":2.6000000000000001,"15min":1.9910000000000001},"min":{"1min":0.90400000000000003,"5min":0.71799999999999997,"15min":0.628},"max":{"1min":5.7610000000000001,"5min":65.238,"15min":65.238},"last":2.4449999999999998},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.1850000000000001,"15min":2.395},"min":{"1min":1.073,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":6.2969999999999997,"5min":65.281999999999996,"15min":65.281999999999996},"last":2.504}]},{"osd":5,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":5.734,"15min":3.2970000000000002},"min":{"1min":0.90300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":6.4260000000000002,"5min":297.14100000000002,"15min":297.14100000000002},"last":2.7080000000000002},{"interface":"front","average":{"1min":2.2450000000000001,"5min":5.843,"15min":3.3559999999999999},"min":{"1min":1.298,"5min":0.83099999999999996,"15min":0.79000000000000004},"max":{"1min":5.3200000000000003,"5min":297.178,"15min":297.178},"last":3.6259999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":3.468,"15min":2.6150000000000002},"min":{"1min":1.337,"5min":0.92400000000000004,"15min":0.90000000000000002},"max":{"1min":5.8559999999999999,"5min":70.016000000000005,"15min":70.016000000000005},"last":3.3940000000000001},{"interface":"front","average":{"1min":2.2549999999999999,"5min":2.9039999999999999,"15min":2.206},"min":{"1min":1.075,"5min":0.877,"15min":0.753},"max":{"1min":6.2000000000000002,"5min":65.394999999999996,"15min":65.394999999999996},"last":2.8119999999999998}]},{"osd":7,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.024,"5min":3.4009999999999998,"15min":2.8940000000000001},"min":{"1min":1.093,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":9.3599999999999994,"5min":62.003999999999998,"15min":143.607},"last":3.105},{"interface":"front","average":{"1min":2.7429999999999999,"5min":3.8399999999999999,"15min":2.7949999999999999},"min":{"1min":1.171,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":9.7699999999999996,"5min":62.216000000000001,"15min":62.216000000000001},"last":2.964}]}]},{"osd":4,"up_from":13,"seq":55834575160,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257284,"kb_used_data":45308,"kb_used_omap":0,"kb_used_meta":211968,"kb_avail":94114556,"statfs":{"total":96636764160,"available":96373305344,"internally_reserved":0,"allocated":46395392,"data_stored":46238143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":217055232},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":3.544,"5min":72.183999999999997,"15min":25.489000000000001},"min":{"1min":0.78000000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":32.085999999999999,"5min":4575.527,"15min":4575.527},"last":1.331},{"interface":"front","average":{"1min":3.343,"5min":72.400000000000006,"15min":28.329999999999998},"min":{"1min":0.755,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":32.143999999999998,"5min":4579.8609999999999,"15min":4579.8609999999999},"last":2.3109999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":3.4449999999999998,"5min":4.9009999999999998,"15min":8.2260000000000009},"min":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":21.684999999999999,"5min":122.90300000000001,"15min":752.74000000000001},"last":2.798},{"interface":"front","average":{"1min":3.79,"5min":5.7629999999999999,"15min":5.899},"min":{"1min":0.77500000000000002,"5min":0.623,"15min":0.623},"max":{"1min":21.782,"5min":124.078,"15min":594.72199999999998},"last":1.875}]},{"osd":2,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":1.909,"5min":1.857,"15min":4.8220000000000001},"min":{"1min":0.81599999999999995,"5min":0.74299999999999999,"15min":0.67700000000000005},"max":{"1min":3.9889999999999999,"5min":6.7380000000000004,"15min":752.94799999999998},"last":3.1669999999999998},{"interface":"front","average":{"1min":2.226,"5min":2.0390000000000001,"15min":2.2149999999999999},"min":{"1min":0.99199999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":5.0330000000000004,"5min":6.8719999999999999,"15min":31.030000000000001},"last":2.5630000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":2.9849999999999999,"15min":2.2549999999999999},"min":{"1min":0.78900000000000003,"5min":0.747,"15min":0.747},"max":{"1min":3.1949999999999998,"5min":124.405,"15min":124.405},"last":1.403},{"interface":"front","average":{"1min":2.0600000000000001,"5min":3.2040000000000002,"15min":5.2210000000000001},"min":{"1min":0.81299999999999994,"5min":0.73799999999999999,"15min":0.68100000000000005},"max":{"1min":4.3209999999999997,"5min":122.337,"15min":753.07100000000003},"last":2.3849999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.5409999999999999,"15min":2.3490000000000002},"min":{"1min":1.046,"5min":0.83399999999999996,"15min":0.82499999999999996},"max":{"1min":5.2759999999999998,"5min":65.716999999999999,"15min":65.716999999999999},"last":2.9289999999999998},{"interface":"front","average":{"1min":2.2160000000000002,"5min":2.6219999999999999,"15min":2.331},"min":{"1min":1.0089999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":3.3220000000000001,"5min":64.546000000000006,"15min":64.546000000000006},"last":2.6309999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.2989999999999999,"5min":2.1070000000000002,"15min":5.7930000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.79000000000000004},"max":{"1min":5.2350000000000003,"5min":6.6120000000000001,"15min":753.18700000000001},"last":3.4529999999999998},{"interface":"front","average":{"1min":2.9129999999999998,"5min":2.2280000000000002,"15min":3.0230000000000001},"min":{"1min":1.238,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":11.848000000000001,"5min":11.848000000000001,"15min":178.023},"last":3.274}]},{"osd":7,"last update":"Fri Nov 20 12:03:33 2020","interfaces":[{"interface":"back","average":{"1min":2.5310000000000001,"5min":2.355,"15min":2.4300000000000002},"min":{"1min":1.3640000000000001,"5min":1.006,"15min":0.94899999999999995},"max":{"1min":3.6030000000000002,"5min":6.9950000000000001,"15min":7.3079999999999998},"last":2.8799999999999999},{"interface":"front","average":{"1min":2.5790000000000002,"5min":2.4260000000000002,"15min":5.359},"min":{"1min":1.181,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":5.4710000000000001,"5min":6.4610000000000003,"15min":753.30100000000004},"last":4.242}]}]},{"osd":5,"up_from":13,"seq":55834575160,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378952,"kb_used_data":69888,"kb_used_omap":0,"kb_used_meta":309056,"kb_avail":93992888,"statfs":{"total":96636764160,"available":96248717312,"internally_reserved":0,"allocated":71565312,"data_stored":71404093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316473344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":78.034999999999997,"15min":27.175999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":2.6469999999999998,"5min":4320.9859999999999,"15min":4320.9859999999999},"last":2.5670000000000002},{"interface":"front","average":{"1min":1.3779999999999999,"5min":78.102999999999994,"15min":27.228000000000002},"min":{"1min":0.66200000000000003,"5min":0.624,"15min":0.50900000000000001},"max":{"1min":2.4550000000000001,"5min":4324.4759999999997,"15min":4324.4759999999997},"last":2.4550000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":6.3230000000000004,"5min":6.6420000000000003,"15min":5.2039999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":42.215000000000003,"5min":97.617999999999995,"15min":532.33500000000004},"last":1.5880000000000001},{"interface":"front","average":{"1min":6.5579999999999998,"5min":7.0579999999999998,"15min":5.556},"min":{"1min":0.81499999999999995,"5min":0.60899999999999999,"15min":0.57399999999999995},"max":{"1min":42.776000000000003,"5min":97.906000000000006,"15min":525.60599999999999},"last":2.2730000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.609,"15min":2.266},"min":{"1min":0.69699999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9889999999999999,"5min":86.805000000000007,"15min":86.805000000000007},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.4159999999999999,"15min":2.222},"min":{"1min":0.72899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.3150000000000004,"5min":86.688000000000002,"15min":86.688000000000002},"last":2.3849999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0459999999999998,"15min":2.609},"min":{"1min":0.82999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":6.5759999999999996,"5min":87.418999999999997,"15min":87.418999999999997},"last":2.1320000000000001},{"interface":"front","average":{"1min":2.0649999999999999,"5min":3.0779999999999998,"15min":2.5670000000000002},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.516,"5min":87.192999999999998,"15min":87.192999999999998},"last":2.6480000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.7879999999999998,"15min":2.6070000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.8730000000000002,"5min":86.876000000000005,"15min":86.876000000000005},"last":2.8069999999999999},{"interface":"front","average":{"1min":2.218,"5min":2.919,"15min":2.7269999999999999},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0019999999999998,"5min":87.581999999999994,"15min":87.581999999999994},"last":2.867}]},{"osd":6,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.919,"15min":2.7669999999999999},"min":{"1min":0.92000000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":5.2830000000000004,"5min":87.760999999999996,"15min":87.760999999999996},"last":2.9609999999999999},{"interface":"front","average":{"1min":2.2629999999999999,"5min":3.153,"15min":2.968},"min":{"1min":1.0329999999999999,"5min":0.89600000000000002,"15min":0.88},"max":{"1min":4.0629999999999997,"5min":87.366,"15min":87.366},"last":3.0049999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.5350000000000001,"5min":3.1459999999999999,"15min":3.048},"min":{"1min":1.161,"5min":1.1060000000000001,"15min":1.024},"max":{"1min":4.8330000000000002,"5min":87.825000000000003,"15min":87.825000000000003},"last":3.194},{"interface":"front","average":{"1min":2.6520000000000001,"5min":3.2450000000000001,"15min":3.081},"min":{"1min":1.169,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":5.0979999999999999,"5min":87.489000000000004,"15min":87.489000000000004},"last":3.2349999999999999}]}]}]}} 2020-11-20T12:04:35.739 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:04:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 Processor -- start 2020-11-20T12:04:35.859 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 -- start start 2020-11-20T12:04:35.861 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbaf4142f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf4065ec0 con 0x7fbaf40674f0 2020-11-20T12:04:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf4137c30 con 0x7fbaf4137640 2020-11-20T12:04:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf884e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40665e0 con 0x7fbaf4134c50 2020-11-20T12:04:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf37fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbaf40674f0 0x7fbaf413abb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47782/0 (socket says 172.21.15.161:47782) 2020-11-20T12:04:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf37fe700 1 -- 172.21.15.161:0/1921703507 learned_addr learned my addr 172.21.15.161:0/1921703507 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf3fff700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbaf4142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715101983 0 0) 0x7fbaf4065ec0 con 0x7fbaf40674f0 2020-11-20T12:04:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad4003240 con 0x7fbaf40674f0 2020-11-20T12:04:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314269443 0 0) 0x7fbaf4137c30 con 0x7fbaf4137640 2020-11-20T12:04:35.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf4065ec0 con 0x7fbaf4137640 2020-11-20T12:04:35.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2311883434 0 0) 0x7fbad4003240 con 0x7fbaf40674f0 2020-11-20T12:04:35.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 msgr2=0x7fbaf4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbaf4142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.864 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 >> v1:172.21.15.186:6789/0 conn(0x7fbaf4137640 legacy=0x7fbaf4134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4137ed0 con 0x7fbaf40674f0 2020-11-20T12:04:35.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7fbaec001860 con 0x7fbaf40674f0 2020-11-20T12:04:35.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 >> v1:172.21.15.161:6789/0 conn(0x7fbaf40674f0 legacy=0x7fbaf413abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.865 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad40038f0 0x7fbad4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad40044e0 0x7fbad4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbad4004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40665e0 con 0x7fbad40044e0 2020-11-20T12:04:35.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4005340 con 0x7fbad40038f0 2020-11-20T12:04:35.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad400b760 con 0x7fbaf4134c50 2020-11-20T12:04:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad40044e0 0x7fbad4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf3fff700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbad4004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.850+0000 7fbaf37fe700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad40038f0 0x7fbad4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 msgr2=0x7fbad4004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf4134c50 0x7fbad4004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad40038f0 msgr2=0x7fbad4003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad40038f0 0x7fbad4003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/1921703507 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad4003240 con 0x7fbad40044e0 2020-11-20T12:04:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad40044e0 0x7fbad4004960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fbae4001a80 tx=0x7fbae4007b90).ready entity=mon.0 client_cookie=d069038a7b2e4bcd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4007020 con 0x7fbad40044e0 2020-11-20T12:04:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4007180 con 0x7fbad40044e0 2020-11-20T12:04:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf27fc700 1 -- 172.21.15.161:0/1921703507 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400c960 con 0x7fbad40044e0 2020-11-20T12:04:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- 172.21.15.161:0/1921703507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad40044e0 msgr2=0x7fbad4004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 --2- 172.21.15.161:0/1921703507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbad40044e0 0x7fbad4004960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fbae4001a80 tx=0x7fbae4007b90).stop 2020-11-20T12:04:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf3fff700 1 -- 172.21.15.161:0/1921703507 reap_dead start 2020-11-20T12:04:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- 172.21.15.161:0/1921703507 shutdown_connections 2020-11-20T12:04:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- 172.21.15.161:0/1921703507 >> 172.21.15.161:0/1921703507 conn(0x7fbaf4061260 msgr2=0x7fbaf4061640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:35.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- 172.21.15.161:0/1921703507 shutdown_connections 2020-11-20T12:04:35.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- 172.21.15.161:0/1921703507 wait complete. 2020-11-20T12:04:35.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 Processor -- start 2020-11-20T12:04:35.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.854+0000 7fbaf884e700 1 -- start start 2020-11-20T12:04:35.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad40044e0 0x7fbaf40acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 0x7fbaf4149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40ac370 con 0x7fbaf40a1e90 2020-11-20T12:04:35.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40ac610 con 0x7fbaf4148df0 2020-11-20T12:04:35.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf40ac8b0 con 0x7fbad40044e0 2020-11-20T12:04:35.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37556/0 (socket says 172.21.15.161:37556) 2020-11-20T12:04:35.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/2225712959 learned_addr learned my addr 172.21.15.161:0/2225712959 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:35.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf37fe700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad40044e0 0x7fbaf40acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf3fff700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 0x7fbaf4149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.876 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad40044e0 msgr2=0x7fbaf40acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.876 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad40044e0 0x7fbaf40acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.876 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 msgr2=0x7fbaf4149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:35.876 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 0x7fbaf4149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:35.876 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 -- 172.21.15.161:0/2225712959 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf40a7ef0 con 0x7fbaf40a1e90 2020-11-20T12:04:35.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf3fff700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 0x7fbaf4149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:35.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf2ffd700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbae4000f20 tx=0x7fbae4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4001ea0 con 0x7fbaf40a1e90 2020-11-20T12:04:35.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae4012af0 con 0x7fbaf40a1e90 2020-11-20T12:04:35.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae401d440 con 0x7fbaf40a1e90 2020-11-20T12:04:35.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 -- 172.21.15.161:0/2225712959 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf40add70 con 0x7fbaf40a1e90 2020-11-20T12:04:35.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbaf884e700 1 -- 172.21.15.161:0/2225712959 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf40a2530 con 0x7fbaf40a1e90 2020-11-20T12:04:35.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.858+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf40a8080 con 0x7fbaf40a1e90 2020-11-20T12:04:35.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.862+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fbae4024030 con 0x7fbaf40a1e90 2020-11-20T12:04:35.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.862+0000 7fbaeb7fe700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 0x7fbad0057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:35.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.862+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbae406f8f0 con 0x7fbaf40a1e90 2020-11-20T12:04:35.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.862+0000 7fbaf37fe700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 0x7fbad0057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:35.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.862+0000 7fbaf37fe700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 0x7fbad0057c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbaec0017b0 tx=0x7fbaec007040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:35.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:35.866+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbae40456e0 con 0x7fbaf40a1e90 2020-11-20T12:04:36.027 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.018+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaf40adf00 con 0x7fbaf40a1e90 2020-11-20T12:04:36.029 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.018+0000 7fbaeb7fe700 1 -- 172.21.15.161:0/2225712959 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17135 (secure 0 0 0) 0x7fbae4030300 con 0x7fbaf40a1e90 2020-11-20T12:04:36.029 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T12:04:36.030 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"416fbbe8-6418-42c8-b3e0-6e08bacfe8cc","created":"2020-11-20T11:38:34.501853+0000","modified":"2020-11-20T11:38:53.953514+0000","last_up_change":"2020-11-20T11:38:41.289927+0000","last_in_change":"2020-11-20T11:38:41.289927+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T11:38:38.321980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T11:38:45.546076+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T11:38:49.160214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T11:38:51.610748+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"55c9ae94-487e-4cfe-b057-5806f0d6480d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6815","nonce":14664},{"type":"v1","addr":"172.21.15.161:6818","nonce":14664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":14664},{"type":"v1","addr":"172.21.15.161:6822","nonce":14664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":14664},{"type":"v1","addr":"172.21.15.161:6830","nonce":14664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":14664},{"type":"v1","addr":"172.21.15.161:6827","nonce":14664}]},"public_addr":"172.21.15.161:6818/14664","cluster_addr":"172.21.15.161:6822/14664","heartbeat_back_addr":"172.21.15.161:6830/14664","heartbeat_front_addr":"172.21.15.161:6827/14664","state":["exists","up"]},{"osd":1,"uuid":"bedce536-93d0-4197-ab10-de0a13a598e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":14673},{"type":"v1","addr":"172.21.15.161:6809","nonce":14673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":14673},{"type":"v1","addr":"172.21.15.161:6811","nonce":14673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":14673},{"type":"v1","addr":"172.21.15.161:6817","nonce":14673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":14673},{"type":"v1","addr":"172.21.15.161:6813","nonce":14673}]},"public_addr":"172.21.15.161:6809/14673","cluster_addr":"172.21.15.161:6811/14673","heartbeat_back_addr":"172.21.15.161:6817/14673","heartbeat_front_addr":"172.21.15.161:6813/14673","state":["exists","up"]},{"osd":2,"uuid":"9e56f2c4-17dc-46b4-bf8b-511dc51c3bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":14663},{"type":"v1","addr":"172.21.15.161:6801","nonce":14663}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":14663},{"type":"v1","addr":"172.21.15.161:6803","nonce":14663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":14663},{"type":"v1","addr":"172.21.15.161:6807","nonce":14663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":14663},{"type":"v1","addr":"172.21.15.161:6805","nonce":14663}]},"public_addr":"172.21.15.161:6801/14663","cluster_addr":"172.21.15.161:6803/14663","heartbeat_back_addr":"172.21.15.161:6807/14663","heartbeat_front_addr":"172.21.15.161:6805/14663","state":["exists","up"]},{"osd":3,"uuid":"7f02c681-34ee-48ab-bac9-d70f4ab31cec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":14682},{"type":"v1","addr":"172.21.15.161:6819","nonce":14682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6821","nonce":14682},{"type":"v1","addr":"172.21.15.161:6823","nonce":14682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":14682},{"type":"v1","addr":"172.21.15.161:6831","nonce":14682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":14682},{"type":"v1","addr":"172.21.15.161:6826","nonce":14682}]},"public_addr":"172.21.15.161:6819/14682","cluster_addr":"172.21.15.161:6823/14682","heartbeat_back_addr":"172.21.15.161:6831/14682","heartbeat_front_addr":"172.21.15.161:6826/14682","state":["exists","up"]},{"osd":4,"uuid":"f03f7266-583f-41cb-a70b-da2c3d4f11fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":14935},{"type":"v1","addr":"172.21.15.186:6811","nonce":14935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6813","nonce":14935},{"type":"v1","addr":"172.21.15.186:6815","nonce":14935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6821","nonce":14935},{"type":"v1","addr":"172.21.15.186:6823","nonce":14935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6817","nonce":14935},{"type":"v1","addr":"172.21.15.186:6819","nonce":14935}]},"public_addr":"172.21.15.186:6811/14935","cluster_addr":"172.21.15.186:6815/14935","heartbeat_back_addr":"172.21.15.186:6823/14935","heartbeat_front_addr":"172.21.15.186:6819/14935","state":["exists","up"]},{"osd":5,"uuid":"6baffc6e-5a02-4a37-90ba-b221ecd507cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6809","nonce":14934},{"type":"v1","addr":"172.21.15.186:6810","nonce":14934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":14934},{"type":"v1","addr":"172.21.15.186:6814","nonce":14934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":14934},{"type":"v1","addr":"172.21.15.186:6822","nonce":14934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":14934},{"type":"v1","addr":"172.21.15.186:6818","nonce":14934}]},"public_addr":"172.21.15.186:6810/14934","cluster_addr":"172.21.15.186:6814/14934","heartbeat_back_addr":"172.21.15.186:6822/14934","heartbeat_front_addr":"172.21.15.186:6818/14934","state":["exists","up"]},{"osd":6,"uuid":"4dd5d302-e0a8-4ae2-a2af-f8ddf9928f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":14936},{"type":"v1","addr":"172.21.15.186:6801","nonce":14936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":14936},{"type":"v1","addr":"172.21.15.186:6803","nonce":14936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":14936},{"type":"v1","addr":"172.21.15.186:6807","nonce":14936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":14936},{"type":"v1","addr":"172.21.15.186:6805","nonce":14936}]},"public_addr":"172.21.15.186:6801/14936","cluster_addr":"172.21.15.186:6803/14936","heartbeat_back_addr":"172.21.15.186:6807/14936","heartbeat_front_addr":"172.21.15.186:6805/14936","state":["exists","up"]},{"osd":7,"uuid":"9625c4a8-73ac-43e1-9eee-758543842754","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":14945},{"type":"v1","addr":"172.21.15.186:6825","nonce":14945}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":14945},{"type":"v1","addr":"172.21.15.186:6827","nonce":14945}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":14945},{"type":"v1","addr":"172.21.15.186:6831","nonce":14945}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":14945},{"type":"v1","addr":"172.21.15.186:6829","nonce":14945}]},"public_addr":"172.21.15.186:6825/14945","cluster_addr":"172.21.15.186:6827/14945","heartbeat_back_addr":"172.21.15.186:6831/14945","heartbeat_front_addr":"172.21.15.186:6829/14945","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.103567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.851219+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.024480+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.090642+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.017969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.107489+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:39.853995+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T11:38:40.169679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:04:36.031 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 msgr2=0x7fbad0057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:36.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 0x7fbad0057c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fbaec0017b0 tx=0x7fbaec007040).stop 2020-11-20T12:04:36.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 msgr2=0x7fbaf40ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:36.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbae4000f20 tx=0x7fbae4016000).stop 2020-11-20T12:04:36.032 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 shutdown_connections 2020-11-20T12:04:36.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fbad00557c0 0x7fbad0057c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:36.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf4148df0 0x7fbaf4149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:36.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad40044e0 0x7fbaf40acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:36.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 --2- 172.21.15.161:0/2225712959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbaf40a1e90 0x7fbaf40ad880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:36.033 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 >> 172.21.15.161:0/2225712959 conn(0x7fbaf4061260 msgr2=0x7fbaf4134310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 shutdown_connections 2020-11-20T12:04:36.034 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:36.022+0000 7fbae97fa700 1 -- 172.21.15.161:0/2225712959 wait complete. 2020-11-20T12:04:37.044 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T12:04:37.045 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:37.184 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.174+0000 7ff0f0a98700 1 Processor -- start 2020-11-20T12:04:37.185 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.174+0000 7ff0f0a98700 1 -- start start 2020-11-20T12:04:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0ec061400 0x7ff0ec0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.187 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec0a5b60 con 0x7ff0ec13ad40 2020-11-20T12:04:37.188 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec0a99c0 con 0x7ff0ec061400 2020-11-20T12:04:37.188 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0a9c50 con 0x7ff0ec0a7510 2020-11-20T12:04:37.188 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0ec061400 0x7ff0ec0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.188 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0ec061400 0x7ff0ec0a5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37560/0 (socket says 172.21.15.161:37560) 2020-11-20T12:04:37.188 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0ebfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff0ec13ad40 0x7ff0ec0a0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47806/0 (socket says 172.21.15.161:47806) 2020-11-20T12:04:37.189 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 -- 172.21.15.161:0/2340253001 learned_addr learned my addr 172.21.15.161:0/2340253001 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:37.189 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eaffd700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.189 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 -- 172.21.15.161:0/2340253001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 msgr2=0x7ff0ec0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:37.189 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 -- 172.21.15.161:0/2340253001 >> v1:172.21.15.161:6789/0 conn(0x7ff0ec13ad40 legacy=0x7ff0ec0a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 -- 172.21.15.161:0/2340253001 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0a51d0 con 0x7ff0ec061400 2020-11-20T12:04:37.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0ea7fc700 1 -- 172.21.15.161:0/2340253001 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707314965 0 0) 0x7ff0ec0a5b60 con 0x7ff0ec13ad40 2020-11-20T12:04:37.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec061400 0x7ff0ec0a5670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0d4006fd0 tx=0x7ff0d4006eb0).ready entity=mon.0 client_cookie=43dea3918c1008c6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0ea7fc700 1 -- 172.21.15.161:0/2340253001 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009810 con 0x7ff0ec061400 2020-11-20T12:04:37.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0ea7fc700 1 -- 172.21.15.161:0/2340253001 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d4009970 con 0x7ff0ec061400 2020-11-20T12:04:37.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0ea7fc700 1 -- 172.21.15.161:0/2340253001 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009cf0 con 0x7ff0ec061400 2020-11-20T12:04:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- 172.21.15.161:0/2340253001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec061400 msgr2=0x7ff0ec0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec061400 0x7ff0ec0a5670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff0d4006fd0 tx=0x7ff0d4006eb0).stop 2020-11-20T12:04:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- 172.21.15.161:0/2340253001 shutdown_connections 2020-11-20T12:04:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec061400 0x7ff0ec0a5670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/2340253001 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- 172.21.15.161:0/2340253001 >> 172.21.15.161:0/2340253001 conn(0x7ff0ec0ad590 msgr2=0x7ff0ec0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- 172.21.15.161:0/2340253001 shutdown_connections 2020-11-20T12:04:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.178+0000 7ff0f0a98700 1 -- 172.21.15.161:0/2340253001 wait complete. 2020-11-20T12:04:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 Processor -- start 2020-11-20T12:04:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- start start 2020-11-20T12:04:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec061400 0x7ff0ec137200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec066a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 0x7ff0ec14a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec0679f0 con 0x7ff0ec13ad40 2020-11-20T12:04:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec066640 con 0x7ff0ec061400 2020-11-20T12:04:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec149b20 con 0x7ff0ec0a7510 2020-11-20T12:04:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 0x7ff0ec14a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 0x7ff0ec14a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37570/0 (socket says 172.21.15.161:37570) 2020-11-20T12:04:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 -- 172.21.15.161:0/606546439 learned_addr learned my addr 172.21.15.161:0/606546439 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0eaffd700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec066a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec061400 0x7ff0ec137200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 -- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 msgr2=0x7ff0ec066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff0ec0a7510 0x7ff0ec066a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 -- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec061400 msgr2=0x7ff0ec137200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec061400 0x7ff0ec137200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0a2270 con 0x7ff0ec13ad40 2020-11-20T12:04:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff0ec061400 0x7ff0ec137200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0ebfff700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 0x7ff0ec14a080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff0e4007a20 tx=0x7ff0e4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4005ac0 con 0x7ff0ec13ad40 2020-11-20T12:04:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4005c20 con 0x7ff0ec13ad40 2020-11-20T12:04:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4007110 con 0x7ff0ec13ad40 2020-11-20T12:04:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec0a2510 con 0x7ff0ec13ad40 2020-11-20T12:04:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.182+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec0a1e40 con 0x7ff0ec13ad40 2020-11-20T12:04:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0ec0a20c0 con 0x7ff0ec13ad40 2020-11-20T12:04:37.204 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7ff0e4007480 con 0x7ff0ec13ad40 2020-11-20T12:04:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff0c80557c0 0x7ff0c8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.206 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff0e4070900 con 0x7ff0ec13ad40 2020-11-20T12:04:37.206 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff0c80557c0 0x7ff0c8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.206 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7ff0c805d3a0 0x7ff0c805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.206 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0c805fe20 con 0x7ff0c805d3a0 2020-11-20T12:04:37.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0e4075220 con 0x7ff0ec13ad40 2020-11-20T12:04:37.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0eaffd700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7ff0c805d3a0 0x7ff0c805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0eb7fe700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff0c80557c0 0x7ff0c8057c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff0d400b1b0 tx=0x7ff0d4015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0eaffd700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7ff0c805d3a0 0x7ff0c805f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.207 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.186+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== osd.0 v2:172.21.15.161:6815/14664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7ff0c805fe20 con 0x7ff0c805d3a0 2020-11-20T12:04:37.215 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 --> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff0ec0667d0 con 0x7ff0c805d3a0 2020-11-20T12:04:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0e37fe700 1 -- 172.21.15.161:0/606546439 <== osd.0 v2:172.21.15.161:6815/14664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff0dc00cb50 con 0x7ff0c805d3a0 2020-11-20T12:04:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7ff0c805d3a0 msgr2=0x7ff0c805f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.216 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6815/14664,v1:172.21.15.161:6818/14664] conn(0x7ff0c805d3a0 0x7ff0c805f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff0c80557c0 msgr2=0x7ff0c8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff0c80557c0 0x7ff0c8057c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff0d400b1b0 tx=0x7ff0d4015000).stop 2020-11-20T12:04:37.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 msgr2=0x7ff0ec14a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.217 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 --2- 172.21.15.161:0/606546439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0ec13ad40 0x7ff0ec14a080 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7ff0e4007a20 tx=0x7ff0e4007db0).stop 2020-11-20T12:04:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0ebfff700 1 -- 172.21.15.161:0/606546439 reap_dead start 2020-11-20T12:04:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 shutdown_connections 2020-11-20T12:04:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 >> 172.21.15.161:0/606546439 conn(0x7ff0ec0ad590 msgr2=0x7ff0ec09f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 shutdown_connections 2020-11-20T12:04:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.206+0000 7ff0f0a98700 1 -- 172.21.15.161:0/606546439 wait complete. 2020-11-20T12:04:37.219 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:37.219 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:37.219 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:37.233 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T12:04:37.350 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 Processor -- start 2020-11-20T12:04:37.351 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 -- start start 2020-11-20T12:04:37.353 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2d00af0c0 0x7fd2d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.353 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd2d00a69c0 0x7fd2d0135eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.353 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d00a9bb0 con 0x7fd2d00a2940 2020-11-20T12:04:37.354 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00a9f70 con 0x7fd2d00af0c0 2020-11-20T12:04:37.354 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6941700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00aa210 con 0x7fd2d00a69c0 2020-11-20T12:04:37.354 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2d00af0c0 0x7fd2d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.355 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d513e700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd2d00a2940 0x7fd2d01357a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47820/0 (socket says 172.21.15.161:47820) 2020-11-20T12:04:37.355 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d513e700 1 -- 172.21.15.161:0/4235592420 learned_addr learned my addr 172.21.15.161:0/4235592420 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:37.355 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d6140700 1 --2- 172.21.15.161:0/4235592420 >> v2:172.21.15.186:3300/0 conn(0x7fd2d00a69c0 0x7fd2d0135eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.355 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d493d700 1 -- 172.21.15.161:0/4235592420 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665789520 0 0) 0x7fd2d00a9bb0 con 0x7fd2d00a2940 2020-11-20T12:04:37.355 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d493d700 1 -- 172.21.15.161:0/4235592420 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b8003240 con 0x7fd2d00a2940 2020-11-20T12:04:37.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 -- 172.21.15.161:0/4235592420 >> v2:172.21.15.186:3300/0 conn(0x7fd2d00a69c0 msgr2=0x7fd2d0135eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:37.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 --2- 172.21.15.161:0/4235592420 >> v2:172.21.15.186:3300/0 conn(0x7fd2d00a69c0 0x7fd2d0135eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 -- 172.21.15.161:0/4235592420 >> v1:172.21.15.161:6789/0 conn(0x7fd2d00a2940 legacy=0x7fd2d01357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.356 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 -- 172.21.15.161:0/4235592420 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d00aa4b0 con 0x7fd2d00af0c0 2020-11-20T12:04:37.357 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.342+0000 7fd2d593f700 1 --2- 172.21.15.161:0/4235592420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00af0c0 0x7fd2d0067630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd2d0066580 tx=0x7fd2cc006df0).ready entity=mon.0 client_cookie=b502d843c7801685 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d493d700 1 -- 172.21.15.161:0/4235592420 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc009640 con 0x7fd2d00af0c0 2020-11-20T12:04:37.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d493d700 1 -- 172.21.15.161:0/4235592420 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0097a0 con 0x7fd2d00af0c0 2020-11-20T12:04:37.364 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d493d700 1 -- 172.21.15.161:0/4235592420 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc009b20 con 0x7fd2d00af0c0 2020-11-20T12:04:37.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/4235592420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00af0c0 msgr2=0x7fd2d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- 172.21.15.161:0/4235592420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00af0c0 0x7fd2d0067630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd2d0066580 tx=0x7fd2cc006df0).stop 2020-11-20T12:04:37.365 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/4235592420 shutdown_connections 2020-11-20T12:04:37.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- 172.21.15.161:0/4235592420 >> v2:172.21.15.186:3300/0 conn(0x7fd2d00a69c0 0x7fd2d0135eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- 172.21.15.161:0/4235592420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00af0c0 0x7fd2d0067630 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.366 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/4235592420 >> 172.21.15.161:0/4235592420 conn(0x7fd2d00639f0 msgr2=0x7fd2d0063dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.367 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/4235592420 shutdown_connections 2020-11-20T12:04:37.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/4235592420 wait complete. 2020-11-20T12:04:37.369 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 Processor -- start 2020-11-20T12:04:37.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- start start 2020-11-20T12:04:37.370 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 0x7fd2d0147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.371 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d00af0c0 0x7fd2d009f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.372 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01474b0 con 0x7fd2d00a2940 2020-11-20T12:04:37.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01476a0 con 0x7fd2d00af0c0 2020-11-20T12:04:37.373 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0147940 con 0x7fd2d00a69c0 2020-11-20T12:04:37.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.374 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37582/0 (socket says 172.21.15.161:37582) 2020-11-20T12:04:37.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 -- 172.21.15.161:0/335217740 learned_addr learned my addr 172.21.15.161:0/335217740 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:37.375 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d513e700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 0x7fd2d0147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6140700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d00af0c0 0x7fd2d009f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.376 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 -- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 msgr2=0x7fd2d0147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 0x7fd2d0147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.377 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 -- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d00af0c0 msgr2=0x7fd2d009f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d00af0c0 0x7fd2d009f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 -- 172.21.15.161:0/335217740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d01482d0 con 0x7fd2d00a2940 2020-11-20T12:04:37.378 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d513e700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 0x7fd2d0147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:37.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d593f700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd2d005cae0 tx=0x7fd2cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc011cc0 con 0x7fd2d00a2940 2020-11-20T12:04:37.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc011e20 con 0x7fd2d00a2940 2020-11-20T12:04:37.379 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d0136640 con 0x7fd2d00a2940 2020-11-20T12:04:37.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc01e670 con 0x7fd2d00a2940 2020-11-20T12:04:37.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.346+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d009da80 con 0x7fd2d00a2940 2020-11-20T12:04:37.380 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.350+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d0069250 con 0x7fd2d00a2940 2020-11-20T12:04:37.381 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.350+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fd2cc025030 con 0x7fd2d00a2940 2020-11-20T12:04:37.381 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.350+0000 7fd2c1ffb700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 0x7fd2a8057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.382 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.350+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd2cc06fe90 con 0x7fd2d00a2940 2020-11-20T12:04:37.382 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.350+0000 7fd2d513e700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 0x7fd2a8057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.382 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.354+0000 7fd2d513e700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 0x7fd2a8057c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd2d00a5af0 tx=0x7fd2c4009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.384 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.354+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd2cc045b70 con 0x7fd2d00a2940 2020-11-20T12:04:37.515 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.506+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2d005cc70 con 0x7fd2a80557c0 2020-11-20T12:04:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.506+0000 7fd2c1ffb700 1 -- 172.21.15.161:0/335217740 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2d005cc70 con 0x7fd2a80557c0 2020-11-20T12:04:37.518 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 msgr2=0x7fd2a8057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.519 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 0x7fd2a8057c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fd2d00a5af0 tx=0x7fd2c4009040).stop 2020-11-20T12:04:37.519 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 msgr2=0x7fd2d00a5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.519 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fd2d005cae0 tx=0x7fd2cc015000).stop 2020-11-20T12:04:37.519 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 shutdown_connections 2020-11-20T12:04:37.519 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fd2a80557c0 0x7fd2a8057c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.520 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2d00af0c0 0x7fd2d009f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.520 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2d00a2940 0x7fd2d00a5360 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.520 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 --2- 172.21.15.161:0/335217740 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd2d00a69c0 0x7fd2d0147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.520 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 >> 172.21.15.161:0/335217740 conn(0x7fd2d00639f0 msgr2=0x7fd2d0067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.520 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 shutdown_connections 2020-11-20T12:04:37.521 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.510+0000 7fd2d6941700 1 -- 172.21.15.161:0/335217740 wait complete. 2020-11-20T12:04:37.521 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T12:04:37.532 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T12:04:37.533 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:37.660 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.650+0000 7fc0a359e700 1 Processor -- start 2020-11-20T12:04:37.661 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.650+0000 7fc0a359e700 1 -- start start 2020-11-20T12:04:37.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc0a40adcf0 0x7fc0a413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a4138090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40a9540 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.663 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a4060710 con 0x7fc0a40adcf0 2020-11-20T12:04:37.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40609b0 con 0x7fc0a4137c50 2020-11-20T12:04:37.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a1d9b700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc0a40ae0d0 0x7fc0a40a8e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47832/0 (socket says 172.21.15.161:47832) 2020-11-20T12:04:37.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a1d9b700 1 -- 172.21.15.161:0/3072811395 learned_addr learned my addr 172.21.15.161:0/3072811395 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:37.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a2d9d700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a4138090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.664 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3072811395 >> v2:172.21.15.186:3300/0 conn(0x7fc0a40adcf0 0x7fc0a413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.665 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022365394 0 0) 0x7fc0a40a9540 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.665 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc088003240 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.666 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 -- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 msgr2=0x7fc0a4138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:37.666 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a4138090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 -- 172.21.15.161:0/3072811395 >> v1:172.21.15.161:6789/0 conn(0x7fc0a40ae0d0 legacy=0x7fc0a40a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4106152616 0 0) 0x7fc088003240 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 -- 172.21.15.161:0/3072811395 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4066860 con 0x7fc0a40adcf0 2020-11-20T12:04:37.668 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a2d9d700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a4138090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:37.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a413a9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc09800b9a0 tx=0x7fc098006df0).ready entity=mon.1 client_cookie=d7dff0fc7f104c69 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940014e0 con 0x7fc0a40adcf0 2020-11-20T12:04:37.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098011400 con 0x7fc0a40adcf0 2020-11-20T12:04:37.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a159a700 1 -- 172.21.15.161:0/3072811395 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098011780 con 0x7fc0a40adcf0 2020-11-20T12:04:37.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 msgr2=0x7fc0a413a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a413a9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc09800b9a0 tx=0x7fc098006df0).stop 2020-11-20T12:04:37.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- 172.21.15.161:0/3072811395 shutdown_connections 2020-11-20T12:04:37.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a413a9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3072811395 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a4138090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- 172.21.15.161:0/3072811395 >> 172.21.15.161:0/3072811395 conn(0x7fc0a4062730 msgr2=0x7fc0a4062b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- 172.21.15.161:0/3072811395 shutdown_connections 2020-11-20T12:04:37.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.654+0000 7fc0a359e700 1 -- 172.21.15.161:0/3072811395 wait complete. 2020-11-20T12:04:37.674 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 Processor -- start 2020-11-20T12:04:37.674 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 -- start start 2020-11-20T12:04:37.674 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a40a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.674 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 0x7fc0a40a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.675 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.675 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40a2730 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.675 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40a2c90 con 0x7fc0a40adcf0 2020-11-20T12:04:37.675 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40a2f30 con 0x7fc0a4137c50 2020-11-20T12:04:37.675 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a1d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 0x7fc0a40a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.676 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a1d9b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 0x7fc0a40a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37598/0 (socket says 172.21.15.161:37598) 2020-11-20T12:04:37.676 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a1d9b700 1 -- 172.21.15.161:0/3976894838 learned_addr learned my addr 172.21.15.161:0/3976894838 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:37.676 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a2d9d700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.676 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.658+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a40a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 -- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 msgr2=0x7fc0a414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc0a4137c50 0x7fc0a414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 -- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 msgr2=0x7fc0a40a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc0a40adcf0 0x7fc0a40a20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a414d4c0 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a1d9b700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 0x7fc0a40a4c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc09400cae0 tx=0x7fc094001e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094007170 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0940072d0 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a413bb80 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400a960 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.679 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a40a33d0 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.679 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fc094010070 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.679 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0a4044f60 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.679 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc0780557c0 0x7fc078057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.679 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc09406e1b0 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.680 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc0780557c0 0x7fc078057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.680 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7fc07805d3a0 0x7fc07805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.680 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc07805fe20 con 0x7fc07805d3a0 2020-11-20T12:04:37.680 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc094070820 con 0x7fc0a40ae0d0 2020-11-20T12:04:37.680 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a259c700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc0780557c0 0x7fc078057c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc09800d260 tx=0x7fc098013000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.681 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.662+0000 7fc0a2d9d700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7fc07805d3a0 0x7fc07805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.681 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.666+0000 7fc0a2d9d700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7fc07805d3a0 0x7fc07805f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.681 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.666+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== osd.1 v2:172.21.15.161:6808/14673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fc07805fe20 con 0x7fc07805d3a0 2020-11-20T12:04:37.688 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 --> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc0a4141430 con 0x7fc07805d3a0 2020-11-20T12:04:37.689 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0927fc700 1 -- 172.21.15.161:0/3976894838 <== osd.1 v2:172.21.15.161:6808/14673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc0a4141430 con 0x7fc07805d3a0 2020-11-20T12:04:37.689 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7fc07805d3a0 msgr2=0x7fc07805f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.689 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6808/14673,v1:172.21.15.161:6809/14673] conn(0x7fc07805d3a0 0x7fc07805f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc0780557c0 msgr2=0x7fc078057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fc0780557c0 0x7fc078057c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fc09800d260 tx=0x7fc098013000).stop 2020-11-20T12:04:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 msgr2=0x7fc0a40a4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 --2- 172.21.15.161:0/3976894838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40ae0d0 0x7fc0a40a4c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc09400cae0 tx=0x7fc094001e50).stop 2020-11-20T12:04:37.690 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a2d9d700 1 -- 172.21.15.161:0/3976894838 reap_dead start 2020-11-20T12:04:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 shutdown_connections 2020-11-20T12:04:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 >> 172.21.15.161:0/3976894838 conn(0x7fc0a4062730 msgr2=0x7fc0a40ac660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 shutdown_connections 2020-11-20T12:04:37.691 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.678+0000 7fc0a359e700 1 -- 172.21.15.161:0/3976894838 wait complete. 2020-11-20T12:04:37.692 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:37.692 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:37.692 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:37.703 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T12:04:37.829 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.818+0000 7f9f60a7b700 1 Processor -- start 2020-11-20T12:04:37.829 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.818+0000 7f9f60a7b700 1 -- start start 2020-11-20T12:04:37.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c0addd0 0x7f9f5c0a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9f5c0ae1b0 0x7f9f5c0678e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c13ddd0 con 0x7f9f5c060d40 2020-11-20T12:04:37.831 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a9400 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a9690 con 0x7f9f5c0addd0 2020-11-20T12:04:37.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5bfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9f5c060d40 0x7f9f5c13e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47852/0 (socket says 172.21.15.161:47852) 2020-11-20T12:04:37.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5bfff700 1 -- 172.21.15.161:0/2873075939 learned_addr learned my addr 172.21.15.161:0/2873075939 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:37.832 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 --2- 172.21.15.161:0/2873075939 >> v2:172.21.15.186:3300/0 conn(0x7f9f5c0ae1b0 0x7f9f5c0678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.833 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5b7fe700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c0addd0 0x7f9f5c0a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.833 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5a7fc700 1 -- 172.21.15.161:0/2873075939 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254617862 0 0) 0x7f9f5c13ddd0 con 0x7f9f5c060d40 2020-11-20T12:04:37.833 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5a7fc700 1 -- 172.21.15.161:0/2873075939 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f48003240 con 0x7f9f5c060d40 2020-11-20T12:04:37.835 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 -- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c0addd0 msgr2=0x7f9f5c0a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:37.835 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c0addd0 0x7f9f5c0a8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.835 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 -- 172.21.15.161:0/2873075939 >> v1:172.21.15.161:6789/0 conn(0x7f9f5c060d40 legacy=0x7f9f5c13e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.836 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 -- 172.21.15.161:0/2873075939 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0a9930 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.836 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5affd700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c0678e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f5000b9a0 tx=0x7f9f50006df0).ready entity=mon.1 client_cookie=58c6c57ce0856ecb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.836 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5a7fc700 1 -- 172.21.15.161:0/2873075939 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50009680 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.836 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5a7fc700 1 -- 172.21.15.161:0/2873075939 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500097e0 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.837 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f5a7fc700 1 -- 172.21.15.161:0/2873075939 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f50009b60 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.837 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0ae1b0 msgr2=0x7f9f5c0678e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.837 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c0678e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f5000b9a0 tx=0x7f9f50006df0).stop 2020-11-20T12:04:37.837 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2873075939 shutdown_connections 2020-11-20T12:04:37.837 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c0addd0 0x7f9f5c0a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.838 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2873075939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c0678e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.838 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2873075939 >> 172.21.15.161:0/2873075939 conn(0x7f9f5c0627a0 msgr2=0x7f9f5c062b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:37.838 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2873075939 shutdown_connections 2020-11-20T12:04:37.839 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.822+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2873075939 wait complete. 2020-11-20T12:04:37.839 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 Processor -- start 2020-11-20T12:04:37.839 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- start start 2020-11-20T12:04:37.841 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 0x7f9f5c0a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.841 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 0x7f9f5c0a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.842 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.842 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c13d9e0 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.842 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a5660 con 0x7f9f5c0addd0 2020-11-20T12:04:37.842 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0a5900 con 0x7f9f5c060d40 2020-11-20T12:04:37.842 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.843 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37616/0 (socket says 172.21.15.161:37616) 2020-11-20T12:04:37.843 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 -- 172.21.15.161:0/2769513835 learned_addr learned my addr 172.21.15.161:0/2769513835 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:37.843 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5b7fe700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 0x7f9f5c0a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.843 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5affd700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 0x7f9f5c0a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.843 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 -- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 msgr2=0x7f9f5c0a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.844 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 0x7f9f5c0a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.844 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 -- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 msgr2=0x7f9f5c0a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.844 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 0x7f9f5c0a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:37.844 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 -- 172.21.15.161:0/2769513835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0a5ba0 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.845 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5b7fe700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 0x7f9f5c0a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:37.845 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5affd700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 0x7f9f5c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:37.845 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f5bfff700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9f5400ca60 tx=0x7f9f54007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.845 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54005b80 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.845 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f54005ce0 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.846 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54007320 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.846 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c0a5e40 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.846 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.826+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c0a7180 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.846 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c069250 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.847 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f9f54010030 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.847 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f3b7fe700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 0x7f9f34057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:37.847 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f5b7fe700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 0x7f9f34057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:37.847 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9f5406e780 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.847 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.830+0000 7f9f5b7fe700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 0x7f9f34057c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9f4c006fd0 tx=0x7f9f4c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:37.848 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.834+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9f540444c0 con 0x7f9f5c0ae1b0 2020-11-20T12:04:37.994 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.986+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f5c0a5fd0 con 0x7f9f340557c0 2020-11-20T12:04:37.994 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.986+0000 7f9f3b7fe700 1 -- 172.21.15.161:0/2769513835 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f5c0a5fd0 con 0x7f9f340557c0 2020-11-20T12:04:37.998 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 msgr2=0x7f9f34057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.999 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 0x7f9f34057c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f9f4c006fd0 tx=0x7f9f4c008040).stop 2020-11-20T12:04:37.999 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 msgr2=0x7f9f5c136ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:37.999 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9f5400ca60 tx=0x7f9f54007de0).stop 2020-11-20T12:04:37.999 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 shutdown_connections 2020-11-20T12:04:37.999 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f9f340557c0 0x7f9f34057c80 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0x7f9f4c006fd0 tx=0x7f9f4c008040).stop 2020-11-20T12:04:38.000 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f5c0ae1b0 0x7f9f5c136ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.000 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9f5c060d40 0x7f9f5c0a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.000 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 --2- 172.21.15.161:0/2769513835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f5c0addd0 0x7f9f5c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.001 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 >> 172.21.15.161:0/2769513835 conn(0x7f9f5c0627a0 msgr2=0x7f9f5c066360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.001 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 shutdown_connections 2020-11-20T12:04:38.001 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:37.990+0000 7f9f60a7b700 1 -- 172.21.15.161:0/2769513835 wait complete. 2020-11-20T12:04:38.002 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T12:04:38.014 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T12:04:38.014 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:38.140 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 Processor -- start 2020-11-20T12:04:38.140 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 -- start start 2020-11-20T12:04:38.142 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 0x7f840413a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.143 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 0x7f84040a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.143 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8404060710 con 0x7f84040a9320 2020-11-20T12:04:38.143 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84040609b0 con 0x7f84040ae0d0 2020-11-20T12:04:38.143 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8408e9e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8404138360 con 0x7f84040adcf0 2020-11-20T12:04:38.144 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8403fff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f84040a9320 0x7f8404137c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47866/0 (socket says 172.21.15.161:47866) 2020-11-20T12:04:38.144 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8403fff700 1 -- 172.21.15.161:0/792243072 learned_addr learned my addr 172.21.15.161:0/792243072 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:38.144 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f84037fe700 1 --2- 172.21.15.161:0/792243072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 0x7f840413a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.144 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f8402ffd700 1 --2- 172.21.15.161:0/792243072 >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 0x7f84040a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.144 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f84027fc700 1 -- 172.21.15.161:0/792243072 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500702225 0 0) 0x7f8404060710 con 0x7f84040a9320 2020-11-20T12:04:38.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.130+0000 7f84027fc700 1 -- 172.21.15.161:0/792243072 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e4003240 con 0x7f84040a9320 2020-11-20T12:04:38.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/792243072 >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 msgr2=0x7f84040a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:38.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- 172.21.15.161:0/792243072 >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 0x7f84040a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/792243072 >> v1:172.21.15.161:6789/0 conn(0x7f84040a9320 legacy=0x7f8404137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.145 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/792243072 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404066860 con 0x7f84040adcf0 2020-11-20T12:04:38.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8402ffd700 1 --2- 172.21.15.161:0/792243072 >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 0x7f84040a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:38.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- 172.21.15.161:0/792243072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 0x7f840413a9a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f83fc00b9a0 tx=0x7f83fc006df0).ready entity=mon.2 client_cookie=e28307a306cc5899 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84027fc700 1 -- 172.21.15.161:0/792243072 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc009680 con 0x7f84040adcf0 2020-11-20T12:04:38.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84027fc700 1 -- 172.21.15.161:0/792243072 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc0097e0 con 0x7f84040adcf0 2020-11-20T12:04:38.146 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84027fc700 1 -- 172.21.15.161:0/792243072 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc009b60 con 0x7f84040adcf0 2020-11-20T12:04:38.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- 172.21.15.161:0/792243072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 msgr2=0x7f840413a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- 172.21.15.161:0/792243072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 0x7f840413a9a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f83fc00b9a0 tx=0x7f83fc006df0).stop 2020-11-20T12:04:38.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- 172.21.15.161:0/792243072 shutdown_connections 2020-11-20T12:04:38.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- 172.21.15.161:0/792243072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040adcf0 0x7f840413a9a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.147 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- 172.21.15.161:0/792243072 >> v2:172.21.15.186:3300/0 conn(0x7f84040ae0d0 0x7f84040a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.148 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- 172.21.15.161:0/792243072 >> 172.21.15.161:0/792243072 conn(0x7f8404062730 msgr2=0x7f8404062b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.148 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- 172.21.15.161:0/792243072 shutdown_connections 2020-11-20T12:04:38.148 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- 172.21.15.161:0/792243072 wait complete. 2020-11-20T12:04:38.151 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 Processor -- start 2020-11-20T12:04:38.151 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- start start 2020-11-20T12:04:38.151 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 0x7f84040a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.151 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040ae0d0 0x7f84040a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.152 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840413e110 0x7f8404149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.152 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840413e690 con 0x7f84040adcf0 2020-11-20T12:04:38.152 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840413e930 con 0x7f840413e110 2020-11-20T12:04:38.152 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8408e9e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840413ebd0 con 0x7f84040ae0d0 2020-11-20T12:04:38.152 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 0x7f84040a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.153 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 0x7f84040a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37626/0 (socket says 172.21.15.161:37626) 2020-11-20T12:04:38.153 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/352471361 learned_addr learned my addr 172.21.15.161:0/352471361 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.153 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8402ffd700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040ae0d0 0x7f84040a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.153 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f8403fff700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840413e110 0x7f8404149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.154 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040ae0d0 msgr2=0x7f84040a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.154 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84040ae0d0 0x7f84040a2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.154 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840413e110 msgr2=0x7f8404149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.154 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f840413e110 0x7f8404149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.154 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.134+0000 7f84037fe700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040a2af0 con 0x7f84040adcf0 2020-11-20T12:04:38.155 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f84037fe700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 0x7f84040a40a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f83fc009380 tx=0x7f83fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.155 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc011cc0 con 0x7f84040adcf0 2020-11-20T12:04:38.155 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc011e20 con 0x7f84040adcf0 2020-11-20T12:04:38.155 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840414a220 con 0x7f84040adcf0 2020-11-20T12:04:38.155 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc01d660 con 0x7f84040adcf0 2020-11-20T12:04:38.156 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840414a680 con 0x7f84040adcf0 2020-11-20T12:04:38.156 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8404044f60 con 0x7f84040adcf0 2020-11-20T12:04:38.156 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f83fc024030 con 0x7f84040adcf0 2020-11-20T12:04:38.156 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f83e00557c0 0x7f83e0057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f83fc070270 con 0x7f84040adcf0 2020-11-20T12:04:38.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8402ffd700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f83e00557c0 0x7f83e0057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f83e005d3a0 0x7f83e005f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.157 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83e005fe20 con 0x7f83e005d3a0 2020-11-20T12:04:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83fc070670 con 0x7f84040adcf0 2020-11-20T12:04:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8403fff700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f83e005d3a0 0x7f83e005f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.138+0000 7f8402ffd700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f83e00557c0 0x7f83e0057c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f84040a8380 tx=0x7f83ec006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.142+0000 7f8403fff700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f83e005d3a0 0x7f83e005f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.142+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== osd.2 v2:172.21.15.161:6800/14663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f83e005fe20 con 0x7f83e005d3a0 2020-11-20T12:04:38.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 --> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84040a9560 con 0x7f83e005d3a0 2020-11-20T12:04:38.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f83fb7fe700 1 -- 172.21.15.161:0/352471361 <== osd.2 v2:172.21.15.161:6800/14663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84040a9560 con 0x7f83e005d3a0 2020-11-20T12:04:38.168 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:38.168 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:38.168 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:38.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f83e005d3a0 msgr2=0x7f83e005f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6800/14663,v1:172.21.15.161:6801/14663] conn(0x7f83e005d3a0 0x7f83e005f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f83e00557c0 msgr2=0x7f83e0057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f83e00557c0 0x7f83e0057c80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f84040a8380 tx=0x7f83ec006df0).stop 2020-11-20T12:04:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 msgr2=0x7f84040a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 --2- 172.21.15.161:0/352471361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84040adcf0 0x7f84040a40a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f83fc009380 tx=0x7f83fc015000).stop 2020-11-20T12:04:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8403fff700 1 -- 172.21.15.161:0/352471361 reap_dead start 2020-11-20T12:04:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 shutdown_connections 2020-11-20T12:04:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 >> 172.21.15.161:0/352471361 conn(0x7f8404062730 msgr2=0x7f84040aa6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 shutdown_connections 2020-11-20T12:04:38.172 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.158+0000 7f8408e9e700 1 -- 172.21.15.161:0/352471361 wait complete. 2020-11-20T12:04:38.184 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T12:04:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.306+0000 7f43552e5700 1 Processor -- start 2020-11-20T12:04:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.306+0000 7f43552e5700 1 -- start start 2020-11-20T12:04:38.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4350061300 0x7f4350136da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4350067180 0x7f4350068200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f43500a91a0 0x7f43500a9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350067600 con 0x7f4350067180 2020-11-20T12:04:38.320 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43500a9b40 con 0x7f43500a91a0 2020-11-20T12:04:38.320 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4350067820 con 0x7f4350061300 2020-11-20T12:04:38.321 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4350067180 0x7f4350068200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.321 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434effd700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4350061300 0x7f4350136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.321 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4350067180 0x7f4350068200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37638/0 (socket says 172.21.15.161:37638) 2020-11-20T12:04:38.321 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 -- 172.21.15.161:0/2455880817 learned_addr learned my addr 172.21.15.161:0/2455880817 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434f7fe700 1 --2- 172.21.15.161:0/2455880817 >> v2:172.21.15.186:3300/0 conn(0x7f43500a91a0 0x7f43500a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 -- 172.21.15.161:0/2455880817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4350061300 msgr2=0x7f4350136da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:38.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 --2- 172.21.15.161:0/2455880817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4350061300 0x7f4350136da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.322 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 -- 172.21.15.161:0/2455880817 >> v2:172.21.15.186:3300/0 conn(0x7f43500a91a0 msgr2=0x7f43500a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:38.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 --2- 172.21.15.161:0/2455880817 >> v2:172.21.15.186:3300/0 conn(0x7f43500a91a0 0x7f43500a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 -- 172.21.15.161:0/2455880817 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350067d60 con 0x7f4350067180 2020-11-20T12:04:38.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434e7fc700 1 --2- 172.21.15.161:0/2455880817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f4350068200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4350064ba0 tx=0x7f4340006eb0).ready entity=mon.0 client_cookie=150c332b53b8719 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434dffb700 1 -- 172.21.15.161:0/2455880817 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340009720 con 0x7f4350067180 2020-11-20T12:04:38.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434dffb700 1 -- 172.21.15.161:0/2455880817 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4340009880 con 0x7f4350067180 2020-11-20T12:04:38.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f434dffb700 1 -- 172.21.15.161:0/2455880817 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340009c00 con 0x7f4350067180 2020-11-20T12:04:38.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- 172.21.15.161:0/2455880817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 msgr2=0x7f4350068200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- 172.21.15.161:0/2455880817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f4350068200 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f4350064ba0 tx=0x7f4340006eb0).stop 2020-11-20T12:04:38.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- 172.21.15.161:0/2455880817 shutdown_connections 2020-11-20T12:04:38.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- 172.21.15.161:0/2455880817 >> v2:172.21.15.186:3300/0 conn(0x7f43500a91a0 0x7f43500a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- 172.21.15.161:0/2455880817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4350061300 0x7f4350136da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 --2- 172.21.15.161:0/2455880817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f4350068200 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- 172.21.15.161:0/2455880817 >> 172.21.15.161:0/2455880817 conn(0x7f43500ae1b0 msgr2=0x7f43500aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- 172.21.15.161:0/2455880817 shutdown_connections 2020-11-20T12:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- 172.21.15.161:0/2455880817 wait complete. 2020-11-20T12:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 Processor -- start 2020-11-20T12:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.310+0000 7f43552e5700 1 -- start start 2020-11-20T12:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4350061300 0x7f43500a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43500a91a0 0x7f435014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a2fd0 con 0x7f4350067180 2020-11-20T12:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a2150 con 0x7f4350061300 2020-11-20T12:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500a23f0 con 0x7f43500a91a0 2020-11-20T12:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37646/0 (socket says 172.21.15.161:37646) 2020-11-20T12:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 -- 172.21.15.161:0/1530402463 learned_addr learned my addr 172.21.15.161:0/1530402463 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434effd700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4350061300 0x7f43500a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434f7fe700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43500a91a0 0x7f435014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 -- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43500a91a0 msgr2=0x7f435014d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43500a91a0 0x7f435014d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 -- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4350061300 msgr2=0x7f43500a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4350061300 0x7f43500a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 -- 172.21.15.161:0/1530402463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43500a2690 con 0x7f4350067180 2020-11-20T12:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f434e7fc700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4340010000 tx=0x7f4340015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340011c40 con 0x7f4350067180 2020-11-20T12:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4340011da0 con 0x7f4350067180 2020-11-20T12:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434001e690 con 0x7f4350067180 2020-11-20T12:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43500a1dd0 con 0x7f4350067180 2020-11-20T12:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435013ad20 con 0x7f4350067180 2020-11-20T12:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43500a1fc0 con 0x7f4350067180 2020-11-20T12:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.314+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f4340025030 con 0x7f4350067180 2020-11-20T12:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.318+0000 7f4336ffd700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 0x7f432c057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.318+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f434006fe30 con 0x7f4350067180 2020-11-20T12:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.318+0000 7f434effd700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 0x7f432c057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.318+0000 7f434effd700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 0x7f432c057cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f434400cc60 tx=0x7f4344008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.322+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4340045ca0 con 0x7f4350067180 2020-11-20T12:04:38.490 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.482+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f43500a2820 con 0x7f432c0557f0 2020-11-20T12:04:38.491 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.482+0000 7f4336ffd700 1 -- 172.21.15.161:0/1530402463 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43500a2820 con 0x7f432c0557f0 2020-11-20T12:04:38.493 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 msgr2=0x7f432c057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 0x7f432c057cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f434400cc60 tx=0x7f4344008040).stop 2020-11-20T12:04:38.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 msgr2=0x7f435014cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f4340010000 tx=0x7f4340015000).stop 2020-11-20T12:04:38.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 shutdown_connections 2020-11-20T12:04:38.494 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f432c0557f0 0x7f432c057cb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f43500a91a0 0x7f435014d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4350061300 0x7f43500a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 --2- 172.21.15.161:0/1530402463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4350067180 0x7f435014cc90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.495 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 >> 172.21.15.161:0/1530402463 conn(0x7f43500ae1b0 msgr2=0x7f43500aa190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 shutdown_connections 2020-11-20T12:04:38.496 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.486+0000 7f43552e5700 1 -- 172.21.15.161:0/1530402463 wait complete. 2020-11-20T12:04:38.496 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T12:04:38.511 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T12:04:38.511 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:38.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.618+0000 7f461f0d1700 1 Processor -- start 2020-11-20T12:04:38.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.618+0000 7f461f0d1700 1 -- start start 2020-11-20T12:04:38.790 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461f0d1700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461f0d1700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f461814b770 0x7f4618151f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461f0d1700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46180a5140 con 0x7f46180a5b60 2020-11-20T12:04:38.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461f0d1700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46180a84b0 con 0x7f461814b770 2020-11-20T12:04:38.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461f0d1700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a8690 con 0x7f46180a5780 2020-11-20T12:04:38.791 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461d66e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f461814b770 0x7f4618151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461d66e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f461814b770 0x7f4618151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37654/0 (socket says 172.21.15.161:37654) 2020-11-20T12:04:38.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461d66e700 1 -- 172.21.15.161:0/3011538906 learned_addr learned my addr 172.21.15.161:0/3011538906 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f46177fe700 1 -- 172.21.15.161:0/3011538906 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904719132 0 0) 0x7f46180a5140 con 0x7f46180a5b60 2020-11-20T12:04:38.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.622+0000 7f461ce6d700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.792 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f46177fe700 1 -- 172.21.15.161:0/3011538906 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4600003220 con 0x7f46180a5b60 2020-11-20T12:04:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f461d66e700 1 -- 172.21.15.161:0/3011538906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 msgr2=0x7f46180a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f461d66e700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f461d66e700 1 -- 172.21.15.161:0/3011538906 >> v1:172.21.15.186:6789/0 conn(0x7f46180a5b60 legacy=0x7f461814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f461d66e700 1 -- 172.21.15.161:0/3011538906 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180a9420 con 0x7f461814b770 2020-11-20T12:04:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f461d66e700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f4618151f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4610009480 tx=0x7f4610006eb0).ready entity=mon.0 client_cookie=31e50f9723317d20 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f46177fe700 1 -- 172.21.15.161:0/3011538906 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610014b70 con 0x7f461814b770 2020-11-20T12:04:38.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f46177fe700 1 -- 172.21.15.161:0/3011538906 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610014cd0 con 0x7f461814b770 2020-11-20T12:04:38.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.782+0000 7f46177fe700 1 -- 172.21.15.161:0/3011538906 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000b830 con 0x7f461814b770 2020-11-20T12:04:38.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- 172.21.15.161:0/3011538906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 msgr2=0x7f4618151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f4618151f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f4610009480 tx=0x7f4610006eb0).stop 2020-11-20T12:04:38.803 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- 172.21.15.161:0/3011538906 shutdown_connections 2020-11-20T12:04:38.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f4618151f40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 --2- 172.21.15.161:0/3011538906 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- 172.21.15.161:0/3011538906 >> 172.21.15.161:0/3011538906 conn(0x7f4618064610 msgr2=0x7f4618060150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- 172.21.15.161:0/3011538906 shutdown_connections 2020-11-20T12:04:38.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- 172.21.15.161:0/3011538906 wait complete. 2020-11-20T12:04:38.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 Processor -- start 2020-11-20T12:04:38.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.786+0000 7f461f0d1700 1 -- start start 2020-11-20T12:04:38.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46180a5b60 0x7f461809f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f461809fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a01e0 con 0x7f461814b770 2020-11-20T12:04:38.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a28c0 con 0x7f46180a5b60 2020-11-20T12:04:38.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46180a2b60 con 0x7f46180a5780 2020-11-20T12:04:38.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f461809fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f461809fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37660/0 (socket says 172.21.15.161:37660) 2020-11-20T12:04:38.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461ce6d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 -- 172.21.15.161:0/2371234099 learned_addr learned my addr 172.21.15.161:0/2371234099 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f4617fff700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46180a5b60 0x7f461809f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 -- 172.21.15.161:0/2371234099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 msgr2=0x7f46180a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f46180a5780 0x7f46180a0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 -- 172.21.15.161:0/2371234099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46180a5b60 msgr2=0x7f461809f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46180a5b60 0x7f461809f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46180a2e00 con 0x7f461814b770 2020-11-20T12:04:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461d66e700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f461809fcf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4610006ef0 tx=0x7f461001c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610024070 con 0x7f461814b770 2020-11-20T12:04:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461807f440 con 0x7f461814b770 2020-11-20T12:04:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461001cb60 con 0x7f461814b770 2020-11-20T12:04:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610014b70 con 0x7f461814b770 2020-11-20T12:04:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.790+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46180a38b0 con 0x7f461814b770 2020-11-20T12:04:38.816 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4618069250 con 0x7f461814b770 2020-11-20T12:04:38.817 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f461001b590 con 0x7f461814b770 2020-11-20T12:04:38.817 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f45f00557c0 0x7f45f0057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.817 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4610014e40 con 0x7f461814b770 2020-11-20T12:04:38.817 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f461ce6d700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f45f00557c0 0x7f45f0057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.818 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f45f005d320 0x7f45f005f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.818 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45f005fda0 con 0x7f45f005d320 2020-11-20T12:04:38.818 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4610006be0 con 0x7f461814b770 2020-11-20T12:04:38.818 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4617fff700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f45f005d320 0x7f45f005f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.818 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f461ce6d700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f45f00557c0 0x7f45f0057c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f460800dcc0 tx=0x7f460800f040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.819 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.794+0000 7f4617fff700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f45f005d320 0x7f45f005f740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.819 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.798+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== osd.3 v2:172.21.15.161:6816/14682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f45f005fda0 con 0x7f45f005d320 2020-11-20T12:04:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 --> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f46180a34a0 con 0x7f45f005d320 2020-11-20T12:04:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f4614ff9700 1 -- 172.21.15.161:0/2371234099 <== osd.3 v2:172.21.15.161:6816/14682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f46180a34a0 con 0x7f45f005d320 2020-11-20T12:04:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f45f005d320 msgr2=0x7f45f005f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6816/14682,v1:172.21.15.161:6819/14682] conn(0x7f45f005d320 0x7f45f005f740 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f45f00557c0 msgr2=0x7f45f0057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f45f00557c0 0x7f45f0057c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f460800dcc0 tx=0x7f460800f040).stop 2020-11-20T12:04:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 msgr2=0x7f461809fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461f0d1700 1 --2- 172.21.15.161:0/2371234099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f461814b770 0x7f461809fcf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f4610006ef0 tx=0x7f461001c000).stop 2020-11-20T12:04:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.810+0000 7f461d66e700 1 -- 172.21.15.161:0/2371234099 reap_dead start 2020-11-20T12:04:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.814+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 shutdown_connections 2020-11-20T12:04:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.814+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 >> 172.21.15.161:0/2371234099 conn(0x7f4618064610 msgr2=0x7f461814ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.814+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 shutdown_connections 2020-11-20T12:04:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.814+0000 7f461f0d1700 1 -- 172.21.15.161:0/2371234099 wait complete. 2020-11-20T12:04:38.824 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:38.824 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:38.824 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:38.835 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T12:04:38.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 Processor -- start 2020-11-20T12:04:38.958 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- start start 2020-11-20T12:04:38.960 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faa900ae5b0 0x7faa9013de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7faa900ae990 0x7faa900630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9013ac90 con 0x7faa900635c0 2020-11-20T12:04:38.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa900aa0a0 con 0x7faa900ae5b0 2020-11-20T12:04:38.961 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9013af30 con 0x7faa900ae990 2020-11-20T12:04:38.962 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faa900ae5b0 0x7faa9013de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.962 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa96d5d700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faa900635c0 0x7faa90067410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47910/0 (socket says 172.21.15.161:47910) 2020-11-20T12:04:38.962 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa96d5d700 1 -- 172.21.15.161:0/1618150915 learned_addr learned my addr 172.21.15.161:0/1618150915 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:38.962 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa95d5b700 1 --2- 172.21.15.161:0/1618150915 >> v2:172.21.15.186:3300/0 conn(0x7faa900ae990 0x7faa900630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.962 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 -- 172.21.15.161:0/1618150915 >> v2:172.21.15.186:3300/0 conn(0x7faa900ae990 msgr2=0x7faa900630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:38.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 --2- 172.21.15.161:0/1618150915 >> v2:172.21.15.186:3300/0 conn(0x7faa900ae990 0x7faa900630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 -- 172.21.15.161:0/1618150915 >> v1:172.21.15.161:6789/0 conn(0x7faa900635c0 legacy=0x7faa90067410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 -- 172.21.15.161:0/1618150915 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9013b1d0 con 0x7faa900ae5b0 2020-11-20T12:04:38.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9555a700 1 -- 172.21.15.161:0/1618150915 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007589707 0 0) 0x7faa9013ac90 con 0x7faa900635c0 2020-11-20T12:04:38.963 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9655c700 1 --2- 172.21.15.161:0/1618150915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900ae5b0 0x7faa9013de30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7faa90062850 tx=0x7faa880091d0).ready entity=mon.0 client_cookie=ecd4a8bdc7d58457 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9555a700 1 -- 172.21.15.161:0/1618150915 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8800bbc0 con 0x7faa900ae5b0 2020-11-20T12:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9555a700 1 -- 172.21.15.161:0/1618150915 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8800bd20 con 0x7faa900ae5b0 2020-11-20T12:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9555a700 1 -- 172.21.15.161:0/1618150915 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88011610 con 0x7faa900ae5b0 2020-11-20T12:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- 172.21.15.161:0/1618150915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900ae5b0 msgr2=0x7faa9013de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 --2- 172.21.15.161:0/1618150915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900ae5b0 0x7faa9013de30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7faa90062850 tx=0x7faa880091d0).stop 2020-11-20T12:04:38.965 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- 172.21.15.161:0/1618150915 shutdown_connections 2020-11-20T12:04:38.965 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 --2- 172.21.15.161:0/1618150915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900ae5b0 0x7faa9013de30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.965 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 --2- 172.21.15.161:0/1618150915 >> v2:172.21.15.186:3300/0 conn(0x7faa900ae990 0x7faa900630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.965 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- 172.21.15.161:0/1618150915 >> 172.21.15.161:0/1618150915 conn(0x7faa90061d30 msgr2=0x7faa900adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:38.965 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- 172.21.15.161:0/1618150915 shutdown_connections 2020-11-20T12:04:38.966 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.950+0000 7faa9755e700 1 -- 172.21.15.161:0/1618150915 wait complete. 2020-11-20T12:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 Processor -- start 2020-11-20T12:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- start start 2020-11-20T12:04:38.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa900ae990 0x7faa900a4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 0x7faa900a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.969 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900a1f50 con 0x7faa900635c0 2020-11-20T12:04:38.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa900a21f0 con 0x7faa901498e0 2020-11-20T12:04:38.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa900a2490 con 0x7faa900ae990 2020-11-20T12:04:38.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37672/0 (socket says 172.21.15.161:37672) 2020-11-20T12:04:38.970 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 -- 172.21.15.161:0/1804067184 learned_addr learned my addr 172.21.15.161:0/1804067184 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:38.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa95d5b700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa900ae990 0x7faa900a4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 -- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa900ae990 msgr2=0x7faa900a4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa900ae990 0x7faa900a4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 -- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 msgr2=0x7faa900a79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:38.971 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa96d5d700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 0x7faa900a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 0x7faa900a79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 -- 172.21.15.161:0/1804067184 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa900a2930 con 0x7faa900635c0 2020-11-20T12:04:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa96d5d700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 0x7faa900a79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:04:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9655c700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7faa88009210 tx=0x7faa88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.972 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88006ae0 con 0x7faa900635c0 2020-11-20T12:04:38.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88010630 con 0x7faa900635c0 2020-11-20T12:04:38.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880109b0 con 0x7faa900635c0 2020-11-20T12:04:38.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa90141430 con 0x7faa900635c0 2020-11-20T12:04:38.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa900a5220 con 0x7faa900635c0 2020-11-20T12:04:38.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa900a2650 con 0x7faa900635c0 2020-11-20T12:04:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.954+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7faa88017070 con 0x7faa900635c0 2020-11-20T12:04:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.958+0000 7faa867fc700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 0x7faa68057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.958+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faa88070b10 con 0x7faa900635c0 2020-11-20T12:04:38.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.958+0000 7faa95d5b700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 0x7faa68057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.958+0000 7faa95d5b700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 0x7faa68057c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faa900ac650 tx=0x7faa8c008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:38.975 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:38.958+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7faa88046850 con 0x7faa900635c0 2020-11-20T12:04:39.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.110+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7faa900a3970 con 0x7faa680557c0 2020-11-20T12:04:39.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.110+0000 7faa867fc700 1 -- 172.21.15.161:0/1804067184 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa900a3970 con 0x7faa680557c0 2020-11-20T12:04:39.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 msgr2=0x7faa68057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 0x7faa68057c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7faa900ac650 tx=0x7faa8c008040).stop 2020-11-20T12:04:39.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 msgr2=0x7faa900a32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7faa88009210 tx=0x7faa88016000).stop 2020-11-20T12:04:39.123 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 shutdown_connections 2020-11-20T12:04:39.124 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7faa680557c0 0x7faa68057c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.124 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa901498e0 0x7faa900a79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.124 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa900635c0 0x7faa900a32e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.124 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 --2- 172.21.15.161:0/1804067184 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7faa900ae990 0x7faa900a4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.124 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 >> 172.21.15.161:0/1804067184 conn(0x7faa90061d30 msgr2=0x7faa90066190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.125 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 shutdown_connections 2020-11-20T12:04:39.125 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.114+0000 7faa9755e700 1 -- 172.21.15.161:0/1804067184 wait complete. 2020-11-20T12:04:39.125 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T12:04:39.135 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T12:04:39.136 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:39.250 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 Processor -- start 2020-11-20T12:04:39.250 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- start start 2020-11-20T12:04:39.252 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff89c05be80 0x7ff89c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.252 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 0x7ff89c0a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.252 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89c0a8450 con 0x7ff89c0a8dc0 2020-11-20T12:04:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89c13efa0 con 0x7ff89c05be80 2020-11-20T12:04:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c0a65e0 con 0x7ff89c0a0740 2020-11-20T12:04:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89a7fc700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff89c0a8dc0 0x7ff89c0a5ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47924/0 (socket says 172.21.15.161:47924) 2020-11-20T12:04:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89a7fc700 1 -- 172.21.15.161:0/3053543021 learned_addr learned my addr 172.21.15.161:0/3053543021 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/3053543021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 0x7ff89c0a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.254 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89affd700 1 --2- 172.21.15.161:0/3053543021 >> v2:172.21.15.186:3300/0 conn(0x7ff89c05be80 0x7ff89c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.254 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff899ffb700 1 -- 172.21.15.161:0/3053543021 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780643198 0 0) 0x7ff89c0a8450 con 0x7ff89c0a8dc0 2020-11-20T12:04:39.254 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff899ffb700 1 -- 172.21.15.161:0/3053543021 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff888003240 con 0x7ff89c0a8dc0 2020-11-20T12:04:39.254 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 -- 172.21.15.161:0/3053543021 >> v2:172.21.15.186:3300/0 conn(0x7ff89c05be80 msgr2=0x7ff89c13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:39.254 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/3053543021 >> v2:172.21.15.186:3300/0 conn(0x7ff89c05be80 0x7ff89c13e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.255 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 -- 172.21.15.161:0/3053543021 >> v1:172.21.15.161:6789/0 conn(0x7ff89c0a8dc0 legacy=0x7ff89c0a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.255 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 -- 172.21.15.161:0/3053543021 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c13e590 con 0x7ff89c0a0740 2020-11-20T12:04:39.255 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/3053543021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 0x7ff89c0a0bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff894009c90 tx=0x7ff8940091d0).ready entity=mon.2 client_cookie=76008a1e62d7499a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff899ffb700 1 -- 172.21.15.161:0/3053543021 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400b9c0 con 0x7ff89c0a0740 2020-11-20T12:04:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff899ffb700 1 -- 172.21.15.161:0/3053543021 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89400bb20 con 0x7ff89c0a0740 2020-11-20T12:04:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff899ffb700 1 -- 172.21.15.161:0/3053543021 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89400bea0 con 0x7ff89c0a0740 2020-11-20T12:04:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- 172.21.15.161:0/3053543021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 msgr2=0x7ff89c0a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 --2- 172.21.15.161:0/3053543021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 0x7ff89c0a0bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff894009c90 tx=0x7ff8940091d0).stop 2020-11-20T12:04:39.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- 172.21.15.161:0/3053543021 shutdown_connections 2020-11-20T12:04:39.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 --2- 172.21.15.161:0/3053543021 >> v2:172.21.15.186:3300/0 conn(0x7ff89c05be80 0x7ff89c13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 --2- 172.21.15.161:0/3053543021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a0740 0x7ff89c0a0bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.261 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.242+0000 7ff89bfff700 1 -- 172.21.15.161:0/3053543021 >> 172.21.15.161:0/3053543021 conn(0x7ff89c0ad590 msgr2=0x7ff89c0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- 172.21.15.161:0/3053543021 shutdown_connections 2020-11-20T12:04:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- 172.21.15.161:0/3053543021 wait complete. 2020-11-20T12:04:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 Processor -- start 2020-11-20T12:04:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- start start 2020-11-20T12:04:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c05be80 0x7ff89c13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 0x7ff89c13a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a8dc0 0x7ff89c067d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c13be50 con 0x7ff89c0a0740 2020-11-20T12:04:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c13ac80 con 0x7ff89c05be80 2020-11-20T12:04:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89bfff700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c139ba0 con 0x7ff89c0a8dc0 2020-11-20T12:04:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 0x7ff89c13a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 0x7ff89c13a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37688/0 (socket says 172.21.15.161:37688) 2020-11-20T12:04:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 -- 172.21.15.161:0/326065863 learned_addr learned my addr 172.21.15.161:0/326065863 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89affd700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c05be80 0x7ff89c13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a8dc0 0x7ff89c067d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 -- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a8dc0 msgr2=0x7ff89c067d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff89c0a8dc0 0x7ff89c067d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 -- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c05be80 msgr2=0x7ff89c13a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c05be80 0x7ff89c13a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89c14dac0 con 0x7ff89c0a0740 2020-11-20T12:04:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff89a7fc700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 0x7ff89c13a790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff89000c710 tx=0x7ff890007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.246+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8900072e0 con 0x7ff89c0a0740 2020-11-20T12:04:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff890007440 con 0x7ff89c0a0740 2020-11-20T12:04:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c0a02b0 con 0x7ff89c0a0740 2020-11-20T12:04:39.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890005800 con 0x7ff89c0a0740 2020-11-20T12:04:39.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c068440 con 0x7ff89c0a0740 2020-11-20T12:04:39.267 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff89c0a05b0 con 0x7ff89c0a0740 2020-11-20T12:04:39.268 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7ff890010070 con 0x7ff89c0a0740 2020-11-20T12:04:39.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff8780557c0 0x7ff878057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff89006e100 con 0x7ff89c0a0740 2020-11-20T12:04:39.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89affd700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff8780557c0 0x7ff878057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7ff87805d320 0x7ff87805f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.269 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff87805fda0 con 0x7ff87805d320 2020-11-20T12:04:39.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff89006e500 con 0x7ff89c0a0740 2020-11-20T12:04:39.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89affd700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff8780557c0 0x7ff878057c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff88c006fd0 tx=0x7ff88c006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7ff87805d320 0x7ff87805f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.270 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.250+0000 7ff89b7fe700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7ff87805d320 0x7ff87805f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.254+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== osd.4 v2:172.21.15.186:6808/14935 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7ff87805fda0 con 0x7ff87805d320 2020-11-20T12:04:39.283 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 --> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff89c044f60 con 0x7ff87805d320 2020-11-20T12:04:39.284 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff882ffd700 1 -- 172.21.15.161:0/326065863 <== osd.4 v2:172.21.15.186:6808/14935 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff89c044f60 con 0x7ff87805d320 2020-11-20T12:04:39.284 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:39.285 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:39.285 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:39.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7ff87805d320 msgr2=0x7ff87805f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.186:6808/14935,v1:172.21.15.186:6811/14935] conn(0x7ff87805d320 0x7ff87805f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff8780557c0 msgr2=0x7ff878057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7ff8780557c0 0x7ff878057c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff88c006fd0 tx=0x7ff88c006df0).stop 2020-11-20T12:04:39.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 msgr2=0x7ff89c13a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 --2- 172.21.15.161:0/326065863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff89c0a0740 0x7ff89c13a790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff89000c710 tx=0x7ff890007aa0).stop 2020-11-20T12:04:39.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89b7fe700 1 -- 172.21.15.161:0/326065863 reap_dead start 2020-11-20T12:04:39.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 shutdown_connections 2020-11-20T12:04:39.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 >> 172.21.15.161:0/326065863 conn(0x7ff89c0ad590 msgr2=0x7ff89c0a9360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 shutdown_connections 2020-11-20T12:04:39.288 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.274+0000 7ff89bfff700 1 -- 172.21.15.161:0/326065863 wait complete. 2020-11-20T12:04:39.297 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T12:04:39.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 Processor -- start 2020-11-20T12:04:39.414 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- start start 2020-11-20T12:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd640ad620 0x7fcd64060150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 0x7fcd64142f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd640a8bc0 con 0x7fcd640a58e0 2020-11-20T12:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd64061050 con 0x7fcd640ad620 2020-11-20T12:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd640a8df0 con 0x7fcd640a5d60 2020-11-20T12:04:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd640ad620 0x7fcd64060150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd640ad620 0x7fcd64060150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37696/0 (socket says 172.21.15.161:37696) 2020-11-20T12:04:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 -- 172.21.15.161:0/3559952884 learned_addr learned my addr 172.21.15.161:0/3559952884 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd62d9d700 1 --2- 172.21.15.161:0/3559952884 >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 0x7fcd64142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.418 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 -- 172.21.15.161:0/3559952884 >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 msgr2=0x7fcd64142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 --2- 172.21.15.161:0/3559952884 >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 0x7fcd64142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 -- 172.21.15.161:0/3559952884 >> v1:172.21.15.161:6789/0 conn(0x7fcd640a58e0 legacy=0x7fcd641427f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 -- 172.21.15.161:0/3559952884 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd640a9090 con 0x7fcd640ad620 2020-11-20T12:04:39.419 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd62d9d700 1 --2- 172.21.15.161:0/3559952884 >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 0x7fcd64142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:04:39.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6259c700 1 --2- 172.21.15.161:0/3559952884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd64060150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fcd64118d00 tx=0x7fcd58006eb0).ready entity=mon.0 client_cookie=e939a020679cac43 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6159a700 1 -- 172.21.15.161:0/3559952884 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd580098d0 con 0x7fcd640ad620 2020-11-20T12:04:39.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6159a700 1 -- 172.21.15.161:0/3559952884 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58009a30 con 0x7fcd640ad620 2020-11-20T12:04:39.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6159a700 1 -- 172.21.15.161:0/3559952884 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58009db0 con 0x7fcd640ad620 2020-11-20T12:04:39.420 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- 172.21.15.161:0/3559952884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 msgr2=0x7fcd64060150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 --2- 172.21.15.161:0/3559952884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd64060150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fcd64118d00 tx=0x7fcd58006eb0).stop 2020-11-20T12:04:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- 172.21.15.161:0/3559952884 shutdown_connections 2020-11-20T12:04:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 --2- 172.21.15.161:0/3559952884 >> v2:172.21.15.186:3300/0 conn(0x7fcd640a5d60 0x7fcd64142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.421 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 --2- 172.21.15.161:0/3559952884 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd64060150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- 172.21.15.161:0/3559952884 >> 172.21.15.161:0/3559952884 conn(0x7fcd640621d0 msgr2=0x7fcd640acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- 172.21.15.161:0/3559952884 shutdown_connections 2020-11-20T12:04:39.422 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- 172.21.15.161:0/3559952884 wait complete. 2020-11-20T12:04:39.424 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 Processor -- start 2020-11-20T12:04:39.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.405+0000 7fcd6359e700 1 -- start start 2020-11-20T12:04:39.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 0x7fcd64115a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 0x7fcd6414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.425 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6414bcb0 con 0x7fcd640ad620 2020-11-20T12:04:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd641162d0 con 0x7fcd640a58e0 2020-11-20T12:04:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd64116570 con 0x7fcd640a5d60 2020-11-20T12:04:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37704/0 (socket says 172.21.15.161:37704) 2020-11-20T12:04:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 -- 172.21.15.161:0/2089723891 learned_addr learned my addr 172.21.15.161:0/2089723891 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6259c700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 0x7fcd64115a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd61d9b700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 0x7fcd6414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 -- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 msgr2=0x7fcd6414b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.427 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 0x7fcd6414b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 -- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 msgr2=0x7fcd64115a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 0x7fcd64115a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 -- 172.21.15.161:0/2089723891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6414e340 con 0x7fcd640ad620 2020-11-20T12:04:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd61d9b700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 0x7fcd6414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:04:39.428 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6259c700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 0x7fcd64115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:04:39.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd62d9d700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcd5c00c8d0 tx=0x7fcd5c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007750 con 0x7fcd640ad620 2020-11-20T12:04:39.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c0078b0 con 0x7fcd640ad620 2020-11-20T12:04:39.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd641189b0 con 0x7fcd640ad620 2020-11-20T12:04:39.429 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007c50 con 0x7fcd640ad620 2020-11-20T12:04:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd64114cf0 con 0x7fcd640ad620 2020-11-20T12:04:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd640a9270 con 0x7fcd640ad620 2020-11-20T12:04:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fcd5c01b460 con 0x7fcd640ad620 2020-11-20T12:04:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 0x7fcd38057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6259c700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 0x7fcd38057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcd5c06eab0 con 0x7fcd640ad620 2020-11-20T12:04:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.409+0000 7fcd6259c700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 0x7fcd38057cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd5800b1b0 tx=0x7fcd58015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.431 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.413+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcd640a9270 con 0x7fcd640ad620 2020-11-20T12:04:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd6414e540 con 0x7fcd380557f0 2020-11-20T12:04:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd527fc700 1 -- 172.21.15.161:0/2089723891 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcd58000c10 con 0x7fcd380557f0 2020-11-20T12:04:39.569 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 msgr2=0x7fcd38057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 0x7fcd38057cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcd5800b1b0 tx=0x7fcd58015000).stop 2020-11-20T12:04:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 msgr2=0x7fcd6414b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcd5c00c8d0 tx=0x7fcd5c008040).stop 2020-11-20T12:04:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 shutdown_connections 2020-11-20T12:04:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fcd380557f0 0x7fcd38057cb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd640ad620 0x7fcd6414b7c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd640a58e0 0x7fcd64115a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 --2- 172.21.15.161:0/2089723891 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcd640a5d60 0x7fcd6414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 >> 172.21.15.161:0/2089723891 conn(0x7fcd640621d0 msgr2=0x7fcd640a9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 shutdown_connections 2020-11-20T12:04:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.557+0000 7fcd6359e700 1 -- 172.21.15.161:0/2089723891 wait complete. 2020-11-20T12:04:39.572 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T12:04:39.587 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T12:04:39.588 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.693+0000 7f59de63c700 1 Processor -- start 2020-11-20T12:04:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.693+0000 7f59de63c700 1 -- start start 2020-11-20T12:04:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59de63c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 0x7f59d8137650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59de63c700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80a7740 con 0x7f59d80aad70 2020-11-20T12:04:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59de63c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80a9470 con 0x7f59d8061300 2020-11-20T12:04:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59de63c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80a9710 con 0x7f59d80a9bb0 2020-11-20T12:04:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d77fe700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f59d80aad70 0x7f59d8134880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47954/0 (socket says 172.21.15.161:47954) 2020-11-20T12:04:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d77fe700 1 -- 172.21.15.161:0/2918188221 learned_addr learned my addr 172.21.15.161:0/2918188221 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:39.709 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59dcbd9700 1 --2- 172.21.15.161:0/2918188221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 0x7f59d8137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.710 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341182991 0 0) 0x7f59d80a7740 con 0x7f59d80aad70 2020-11-20T12:04:39.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b8003240 con 0x7f59d80aad70 2020-11-20T12:04:39.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989331660 0 0) 0x7f59d80a9470 con 0x7f59d8061300 2020-11-20T12:04:39.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d80a7740 con 0x7f59d8061300 2020-11-20T12:04:39.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1922982341 0 0) 0x7f59b8003240 con 0x7f59d80aad70 2020-11-20T12:04:39.711 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59dcbd9700 1 -- 172.21.15.161:0/2918188221 >> v1:172.21.15.186:6789/0 conn(0x7f59d8061300 legacy=0x7f59d80a6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59dcbd9700 1 -- 172.21.15.161:0/2918188221 >> v1:172.21.15.161:6789/0 conn(0x7f59d80aad70 legacy=0x7f59d8134880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59dcbd9700 1 -- 172.21.15.161:0/2918188221 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80616e0 con 0x7f59d80a9bb0 2020-11-20T12:04:39.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59dcbd9700 1 --2- 172.21.15.161:0/2918188221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 0x7f59d8137650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f59d000b9d0 tx=0x7f59d0006df0).ready entity=mon.2 client_cookie=7a578881a829c151 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.712 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00014e0 con 0x7f59d80a9bb0 2020-11-20T12:04:39.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0011400 con 0x7f59d80a9bb0 2020-11-20T12:04:39.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.697+0000 7f59d6ffd700 1 -- 172.21.15.161:0/2918188221 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0011780 con 0x7f59d80a9bb0 2020-11-20T12:04:39.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- 172.21.15.161:0/2918188221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 msgr2=0x7f59d8137650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 --2- 172.21.15.161:0/2918188221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 0x7f59d8137650 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f59d000b9d0 tx=0x7f59d0006df0).stop 2020-11-20T12:04:39.713 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- 172.21.15.161:0/2918188221 shutdown_connections 2020-11-20T12:04:39.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 --2- 172.21.15.161:0/2918188221 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d80a9bb0 0x7f59d8137650 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- 172.21.15.161:0/2918188221 >> 172.21.15.161:0/2918188221 conn(0x7f59d80ae1b0 msgr2=0x7f59d80aa180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- 172.21.15.161:0/2918188221 shutdown_connections 2020-11-20T12:04:39.714 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- 172.21.15.161:0/2918188221 wait complete. 2020-11-20T12:04:39.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 Processor -- start 2020-11-20T12:04:39.717 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- start start 2020-11-20T12:04:39.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 0x7f59d813ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59d80a9bb0 0x7f59d81391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 0x7f59d8147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.718 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8138b70 con 0x7f59d80aad70 2020-11-20T12:04:39.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8139690 con 0x7f59d80a9bb0 2020-11-20T12:04:39.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59de63c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8067e70 con 0x7f59d8061300 2020-11-20T12:04:39.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59dcbd9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 0x7f59d8147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 0x7f59d813ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.719 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59d80a9bb0 0x7f59d81391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59d7fff700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 0x7f59d813ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44710/0 (socket says 172.21.15.161:44710) 2020-11-20T12:04:39.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59dcbd9700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 0x7f59d8147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37720/0 (socket says 172.21.15.161:37720) 2020-11-20T12:04:39.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59d77fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59d80a9bb0 0x7f59d81391a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.161:43186/0 (socket says 172.21.15.161:43186) 2020-11-20T12:04:39.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.701+0000 7f59d7fff700 1 -- 172.21.15.161:0/3527880317 learned_addr learned my addr 172.21.15.161:0/3527880317 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.720 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 -- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 msgr2=0x7f59d813ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 0x7f59d813ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 -- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59d80a9bb0 msgr2=0x7f59d81391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59d80a9bb0 0x7f59d81391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8068110 con 0x7f59d80aad70 2020-11-20T12:04:39.721 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59d7fff700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f59d8061300 0x7f59d813ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:39.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59dcbd9700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 0x7f59d8147d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f59d0012000 tx=0x7f59d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d0009bc0 con 0x7f59d80aad70 2020-11-20T12:04:39.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d0009d20 con 0x7f59d80aad70 2020-11-20T12:04:39.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d81478d0 con 0x7f59d80aad70 2020-11-20T12:04:39.722 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d001e690 con 0x7f59d80aad70 2020-11-20T12:04:39.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8067bf0 con 0x7f59d80aad70 2020-11-20T12:04:39.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59d8069250 con 0x7f59d80aad70 2020-11-20T12:04:39.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f59d001a040 con 0x7f59d80aad70 2020-11-20T12:04:39.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f59b40557c0 0x7f59b4057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.723 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f59d006f930 con 0x7f59d80aad70 2020-11-20T12:04:39.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59d7fff700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f59b40557c0 0x7f59b4057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f59b405d320 0x7f59b405f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59b405fda0 con 0x7f59b405d320 2020-11-20T12:04:39.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.705+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59d0074220 con 0x7f59d80aad70 2020-11-20T12:04:39.724 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.709+0000 7f59d7fff700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f59b40557c0 0x7f59b4057c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f59c800f2a0 tx=0x7f59c8007e20).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.709+0000 7f59d77fe700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f59b405d320 0x7f59b405f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.725 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.709+0000 7f59d77fe700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f59b405d320 0x7f59b405f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.726 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.709+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== osd.5 v2:172.21.15.186:6809/14934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f59b405fda0 con 0x7f59b405d320 2020-11-20T12:04:39.738 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 --> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59d80a7b40 con 0x7f59b405d320 2020-11-20T12:04:39.739 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59cffff700 1 -- 172.21.15.161:0/3527880317 <== osd.5 v2:172.21.15.186:6809/14934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59d80a7b40 con 0x7f59b405d320 2020-11-20T12:04:39.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f59b405d320 msgr2=0x7f59b405f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.186:6809/14934,v1:172.21.15.186:6810/14934] conn(0x7f59b405d320 0x7f59b405f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f59b40557c0 msgr2=0x7f59b4057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.740 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f59b40557c0 0x7f59b4057c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f59c800f2a0 tx=0x7f59c8007e20).stop 2020-11-20T12:04:39.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 msgr2=0x7f59d8147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 --2- 172.21.15.161:0/3527880317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59d80aad70 0x7f59d8147d70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f59d0012000 tx=0x7f59d0015000).stop 2020-11-20T12:04:39.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59dcbd9700 1 -- 172.21.15.161:0/3527880317 reap_dead start 2020-11-20T12:04:39.741 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 shutdown_connections 2020-11-20T12:04:39.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 >> 172.21.15.161:0/3527880317 conn(0x7f59d80ae1b0 msgr2=0x7f59d8132ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 shutdown_connections 2020-11-20T12:04:39.742 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.729+0000 7f59de63c700 1 -- 172.21.15.161:0/3527880317 wait complete. 2020-11-20T12:04:39.742 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:39.742 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:39.743 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:39.751 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T12:04:39.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 Processor -- start 2020-11-20T12:04:39.866 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- start start 2020-11-20T12:04:39.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd84061300 0x7efd840a9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.867 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd840aada0 0x7efd840a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd84068620 con 0x7efd840679c0 2020-11-20T12:04:39.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd84137620 con 0x7efd840aada0 2020-11-20T12:04:39.868 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd84067f40 con 0x7efd84061300 2020-11-20T12:04:39.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd840aada0 0x7efd840a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd840aada0 0x7efd840a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37728/0 (socket says 172.21.15.161:37728) 2020-11-20T12:04:39.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 -- 172.21.15.161:0/2738405214 learned_addr learned my addr 172.21.15.161:0/2738405214 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.869 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8a338700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd84061300 0x7efd840a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.871 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 -- 172.21.15.161:0/2738405214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd84061300 msgr2=0x7efd840a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:39.871 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89336700 1 -- 172.21.15.161:0/2738405214 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250311907 0 0) 0x7efd84068620 con 0x7efd840679c0 2020-11-20T12:04:39.871 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd84061300 0x7efd840a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 -- 172.21.15.161:0/2738405214 >> v1:172.21.15.186:6789/0 conn(0x7efd840679c0 legacy=0x7efd84134560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 -- 172.21.15.161:0/2738405214 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840681e0 con 0x7efd840aada0 2020-11-20T12:04:39.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89b37700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd840a9c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7efd74006fd0 tx=0x7efd74006eb0).ready entity=mon.0 client_cookie=b3c3a7d41572c4dd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89336700 1 -- 172.21.15.161:0/2738405214 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74009810 con 0x7efd840aada0 2020-11-20T12:04:39.872 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89336700 1 -- 172.21.15.161:0/2738405214 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74009970 con 0x7efd840aada0 2020-11-20T12:04:39.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd89336700 1 -- 172.21.15.161:0/2738405214 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74009cf0 con 0x7efd840aada0 2020-11-20T12:04:39.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- 172.21.15.161:0/2738405214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 msgr2=0x7efd840a9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd840a9c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7efd74006fd0 tx=0x7efd74006eb0).stop 2020-11-20T12:04:39.873 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 -- 172.21.15.161:0/2738405214 shutdown_connections 2020-11-20T12:04:39.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd84061300 0x7efd840a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.857+0000 7efd8c59c700 1 --2- 172.21.15.161:0/2738405214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd840a9c00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- 172.21.15.161:0/2738405214 >> 172.21.15.161:0/2738405214 conn(0x7efd840ae1b0 msgr2=0x7efd840aa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:39.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- 172.21.15.161:0/2738405214 shutdown_connections 2020-11-20T12:04:39.874 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- 172.21.15.161:0/2738405214 wait complete. 2020-11-20T12:04:39.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 Processor -- start 2020-11-20T12:04:39.875 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- start start 2020-11-20T12:04:39.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84061300 0x7efd841464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.877 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd8414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8412c8d0 con 0x7efd840aada0 2020-11-20T12:04:39.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8414a940 con 0x7efd84061300 2020-11-20T12:04:39.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8c59c700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd84149a70 con 0x7efd840679c0 2020-11-20T12:04:39.878 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8ab39700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd8414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd89b37700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd89b37700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.161:44728/0 (socket says 172.21.15.161:44728) 2020-11-20T12:04:39.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd89b37700 1 -- 172.21.15.161:0/5599835 learned_addr learned my addr 172.21.15.161:0/5599835 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:39.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.861+0000 7efd8a338700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84061300 0x7efd841464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.879 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 -- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 msgr2=0x7efd8413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 -- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84061300 msgr2=0x7efd841464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:39.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84061300 0x7efd841464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:39.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 -- 172.21.15.161:0/5599835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84149d10 con 0x7efd840aada0 2020-11-20T12:04:39.880 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd89b37700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8ab39700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd8414a450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7efd7c00cb10 tx=0x7efd7c007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00a730 con 0x7efd840aada0 2020-11-20T12:04:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c00a890 con 0x7efd840aada0 2020-11-20T12:04:39.881 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd84149fb0 con 0x7efd840aada0 2020-11-20T12:04:39.882 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c00ac50 con 0x7efd840aada0 2020-11-20T12:04:39.882 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8413df50 con 0x7efd840aada0 2020-11-20T12:04:39.882 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7efd7c019030 con 0x7efd840aada0 2020-11-20T12:04:39.882 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 0x7efd5c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:39.882 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8414a140 con 0x7efd840aada0 2020-11-20T12:04:39.883 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efd7c06e030 con 0x7efd840aada0 2020-11-20T12:04:39.883 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8a338700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 0x7efd5c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:39.883 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.865+0000 7efd8a338700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 0x7efd5c057c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd80006fd0 tx=0x7efd80006df0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:39.884 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:39.873+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efd7c043d70 con 0x7efd840aada0 2020-11-20T12:04:40.035 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efd84069250 con 0x7efd5c0557c0 2020-11-20T12:04:40.035 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd727fc700 1 -- 172.21.15.161:0/5599835 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd84069250 con 0x7efd5c0557c0 2020-11-20T12:04:40.037 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 msgr2=0x7efd5c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 0x7efd5c057c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7efd80006fd0 tx=0x7efd80006df0).stop 2020-11-20T12:04:40.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 msgr2=0x7efd8414a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.025+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd8414a450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7efd7c00cb10 tx=0x7efd7c007ed0).stop 2020-11-20T12:04:40.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 shutdown_connections 2020-11-20T12:04:40.038 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7efd5c0557c0 0x7efd5c057c80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd840aada0 0x7efd8414a450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd84061300 0x7efd841464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 --2- 172.21.15.161:0/5599835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efd840679c0 0x7efd8413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 >> 172.21.15.161:0/5599835 conn(0x7efd840ae1b0 msgr2=0x7efd840656c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.039 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 shutdown_connections 2020-11-20T12:04:40.040 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.029+0000 7efd8c59c700 1 -- 172.21.15.161:0/5599835 wait complete. 2020-11-20T12:04:40.040 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T12:04:40.049 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T12:04:40.049 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:40.164 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 Processor -- start 2020-11-20T12:04:40.164 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 -- start start 2020-11-20T12:04:40.166 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f71c80a9d00 0x7f71c80a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 0x7f71c80613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c80a3a00 con 0x7f71c80a4160 2020-11-20T12:04:40.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c80a8aa0 con 0x7f71c80a9d00 2020-11-20T12:04:40.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.153+0000 7f71ce469700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80a5ff0 con 0x7f71c80a7d00 2020-11-20T12:04:40.167 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71cdc68700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f71c80a4160 0x7f71c8061890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47986/0 (socket says 172.21.15.161:47986) 2020-11-20T12:04:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71cdc68700 1 -- 172.21.15.161:0/2390951292 learned_addr learned my addr 172.21.15.161:0/2390951292 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2390951292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 0x7f71c80613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71cd467700 1 --2- 172.21.15.161:0/2390951292 >> v2:172.21.15.186:3300/0 conn(0x7f71c80a9d00 0x7f71c80a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687685117 0 0) 0x7f71c80a3a00 con 0x7f71c80a4160 2020-11-20T12:04:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71ac003240 con 0x7f71c80a4160 2020-11-20T12:04:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2635614126 0 0) 0x7f71ac003240 con 0x7f71c80a4160 2020-11-20T12:04:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 -- 172.21.15.161:0/2390951292 >> v2:172.21.15.186:3300/0 conn(0x7f71c80a9d00 msgr2=0x7f71c80a5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2390951292 >> v2:172.21.15.186:3300/0 conn(0x7f71c80a9d00 0x7f71c80a5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 -- 172.21.15.161:0/2390951292 >> v1:172.21.15.161:6789/0 conn(0x7f71c80a4160 legacy=0x7f71c8061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 -- 172.21.15.161:0/2390951292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80a3ed0 con 0x7f71c80a7d00 2020-11-20T12:04:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2390951292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 0x7f71c80613a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f71c4009c90 tx=0x7f71c40091d0).ready entity=mon.2 client_cookie=15c58aae6111b9ed server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c00014e0 con 0x7f71c80a7d00 2020-11-20T12:04:40.173 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b6b0 con 0x7f71c80a7d00 2020-11-20T12:04:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71bbfff700 1 -- 172.21.15.161:0/2390951292 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c400ba30 con 0x7f71c80a7d00 2020-11-20T12:04:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 -- 172.21.15.161:0/2390951292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 msgr2=0x7f71c80613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 --2- 172.21.15.161:0/2390951292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 0x7f71c80613a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f71c4009c90 tx=0x7f71c40091d0).stop 2020-11-20T12:04:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 -- 172.21.15.161:0/2390951292 shutdown_connections 2020-11-20T12:04:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 --2- 172.21.15.161:0/2390951292 >> v2:172.21.15.186:3300/0 conn(0x7f71c80a9d00 0x7f71c80a5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 --2- 172.21.15.161:0/2390951292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a7d00 0x7f71c80613a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 -- 172.21.15.161:0/2390951292 >> 172.21.15.161:0/2390951292 conn(0x7f71c80602f0 msgr2=0x7f71c8060700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 -- 172.21.15.161:0/2390951292 shutdown_connections 2020-11-20T12:04:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.157+0000 7f71ce469700 1 -- 172.21.15.161:0/2390951292 wait complete. 2020-11-20T12:04:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 Processor -- start 2020-11-20T12:04:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- start start 2020-11-20T12:04:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c80a4160 0x7f71c8143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 0x7f71c8066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a9d00 0x7f71c814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c814ddf0 con 0x7f71c80a7d00 2020-11-20T12:04:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c80675b0 con 0x7f71c80a4160 2020-11-20T12:04:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c814dfe0 con 0x7f71c80a9d00 2020-11-20T12:04:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 0x7f71c8066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 0x7f71c8066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37746/0 (socket says 172.21.15.161:37746) 2020-11-20T12:04:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 -- 172.21.15.161:0/2742394837 learned_addr learned my addr 172.21.15.161:0/2742394837 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71cdc68700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a9d00 0x7f71c814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71cd467700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c80a4160 0x7f71c8143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 -- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a9d00 msgr2=0x7f71c814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71c80a9d00 0x7f71c814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 -- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c80a4160 msgr2=0x7f71c8143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71c80a4160 0x7f71c8143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8067270 con 0x7f71c80a7d00 2020-11-20T12:04:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ccc66700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 0x7f71c8066d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f71c400b5c0 tx=0x7f71c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4011ea0 con 0x7f71c80a7d00 2020-11-20T12:04:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c809feb0 con 0x7f71c80a7d00 2020-11-20T12:04:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c401d450 con 0x7f71c80a7d00 2020-11-20T12:04:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c814eb10 con 0x7f71c80a7d00 2020-11-20T12:04:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c4006c10 con 0x7f71c80a7d00 2020-11-20T12:04:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71c8062c20 con 0x7f71c80a7d00 2020-11-20T12:04:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.161+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f71c4017040 con 0x7f71c80a7d00 2020-11-20T12:04:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f719c0557c0 0x7f719c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f71c4070480 con 0x7f71c80a7d00 2020-11-20T12:04:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f719c05d320 0x7f719c05f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71cd467700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f719c0557c0 0x7f719c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f719c05fda0 con 0x7f719c05d320 2020-11-20T12:04:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71c4072d00 con 0x7f71c80a7d00 2020-11-20T12:04:40.183 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71cdc68700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f719c05d320 0x7f719c05f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.183 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71cd467700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f719c0557c0 0x7f719c057c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f71bc006fd0 tx=0x7f71bc008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.183 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71cdc68700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f719c05d320 0x7f719c05f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.184 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.165+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== osd.6 v2:172.21.15.186:6800/14936 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f719c05fda0 con 0x7f719c05d320 2020-11-20T12:04:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 --> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71c80aad70 con 0x7f719c05d320 2020-11-20T12:04:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71b9ffb700 1 -- 172.21.15.161:0/2742394837 <== osd.6 v2:172.21.15.186:6800/14936 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f71c80aad70 con 0x7f719c05d320 2020-11-20T12:04:40.191 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:40.191 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:40.192 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:40.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f719c05d320 msgr2=0x7f719c05f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.186:6800/14936,v1:172.21.15.186:6801/14936] conn(0x7f719c05d320 0x7f719c05f740 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f719c0557c0 msgr2=0x7f719c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.193 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f719c0557c0 0x7f719c057c80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f71bc006fd0 tx=0x7f71bc008040).stop 2020-11-20T12:04:40.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 msgr2=0x7f71c8066d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 --2- 172.21.15.161:0/2742394837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71c80a7d00 0x7f71c8066d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f71c400b5c0 tx=0x7f71c4016000).stop 2020-11-20T12:04:40.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71cdc68700 1 -- 172.21.15.161:0/2742394837 reap_dead start 2020-11-20T12:04:40.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 shutdown_connections 2020-11-20T12:04:40.194 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 >> 172.21.15.161:0/2742394837 conn(0x7f71c80602f0 msgr2=0x7f71c81407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 shutdown_connections 2020-11-20T12:04:40.195 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.181+0000 7f71ce469700 1 -- 172.21.15.161:0/2742394837 wait complete. 2020-11-20T12:04:40.203 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T12:04:40.319 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 Processor -- start 2020-11-20T12:04:40.320 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 -- start start 2020-11-20T12:04:40.323 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f003c0a4c00 0x7f003c0604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f003c141a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c060e40 con 0x7f003c0609c0 2020-11-20T12:04:40.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c0a5da0 con 0x7f003c0a4c00 2020-11-20T12:04:40.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0042d8d700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0a6040 con 0x7f003c0a90d0 2020-11-20T12:04:40.324 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f004158a700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f003c0609c0 0x7f003c0a89c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48000/0 (socket says 172.21.15.161:48000) 2020-11-20T12:04:40.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f004158a700 1 -- 172.21.15.161:0/2608087696 learned_addr learned my addr 172.21.15.161:0/2608087696 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:40.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> v2:172.21.15.186:3300/0 conn(0x7f003c0a4c00 0x7f003c0604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f004258c700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f003c141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.325 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833794769 0 0) 0x7f003c060e40 con 0x7f003c0609c0 2020-11-20T12:04:40.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0024003240 con 0x7f003c0609c0 2020-11-20T12:04:40.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.309+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1709292092 0 0) 0x7f0024003240 con 0x7f003c0609c0 2020-11-20T12:04:40.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 msgr2=0x7f003c141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f003c141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.326 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 >> v2:172.21.15.186:3300/0 conn(0x7f003c0a4c00 msgr2=0x7f003c0604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 --2- 172.21.15.161:0/2608087696 >> v2:172.21.15.186:3300/0 conn(0x7f003c0a4c00 0x7f003c0604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0a6820 con 0x7f003c0609c0 2020-11-20T12:04:40.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1507175029 0 0) 0x7f002c0014e0 con 0x7f003c0609c0 2020-11-20T12:04:40.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 >> v1:172.21.15.161:6789/0 conn(0x7f003c0609c0 legacy=0x7f003c0a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.327 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0024003730 0x7f0024003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f00240044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00240049d0 0x7f0024004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0a5da0 con 0x7f0024003730 2020-11-20T12:04:40.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0a6040 con 0x7f00240049d0 2020-11-20T12:04:40.328 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240041d0 con 0x7f003c0a90d0 2020-11-20T12:04:40.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> v2:172.21.15.186:3300/0 conn(0x7f003c0a4c00 0x7f003c0604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:04:40.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0024003730 0x7f0024003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f004158a700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f00240044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.329 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f004258c700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00240049d0 0x7f0024004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 -- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 msgr2=0x7f00240044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f00240044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 -- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00240049d0 msgr2=0x7f0024004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00240049d0 0x7f0024004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.330 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 -- 172.21.15.161:0/2608087696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024003240 con 0x7f0024003730 2020-11-20T12:04:40.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f004158a700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a90d0 0x7f00240044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:40.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0041d8b700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0024003730 0x7f0024003b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f003800bdf0 tx=0x7f0038008040).ready entity=mon.0 client_cookie=a58042eb79549187 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003800b520 con 0x7f0024003730 2020-11-20T12:04:40.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003800ecf0 con 0x7f0024003730 2020-11-20T12:04:40.331 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0040d89700 1 -- 172.21.15.161:0/2608087696 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038012600 con 0x7f0024003730 2020-11-20T12:04:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- 172.21.15.161:0/2608087696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0024003730 msgr2=0x7f0024003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 --2- 172.21.15.161:0/2608087696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0024003730 0x7f0024003b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f003800bdf0 tx=0x7f0038008040).stop 2020-11-20T12:04:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f004258c700 1 -- 172.21.15.161:0/2608087696 reap_dead start 2020-11-20T12:04:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- 172.21.15.161:0/2608087696 shutdown_connections 2020-11-20T12:04:40.332 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- 172.21.15.161:0/2608087696 >> 172.21.15.161:0/2608087696 conn(0x7f003c0ad620 msgr2=0x7f003c0ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- 172.21.15.161:0/2608087696 shutdown_connections 2020-11-20T12:04:40.333 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- 172.21.15.161:0/2608087696 wait complete. 2020-11-20T12:04:40.335 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 Processor -- start 2020-11-20T12:04:40.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.313+0000 7f0042d8d700 1 -- start start 2020-11-20T12:04:40.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a2990 0x7f003c0674d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f003c0679c0 0x7f003c135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.336 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c09dcf0 con 0x7f003c0a25b0 2020-11-20T12:04:40.337 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c09df90 con 0x7f003c0679c0 2020-11-20T12:04:40.337 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c09e230 con 0x7f003c0a2990 2020-11-20T12:04:40.337 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.337 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37768/0 (socket says 172.21.15.161:37768) 2020-11-20T12:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 -- 172.21.15.161:0/1775025338 learned_addr learned my addr 172.21.15.161:0/1775025338 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f004158a700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a2990 0x7f003c0674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f004258c700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f003c0679c0 0x7f003c135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 -- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a2990 msgr2=0x7f003c0674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a2990 0x7f003c0674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 -- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f003c0679c0 msgr2=0x7f003c135470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f003c0679c0 0x7f003c135470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 -- 172.21.15.161:0/1775025338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c09e4d0 con 0x7f003c0a25b0 2020-11-20T12:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0041d8b700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0038006ca0 tx=0x7f003801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038020070 con 0x7f003c0a25b0 2020-11-20T12:04:40.340 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003801b780 con 0x7f003c0a25b0 2020-11-20T12:04:40.340 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c066da0 con 0x7f003c0a25b0 2020-11-20T12:04:40.340 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003801bb00 con 0x7f003c0a25b0 2020-11-20T12:04:40.340 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c135960 con 0x7f003c0a25b0 2020-11-20T12:04:40.341 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c069250 con 0x7f003c0a25b0 2020-11-20T12:04:40.341 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f0038024410 con 0x7f003c0a25b0 2020-11-20T12:04:40.341 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 0x7f0014057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.317+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0038070810 con 0x7f003c0a25b0 2020-11-20T12:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.321+0000 7f004158a700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 0x7f0014057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.321+0000 7f004158a700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 0x7f0014057c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f002c000dd0 tx=0x7f002c009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.343 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.321+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f00380465b0 con 0x7f003c0a25b0 2020-11-20T12:04:40.504 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.493+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f003c067da0 con 0x7f00140557c0 2020-11-20T12:04:40.505 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.493+0000 7f0029ffb700 1 -- 172.21.15.161:0/1775025338 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f003c067da0 con 0x7f00140557c0 2020-11-20T12:04:40.507 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 msgr2=0x7f0014057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.507 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 0x7f0014057c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f002c000dd0 tx=0x7f002c009040).stop 2020-11-20T12:04:40.507 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 msgr2=0x7f003c0668b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.508 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f0038006ca0 tx=0x7f003801a000).stop 2020-11-20T12:04:40.508 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 shutdown_connections 2020-11-20T12:04:40.508 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f00140557c0 0x7f0014057c80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.508 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f003c0679c0 0x7f003c135470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.509 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003c0a25b0 0x7f003c0668b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.509 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 --2- 172.21.15.161:0/1775025338 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f003c0a2990 0x7f003c0674d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.509 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 >> 172.21.15.161:0/1775025338 conn(0x7f003c0ad620 msgr2=0x7f003c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.510 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 shutdown_connections 2020-11-20T12:04:40.510 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.497+0000 7f0042d8d700 1 -- 172.21.15.161:0/1775025338 wait complete. 2020-11-20T12:04:40.510 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T12:04:40.518 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T12:04:40.518 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:04:40.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.625+0000 7f5381a04700 1 Processor -- start 2020-11-20T12:04:40.637 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.625+0000 7f5381a04700 1 -- start start 2020-11-20T12:04:40.640 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 0x7f537c0a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f537c0a95b0 0x7f537c13ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537c0a8c90 con 0x7f537c0a7130 2020-11-20T12:04:40.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537c0a49d0 con 0x7f537c0a95b0 2020-11-20T12:04:40.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c060150 con 0x7f537c0a4db0 2020-11-20T12:04:40.641 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f537c0a95b0 0x7f537c13ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537bfff700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f537c0a7130 0x7f537c13a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48020/0 (socket says 172.21.15.161:48020) 2020-11-20T12:04:40.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537bfff700 1 -- 172.21.15.161:0/2860532657 learned_addr learned my addr 172.21.15.161:0/2860532657 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:40.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5380a02700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 0x7f537c0a90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.642 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 -- 172.21.15.161:0/2860532657 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 msgr2=0x7f537c0a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 0x7f537c0a90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 -- 172.21.15.161:0/2860532657 >> v1:172.21.15.161:6789/0 conn(0x7f537c0a7130 legacy=0x7f537c13a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537b7fe700 1 -- 172.21.15.161:0/2860532657 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532748299 0 0) 0x7f537c0a8c90 con 0x7f537c0a7130 2020-11-20T12:04:40.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 -- 172.21.15.161:0/2860532657 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c0a75d0 con 0x7f537c0a95b0 2020-11-20T12:04:40.643 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5380a02700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 0x7f537c0a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:40.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381203700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a95b0 0x7f537c13ac20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5374009c90 tx=0x7f53740091d0).ready entity=mon.0 client_cookie=940aa35d3cae74ed server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537b7fe700 1 -- 172.21.15.161:0/2860532657 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537400bbc0 con 0x7f537c0a95b0 2020-11-20T12:04:40.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537b7fe700 1 -- 172.21.15.161:0/2860532657 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400bd20 con 0x7f537c0a95b0 2020-11-20T12:04:40.644 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f537b7fe700 1 -- 172.21.15.161:0/2860532657 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374011610 con 0x7f537c0a95b0 2020-11-20T12:04:40.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- 172.21.15.161:0/2860532657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a95b0 msgr2=0x7f537c13ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a95b0 0x7f537c13ac20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f5374009c90 tx=0x7f53740091d0).stop 2020-11-20T12:04:40.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- 172.21.15.161:0/2860532657 shutdown_connections 2020-11-20T12:04:40.645 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a95b0 0x7f537c13ac20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 --2- 172.21.15.161:0/2860532657 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a4db0 0x7f537c0a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- 172.21.15.161:0/2860532657 >> 172.21.15.161:0/2860532657 conn(0x7f537c0ad590 msgr2=0x7f537c0ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- 172.21.15.161:0/2860532657 shutdown_connections 2020-11-20T12:04:40.646 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 -- 172.21.15.161:0/2860532657 wait complete. 2020-11-20T12:04:40.649 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.629+0000 7f5381a04700 1 Processor -- start 2020-11-20T12:04:40.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- start start 2020-11-20T12:04:40.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 0x7f537c068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c0a7130 0x7f537c067840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a95b0 0x7f537c1377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.650 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c066570 con 0x7f537c0a4db0 2020-11-20T12:04:40.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537c068770 con 0x7f537c0a7130 2020-11-20T12:04:40.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537c14cdc0 con 0x7f537c0a95b0 2020-11-20T12:04:40.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 0x7f537c068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 0x7f537c068280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37782/0 (socket says 172.21.15.161:37782) 2020-11-20T12:04:40.651 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 -- 172.21.15.161:0/1585789761 learned_addr learned my addr 172.21.15.161:0/1585789761 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:40.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381203700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a95b0 0x7f537c1377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f537bfff700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c0a7130 0x7f537c067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 -- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a95b0 msgr2=0x7f537c1377d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.652 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a95b0 0x7f537c1377d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.653 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 -- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c0a7130 msgr2=0x7f537c067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.653 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f537c0a7130 0x7f537c067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.653 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c066030 con 0x7f537c0a4db0 2020-11-20T12:04:40.653 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381203700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f537c0a95b0 0x7f537c1377d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:04:40.653 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5380a02700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 0x7f537c068280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f536c00db90 tx=0x7f536c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.654 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c0097f0 con 0x7f537c0a4db0 2020-11-20T12:04:40.654 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536c009950 con 0x7f537c0a4db0 2020-11-20T12:04:40.654 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537c0662d0 con 0x7f537c0a4db0 2020-11-20T12:04:40.654 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536c009cf0 con 0x7f537c0a4db0 2020-11-20T12:04:40.654 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537c067d30 con 0x7f537c0a4db0 2020-11-20T12:04:40.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f537c0a2f70 con 0x7f537c0a4db0 2020-11-20T12:04:40.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f536c013690 con 0x7f537c0a4db0 2020-11-20T12:04:40.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.633+0000 7f5378ff9700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f53580557c0 0x7f5358057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f536c06e820 con 0x7f537c0a4db0 2020-11-20T12:04:40.655 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5378ff9700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7f535805d3a0 0x7f535805f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.656 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f535805fe20 con 0x7f535805d3a0 2020-11-20T12:04:40.656 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f536c073220 con 0x7f537c0a4db0 2020-11-20T12:04:40.656 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f537bfff700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f53580557c0 0x7f5358057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.656 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5381203700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7f535805d3a0 0x7f535805f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.656 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f537bfff700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f53580557c0 0x7f5358057c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f537c0aa7f0 tx=0x7f5364009040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.657 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5381203700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7f535805d3a0 0x7f535805f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.657 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.637+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== osd.7 v2:172.21.15.186:6824/14945 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f535805fe20 con 0x7f535805d3a0 2020-11-20T12:04:40.666 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 --> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f537c137f80 con 0x7f535805d3a0 2020-11-20T12:04:40.667 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5378ff9700 1 -- 172.21.15.161:0/1585789761 <== osd.7 v2:172.21.15.186:6824/14945 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f537c137f80 con 0x7f535805d3a0 2020-11-20T12:04:40.667 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2020-11-20T12:04:40.667 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:04:40.668 INFO:teuthology.orchestra.run.smithi161.stdout:} 2020-11-20T12:04:40.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7f535805d3a0 msgr2=0x7f535805f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.186:6824/14945,v1:172.21.15.186:6825/14945] conn(0x7f535805d3a0 0x7f535805f7c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.669 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f53580557c0 msgr2=0x7f5358057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f53580557c0 0x7f5358057c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f537c0aa7f0 tx=0x7f5364009040).stop 2020-11-20T12:04:40.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 msgr2=0x7f537c068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 --2- 172.21.15.161:0/1585789761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f537c0a4db0 0x7f537c068280 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f536c00db90 tx=0x7f536c008040).stop 2020-11-20T12:04:40.670 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381203700 1 -- 172.21.15.161:0/1585789761 reap_dead start 2020-11-20T12:04:40.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 shutdown_connections 2020-11-20T12:04:40.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 >> 172.21.15.161:0/1585789761 conn(0x7f537c0ad590 msgr2=0x7f537c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 shutdown_connections 2020-11-20T12:04:40.671 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.657+0000 7f5381a04700 1 -- 172.21.15.161:0/1585789761 wait complete. 2020-11-20T12:04:40.684 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T12:04:40.795 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 Processor -- start 2020-11-20T12:04:40.795 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 -- start start 2020-11-20T12:04:40.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f155c0aaaa0 0x7f155c13a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c0a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.798 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c13ddb0 con 0x7f155c0aae80 2020-11-20T12:04:40.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c13dfe0 con 0x7f155c0aaaa0 2020-11-20T12:04:40.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1562ebf700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c13e280 con 0x7f155c0a85a0 2020-11-20T12:04:40.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1561ebd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f155c0aaaa0 0x7f155c13a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.799 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f15616bc700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c0a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1561ebd700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f155c0aaaa0 0x7f155c13a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37792/0 (socket says 172.21.15.161:37792) 2020-11-20T12:04:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.785+0000 7f1561ebd700 1 -- 172.21.15.161:0/3436235918 learned_addr learned my addr 172.21.15.161:0/3436235918 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1561ebd700 1 -- 172.21.15.161:0/3436235918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 msgr2=0x7f155c0a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:04:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1561ebd700 1 --2- 172.21.15.161:0/3436235918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c0a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1561ebd700 1 -- 172.21.15.161:0/3436235918 >> v1:172.21.15.186:6789/0 conn(0x7f155c0aae80 legacy=0x7f155c0a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1561ebd700 1 -- 172.21.15.161:0/3436235918 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c13e520 con 0x7f155c0aaaa0 2020-11-20T12:04:40.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1561ebd700 1 --2- 172.21.15.161:0/3436235918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aaaa0 0x7f155c13a7e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f154c006fd0 tx=0x7f154c006eb0).ready entity=mon.0 client_cookie=57d48b2a26a85a7a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1560ebb700 1 -- 172.21.15.161:0/3436235918 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c009810 con 0x7f155c0aaaa0 2020-11-20T12:04:40.801 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1560ebb700 1 -- 172.21.15.161:0/3436235918 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c009970 con 0x7f155c0aaaa0 2020-11-20T12:04:40.802 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1560ebb700 1 -- 172.21.15.161:0/3436235918 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c009cf0 con 0x7f155c0aaaa0 2020-11-20T12:04:40.804 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- 172.21.15.161:0/3436235918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aaaa0 msgr2=0x7f155c13a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 --2- 172.21.15.161:0/3436235918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aaaa0 0x7f155c13a7e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f154c006fd0 tx=0x7f154c006eb0).stop 2020-11-20T12:04:40.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- 172.21.15.161:0/3436235918 shutdown_connections 2020-11-20T12:04:40.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 --2- 172.21.15.161:0/3436235918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aaaa0 0x7f155c13a7e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.805 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 --2- 172.21.15.161:0/3436235918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c0a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- 172.21.15.161:0/3436235918 >> 172.21.15.161:0/3436235918 conn(0x7f155c061aa0 msgr2=0x7f155c067880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- 172.21.15.161:0/3436235918 shutdown_connections 2020-11-20T12:04:40.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- 172.21.15.161:0/3436235918 wait complete. 2020-11-20T12:04:40.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 Processor -- start 2020-11-20T12:04:40.806 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.789+0000 7f1562ebf700 1 -- start start 2020-11-20T12:04:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c1398c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f155c0aaaa0 0x7f155c09f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1498b0 con 0x7f155c0aae80 2020-11-20T12:04:40.807 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0a00e0 con 0x7f155c0aaaa0 2020-11-20T12:04:40.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c149aa0 con 0x7f155c0a85a0 2020-11-20T12:04:40.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37800/0 (socket says 172.21.15.161:37800) 2020-11-20T12:04:40.808 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 -- 172.21.15.161:0/912474069 learned_addr learned my addr 172.21.15.161:0/912474069 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1561ebd700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c1398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15616bc700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f155c0aaaa0 0x7f155c09f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 -- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 msgr2=0x7f155c1398c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c1398c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.809 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 -- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f155c0aaaa0 msgr2=0x7f155c09f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f155c0aaaa0 0x7f155c09f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 -- 172.21.15.161:0/912474069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0a1d80 con 0x7f155c0aae80 2020-11-20T12:04:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f15626be700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f155400ca60 tx=0x7f1554007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400a770 con 0x7f155c0aae80 2020-11-20T12:04:40.810 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400a8d0 con 0x7f155c0aae80 2020-11-20T12:04:40.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c09fcc0 con 0x7f155c0aae80 2020-11-20T12:04:40.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400ac50 con 0x7f155c0aae80 2020-11-20T12:04:40.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c14a650 con 0x7f155c0aae80 2020-11-20T12:04:40.811 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c0b09e0 con 0x7f155c0aae80 2020-11-20T12:04:40.812 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.793+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f1554010030 con 0x7f155c0aae80 2020-11-20T12:04:40.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.797+0000 7f1549ffb700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 0x7f1534057cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:40.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.797+0000 7f1561ebd700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 0x7f1534057cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:40.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.797+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f155406ea00 con 0x7f155c0aae80 2020-11-20T12:04:40.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.797+0000 7f1561ebd700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 0x7f1534057cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f154c00b1b0 tx=0x7f154c015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:40.813 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.801+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f155c0b09e0 con 0x7f155c0aae80 2020-11-20T12:04:40.973 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f155c0b09e0 con 0x7f15340557f0 2020-11-20T12:04:40.974 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1549ffb700 1 -- 172.21.15.161:0/912474069 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f155c0b09e0 con 0x7f15340557f0 2020-11-20T12:04:40.977 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 msgr2=0x7f1534057cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.977 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 0x7f1534057cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f154c00b1b0 tx=0x7f154c015000).stop 2020-11-20T12:04:40.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 msgr2=0x7f155c149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:40.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f155400ca60 tx=0x7f1554007f40).stop 2020-11-20T12:04:40.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 shutdown_connections 2020-11-20T12:04:40.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f15340557f0 0x7f1534057cb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.978 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f155c0aae80 0x7f155c149f40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f155c0a85a0 0x7f155c1398c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 --2- 172.21.15.161:0/912474069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f155c0aaaa0 0x7f155c09f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:40.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 >> 172.21.15.161:0/912474069 conn(0x7f155c061aa0 msgr2=0x7f155c13d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:40.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 shutdown_connections 2020-11-20T12:04:40.979 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:40.965+0000 7f1562ebf700 1 -- 172.21.15.161:0/912474069 wait complete. 2020-11-20T12:04:40.980 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T12:04:40.994 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:04:41.103 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.093+0000 7fdd62d42700 1 Processor -- start 2020-11-20T12:04:41.104 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.093+0000 7fdd62d42700 1 -- start start 2020-11-20T12:04:41.105 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:41.106 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0a6220 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5c0a9320 con 0x7fdd5c061540 2020-11-20T12:04:41.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0a9ed0 con 0x7fdd5c061160 2020-11-20T12:04:41.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62541700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdd5c0a5d10 0x7fdd5c13e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48052/0 (socket says 172.21.15.161:48052) 2020-11-20T12:04:41.107 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62541700 1 -- 172.21.15.161:0/1150889959 learned_addr learned my addr 172.21.15.161:0/1150889959 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:04:41.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd61d40700 1 --2- 172.21.15.161:0/1150889959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:41.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875137305 0 0) 0x7fdd5c0a6220 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd44003240 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004589681 0 0) 0x7fdd5c0a9320 con 0x7fdd5c061540 2020-11-20T12:04:41.108 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd5c0a6220 con 0x7fdd5c061540 2020-11-20T12:04:41.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2952874901 0 0) 0x7fdd44003240 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd61d40700 1 -- 172.21.15.161:0/1150889959 >> v1:172.21.15.186:6789/0 conn(0x7fdd5c061540 legacy=0x7fdd5c0a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd61d40700 1 -- 172.21.15.161:0/1150889959 >> v1:172.21.15.161:6789/0 conn(0x7fdd5c0a5d10 legacy=0x7fdd5c13e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd61d40700 1 -- 172.21.15.161:0/1150889959 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0a64c0 con 0x7fdd5c061160 2020-11-20T12:04:41.109 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd61d40700 1 --2- 172.21.15.161:0/1150889959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c0aa910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdd5800b9d0 tx=0x7fdd58006df0).ready entity=mon.2 client_cookie=b3019da792270db9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:41.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54001860 con 0x7fdd5c061160 2020-11-20T12:04:41.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58011400 con 0x7fdd5c061160 2020-11-20T12:04:41.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd60d3e700 1 -- 172.21.15.161:0/1150889959 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58011780 con 0x7fdd5c061160 2020-11-20T12:04:41.111 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- 172.21.15.161:0/1150889959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 msgr2=0x7fdd5c0aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 --2- 172.21.15.161:0/1150889959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c0aa910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdd5800b9d0 tx=0x7fdd58006df0).stop 2020-11-20T12:04:41.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- 172.21.15.161:0/1150889959 shutdown_connections 2020-11-20T12:04:41.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 --2- 172.21.15.161:0/1150889959 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c0aa910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- 172.21.15.161:0/1150889959 >> 172.21.15.161:0/1150889959 conn(0x7fdd5c0ae060 msgr2=0x7fdd5c0aa030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:41.112 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- 172.21.15.161:0/1150889959 shutdown_connections 2020-11-20T12:04:41.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.097+0000 7fdd62d42700 1 -- 172.21.15.161:0/1150889959 wait complete. 2020-11-20T12:04:41.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 Processor -- start 2020-11-20T12:04:41.113 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 -- start start 2020-11-20T12:04:41.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c065680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:41.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 0x7fdd5c133cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:41.115 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c1346a0 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0a1920 con 0x7fdd5c061540 2020-11-20T12:04:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62d42700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0a1bc0 con 0x7fdd5c061160 2020-11-20T12:04:41.116 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62541700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62541700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37816/0 (socket says 172.21.15.161:37816) 2020-11-20T12:04:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd62541700 1 -- 172.21.15.161:0/3801073844 learned_addr learned my addr 172.21.15.161:0/3801073844 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:04:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.101+0000 7fdd61d40700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c065680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd6153f700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 0x7fdd5c133cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:41.117 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 -- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 msgr2=0x7fdd5c065680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c065680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 -- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 msgr2=0x7fdd5c133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 0x7fdd5c133cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 -- 172.21.15.161:0/3801073844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c0a1e60 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.118 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd6153f700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 0x7fdd5c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:04:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62541700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fdd5400ce40 tx=0x7fdd54001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5400ab00 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5400ac60 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c0ac7d0 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.119 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c13db20 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54007170 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c044f60 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.120 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7fdd54010070 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 0x7fdd34057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:04:41.121 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdd5406e750 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd61d40700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 0x7fdd34057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:04:41.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.105+0000 7fdd61d40700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 0x7fdd34057c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd5800b150 tx=0x7fdd58015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:04:41.122 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.109+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fdd54044490 con 0x7fdd5c0a5d10 2020-11-20T12:04:41.271 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.261+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd5c13de20 con 0x7fdd340557c0 2020-11-20T12:04:41.284 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd49ffb700 1 -- 172.21.15.161:0/3801073844 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+106722 (secure 0 0 0) 0x7fdd5c13de20 con 0x7fdd340557c0 2020-11-20T12:04:41.284 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 msgr2=0x7fdd34057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 0x7fdd34057c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdd5800b150 tx=0x7fdd58015000).stop 2020-11-20T12:04:41.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 msgr2=0x7fdd5c1341b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:04:41.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fdd5400ce40 tx=0x7fdd54001570).stop 2020-11-20T12:04:41.285 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 shutdown_connections 2020-11-20T12:04:41.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7fdd340557c0 0x7fdd34057c80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd5c0a5d10 0x7fdd5c1341b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdd5c061160 0x7fdd5c065680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.286 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 --2- 172.21.15.161:0/3801073844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd5c061540 0x7fdd5c133cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:04:41.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 >> 172.21.15.161:0/3801073844 conn(0x7fdd5c0ae060 msgr2=0x7fdd5c0a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:04:41.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 shutdown_connections 2020-11-20T12:04:41.287 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:04:41.273+0000 7fdd62d42700 1 -- 172.21.15.161:0/3801073844 wait complete. 2020-11-20T12:04:41.287 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T12:04:41.288 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2020-11-20T12:04:41.296 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":797,"stamp":"2020-11-20T12:04:40.930715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240879681,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":175131,"num_write_kb":3344890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158227,"ondisk_log_size":158227,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2557440,"kb_used_data":472512,"kb_used_omap":0,"kb_used_meta":2084864,"kb_avail":752417280,"statfs":{"total":773094113280,"available":770475294720,"internally_reserved":0,"allocated":483852288,"data_stored":482565482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2134900736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"4.2","version":"24'11613","reported_seq":"11624","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:15.013750+0000","last_change":"2020-11-20T11:38:53.592096+0000","last_active":"2020-11-20T12:04:15.013750+0000","last_peered":"2020-11-20T12:04:15.013750+0000","last_clean":"2020-11-20T12:04:15.013750+0000","last_became_active":"2020-11-20T11:38:53.591457+0000","last_became_peered":"2020-11-20T11:38:53.591457+0000","last_unstale":"2020-11-20T12:04:15.013750+0000","last_undegraded":"2020-11-20T12:04:15.013750+0000","last_fullsized":"2020-11-20T12:04:15.013750+0000","mapping_epoch":22,"log_start":"24'1601","ondisk_log_start":"24'1601","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8925,"num_write_kb":345594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585163+0000","last_change":"2020-11-20T11:38:48.023124+0000","last_active":"2020-11-20T11:38:53.585163+0000","last_peered":"2020-11-20T11:38:53.585163+0000","last_clean":"2020-11-20T11:38:53.585163+0000","last_became_active":"2020-11-20T11:38:48.022698+0000","last_became_peered":"2020-11-20T11:38:48.022698+0000","last_unstale":"2020-11-20T11:38:53.585163+0000","last_undegraded":"2020-11-20T11:38:53.585163+0000","last_fullsized":"2020-11-20T11:38:53.585163+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'18652","reported_seq":"18664","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.727423+0000","last_change":"2020-11-20T11:38:50.587036+0000","last_active":"2020-11-20T12:04:19.727423+0000","last_peered":"2020-11-20T12:04:19.727423+0000","last_clean":"2020-11-20T12:04:19.727423+0000","last_became_active":"2020-11-20T11:38:50.586189+0000","last_became_peered":"2020-11-20T11:38:50.586189+0000","last_unstale":"2020-11-20T12:04:19.727423+0000","last_undegraded":"2020-11-20T12:04:19.727423+0000","last_fullsized":"2020-11-20T12:04:19.727423+0000","mapping_epoch":19,"log_start":"24'8600","ondisk_log_start":"24'8600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10052,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748896,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18671,"num_write_kb":107323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"24'12047","reported_seq":"12058","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.982363+0000","last_change":"2020-11-20T11:38:53.598885+0000","last_active":"2020-11-20T12:04:14.982363+0000","last_peered":"2020-11-20T12:04:14.982363+0000","last_clean":"2020-11-20T12:04:14.982363+0000","last_became_active":"2020-11-20T11:38:53.597636+0000","last_became_peered":"2020-11-20T11:38:53.597636+0000","last_unstale":"2020-11-20T12:04:14.982363+0000","last_undegraded":"2020-11-20T12:04:14.982363+0000","last_fullsized":"2020-11-20T12:04:14.982363+0000","mapping_epoch":22,"log_start":"24'2000","ondisk_log_start":"24'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9313,"num_write_kb":332205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582700+0000","last_change":"2020-11-20T11:38:47.415676+0000","last_active":"2020-11-20T11:38:53.582700+0000","last_peered":"2020-11-20T11:38:53.582700+0000","last_clean":"2020-11-20T11:38:53.582700+0000","last_became_active":"2020-11-20T11:38:47.415243+0000","last_became_peered":"2020-11-20T11:38:47.415243+0000","last_unstale":"2020-11-20T11:38:53.582700+0000","last_undegraded":"2020-11-20T11:38:53.582700+0000","last_fullsized":"2020-11-20T11:38:53.582700+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'12178","reported_seq":"12190","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.592685+0000","last_change":"2020-11-20T11:38:50.584681+0000","last_active":"2020-11-20T12:04:19.592685+0000","last_peered":"2020-11-20T12:04:19.592685+0000","last_clean":"2020-11-20T12:04:19.592685+0000","last_became_active":"2020-11-20T11:38:50.584020+0000","last_became_peered":"2020-11-20T11:38:50.584020+0000","last_unstale":"2020-11-20T12:04:19.592685+0000","last_undegraded":"2020-11-20T12:04:19.592685+0000","last_fullsized":"2020-11-20T12:04:19.592685+0000","mapping_epoch":19,"log_start":"24'2100","ondisk_log_start":"24'2100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10078,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12185,"num_write_kb":70894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"24'11355","reported_seq":"11366","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.898117+0000","last_change":"2020-11-20T11:38:53.592129+0000","last_active":"2020-11-20T12:04:14.898117+0000","last_peered":"2020-11-20T12:04:14.898117+0000","last_clean":"2020-11-20T12:04:14.898117+0000","last_became_active":"2020-11-20T11:38:53.591694+0000","last_became_peered":"2020-11-20T11:38:53.591694+0000","last_unstale":"2020-11-20T12:04:14.898117+0000","last_undegraded":"2020-11-20T12:04:14.898117+0000","last_fullsized":"2020-11-20T12:04:14.898117+0000","mapping_epoch":22,"log_start":"24'1301","ondisk_log_start":"24'1301","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10054,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":328628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.596154+0000","last_change":"2020-11-20T11:38:47.412146+0000","last_active":"2020-11-20T11:38:53.596154+0000","last_peered":"2020-11-20T11:38:53.596154+0000","last_clean":"2020-11-20T11:38:53.596154+0000","last_became_active":"2020-11-20T11:38:47.411779+0000","last_became_peered":"2020-11-20T11:38:47.411779+0000","last_unstale":"2020-11-20T11:38:53.596154+0000","last_undegraded":"2020-11-20T11:38:53.596154+0000","last_fullsized":"2020-11-20T11:38:53.596154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'14444","reported_seq":"14456","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:22.931108+0000","last_change":"2020-11-20T11:38:51.086358+0000","last_active":"2020-11-20T12:04:22.931108+0000","last_peered":"2020-11-20T12:04:22.931108+0000","last_clean":"2020-11-20T12:04:22.931108+0000","last_became_active":"2020-11-20T11:38:51.085703+0000","last_became_peered":"2020-11-20T11:38:51.085703+0000","last_unstale":"2020-11-20T12:04:22.931108+0000","last_undegraded":"2020-11-20T12:04:22.931108+0000","last_fullsized":"2020-11-20T12:04:22.931108+0000","mapping_epoch":19,"log_start":"24'4400","ondisk_log_start":"24'4400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10044,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35293517,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14475,"num_write_kb":86024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"24'11375","reported_seq":"11386","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.867600+0000","last_change":"2020-11-20T11:38:53.602580+0000","last_active":"2020-11-20T12:04:14.867600+0000","last_peered":"2020-11-20T12:04:14.867600+0000","last_clean":"2020-11-20T12:04:14.867600+0000","last_became_active":"2020-11-20T11:38:53.601406+0000","last_became_peered":"2020-11-20T11:38:53.601406+0000","last_unstale":"2020-11-20T12:04:14.867600+0000","last_undegraded":"2020-11-20T12:04:14.867600+0000","last_fullsized":"2020-11-20T12:04:14.867600+0000","mapping_epoch":22,"log_start":"24'1300","ondisk_log_start":"24'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":269399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.582779+0000","last_change":"2020-11-20T11:38:47.415730+0000","last_active":"2020-11-20T11:38:53.582779+0000","last_peered":"2020-11-20T11:38:53.582779+0000","last_clean":"2020-11-20T11:38:53.582779+0000","last_became_active":"2020-11-20T11:38:47.415074+0000","last_became_peered":"2020-11-20T11:38:47.415074+0000","last_unstale":"2020-11-20T11:38:53.582779+0000","last_undegraded":"2020-11-20T11:38:53.582779+0000","last_fullsized":"2020-11-20T11:38:53.582779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":"20","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598756+0000","last_change":"2020-11-20T11:38:42.662573+0000","last_active":"2020-11-20T11:38:53.598756+0000","last_peered":"2020-11-20T11:38:53.598756+0000","last_clean":"2020-11-20T11:38:53.598756+0000","last_became_active":"2020-11-20T11:38:42.661151+0000","last_became_peered":"2020-11-20T11:38:42.661151+0000","last_unstale":"2020-11-20T11:38:53.598756+0000","last_undegraded":"2020-11-20T11:38:53.598756+0000","last_fullsized":"2020-11-20T11:38:53.598756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:39.267196+0000","last_clean_scrub_stamp":"2020-11-20T11:38:39.267196+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'14770","reported_seq":"14782","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.667369+0000","last_change":"2020-11-20T11:38:50.576907+0000","last_active":"2020-11-20T12:04:19.667369+0000","last_peered":"2020-11-20T12:04:19.667369+0000","last_clean":"2020-11-20T12:04:19.667369+0000","last_became_active":"2020-11-20T11:38:50.576462+0000","last_became_peered":"2020-11-20T11:38:50.576462+0000","last_unstale":"2020-11-20T12:04:19.667369+0000","last_undegraded":"2020-11-20T12:04:19.667369+0000","last_fullsized":"2020-11-20T12:04:19.667369+0000","mapping_epoch":19,"log_start":"24'4700","ondisk_log_start":"24'4700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10070,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14791,"num_write_kb":88474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"24'11037","reported_seq":"11048","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.787435+0000","last_change":"2020-11-20T11:38:53.608371+0000","last_active":"2020-11-20T12:04:14.787435+0000","last_peered":"2020-11-20T12:04:14.787435+0000","last_clean":"2020-11-20T12:04:14.787435+0000","last_became_active":"2020-11-20T11:38:53.607661+0000","last_became_peered":"2020-11-20T11:38:53.607661+0000","last_unstale":"2020-11-20T12:04:14.787435+0000","last_undegraded":"2020-11-20T12:04:14.787435+0000","last_fullsized":"2020-11-20T12:04:14.787435+0000","mapping_epoch":22,"log_start":"24'1001","ondisk_log_start":"24'1001","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8436,"num_write_kb":207231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598787+0000","last_change":"2020-11-20T11:38:47.412658+0000","last_active":"2020-11-20T11:38:53.598787+0000","last_peered":"2020-11-20T11:38:53.598787+0000","last_clean":"2020-11-20T11:38:53.598787+0000","last_became_active":"2020-11-20T11:38:47.412241+0000","last_became_peered":"2020-11-20T11:38:47.412241+0000","last_unstale":"2020-11-20T11:38:53.598787+0000","last_undegraded":"2020-11-20T11:38:53.598787+0000","last_fullsized":"2020-11-20T11:38:53.598787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10893","reported_seq":"13336","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.542830+0000","last_change":"2020-11-20T11:38:50.579983+0000","last_active":"2020-11-20T12:04:19.542830+0000","last_peered":"2020-11-20T12:04:19.542830+0000","last_clean":"2020-11-20T12:04:19.542830+0000","last_became_active":"2020-11-20T11:38:50.579603+0000","last_became_peered":"2020-11-20T11:38:50.579603+0000","last_unstale":"2020-11-20T12:04:19.542830+0000","last_undegraded":"2020-11-20T12:04:19.542830+0000","last_fullsized":"2020-11-20T12:04:19.542830+0000","mapping_epoch":19,"log_start":"24'800","ondisk_log_start":"24'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10093,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2431,"num_read_kb":5766,"num_write":10900,"num_write_kb":58738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"24'11812","reported_seq":"11823","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.898523+0000","last_change":"2020-11-20T11:38:53.600590+0000","last_active":"2020-11-20T12:04:14.898523+0000","last_peered":"2020-11-20T12:04:14.898523+0000","last_clean":"2020-11-20T12:04:14.898523+0000","last_became_active":"2020-11-20T11:38:53.599863+0000","last_became_peered":"2020-11-20T11:38:53.599863+0000","last_unstale":"2020-11-20T12:04:14.898523+0000","last_undegraded":"2020-11-20T12:04:14.898523+0000","last_fullsized":"2020-11-20T12:04:14.898523+0000","mapping_epoch":22,"log_start":"24'1800","ondisk_log_start":"24'1800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9018,"num_write_kb":558745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.598714+0000","last_change":"2020-11-20T11:38:48.027432+0000","last_active":"2020-11-20T11:38:53.598714+0000","last_peered":"2020-11-20T11:38:53.598714+0000","last_clean":"2020-11-20T11:38:53.598714+0000","last_became_active":"2020-11-20T11:38:48.026363+0000","last_became_peered":"2020-11-20T11:38:48.026363+0000","last_unstale":"2020-11-20T11:38:53.598714+0000","last_undegraded":"2020-11-20T11:38:53.598714+0000","last_fullsized":"2020-11-20T11:38:53.598714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'11552","reported_seq":"11564","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:22.931248+0000","last_change":"2020-11-20T11:38:51.087122+0000","last_active":"2020-11-20T12:04:22.931248+0000","last_peered":"2020-11-20T12:04:22.931248+0000","last_clean":"2020-11-20T12:04:22.931248+0000","last_became_active":"2020-11-20T11:38:51.086037+0000","last_became_peered":"2020-11-20T11:38:51.086037+0000","last_unstale":"2020-11-20T12:04:22.931248+0000","last_undegraded":"2020-11-20T12:04:22.931248+0000","last_fullsized":"2020-11-20T12:04:22.931248+0000","mapping_epoch":19,"log_start":"24'1500","ondisk_log_start":"24'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10052,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33555075,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11581,"num_write_kb":66598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"24'11671","reported_seq":"11682","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:15.023708+0000","last_change":"2020-11-20T11:38:53.599915+0000","last_active":"2020-11-20T12:04:15.023708+0000","last_peered":"2020-11-20T12:04:15.023708+0000","last_clean":"2020-11-20T12:04:15.023708+0000","last_became_active":"2020-11-20T11:38:53.599001+0000","last_became_peered":"2020-11-20T11:38:53.599001+0000","last_unstale":"2020-11-20T12:04:15.023708+0000","last_undegraded":"2020-11-20T12:04:15.023708+0000","last_fullsized":"2020-11-20T12:04:15.023708+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10071,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8874,"num_write_kb":388797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7451","reported_seq":"7474","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:20.291206+0000","last_change":"2020-11-20T11:38:51.328159+0000","last_active":"2020-11-20T12:04:20.291206+0000","last_peered":"2020-11-20T12:04:20.291206+0000","last_clean":"2020-11-20T12:04:20.291206+0000","last_became_active":"2020-11-20T11:38:51.327330+0000","last_became_peered":"2020-11-20T11:38:51.327330+0000","last_unstale":"2020-11-20T12:04:20.291206+0000","last_undegraded":"2020-11-20T12:04:20.291206+0000","last_fullsized":"2020-11-20T12:04:20.291206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":7451,"ondisk_log_size":7451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21035951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":11,"num_read_kb":70,"num_write":7501,"num_write_kb":44392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.585363+0000","last_change":"2020-11-20T11:38:47.411462+0000","last_active":"2020-11-20T11:38:53.585363+0000","last_peered":"2020-11-20T11:38:53.585363+0000","last_clean":"2020-11-20T11:38:53.585363+0000","last_became_active":"2020-11-20T11:38:47.411044+0000","last_became_peered":"2020-11-20T11:38:47.411044+0000","last_unstale":"2020-11-20T11:38:53.585363+0000","last_undegraded":"2020-11-20T11:38:53.585363+0000","last_fullsized":"2020-11-20T11:38:53.585363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"24'11668","reported_seq":"11679","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:14.929843+0000","last_change":"2020-11-20T11:38:53.602316+0000","last_active":"2020-11-20T12:04:14.929843+0000","last_peered":"2020-11-20T12:04:14.929843+0000","last_clean":"2020-11-20T12:04:14.929843+0000","last_became_active":"2020-11-20T11:38:53.601560+0000","last_became_peered":"2020-11-20T11:38:53.601560+0000","last_unstale":"2020-11-20T12:04:14.929843+0000","last_undegraded":"2020-11-20T12:04:14.929843+0000","last_fullsized":"2020-11-20T12:04:14.929843+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:52.566618+0000","last_clean_scrub_stamp":"2020-11-20T11:38:52.566618+0000","log_size":10068,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8969,"num_write_kb":306187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-11-20T11:38:53.580277+0000","last_change":"2020-11-20T11:38:47.414164+0000","last_active":"2020-11-20T11:38:53.580277+0000","last_peered":"2020-11-20T11:38:53.580277+0000","last_clean":"2020-11-20T11:38:53.580277+0000","last_became_active":"2020-11-20T11:38:47.413633+0000","last_became_peered":"2020-11-20T11:38:47.413633+0000","last_unstale":"2020-11-20T11:38:53.580277+0000","last_undegraded":"2020-11-20T11:38:53.580277+0000","last_fullsized":"2020-11-20T11:38:53.580277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:46.382176+0000","last_clean_scrub_stamp":"2020-11-20T11:38:46.382176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'13610","reported_seq":"13622","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:19.700036+0000","last_change":"2020-11-20T11:38:50.583562+0000","last_active":"2020-11-20T12:04:19.700036+0000","last_peered":"2020-11-20T12:04:19.700036+0000","last_clean":"2020-11-20T12:04:19.700036+0000","last_became_active":"2020-11-20T11:38:50.583037+0000","last_became_peered":"2020-11-20T11:38:50.583037+0000","last_unstale":"2020-11-20T12:04:19.700036+0000","last_undegraded":"2020-11-20T12:04:19.700036+0000","last_fullsized":"2020-11-20T12:04:19.700036+0000","mapping_epoch":19,"log_start":"24'3600","ondisk_log_start":"24'3600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T11:38:49.551186+0000","last_clean_scrub_stamp":"2020-11-20T11:38:49.551186+0000","log_size":10010,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14212,"num_write_kb":85659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70813,"num_write_kb":2736786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80375,"ondisk_log_size":80375,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":240879681,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":104316,"num_write_kb":608102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":481820672,"data_stored":481759362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77850,"ondisk_log_size":77850,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575161,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":200968,"kb_used_data":20800,"kb_used_omap":0,"kb_used_meta":180160,"kb_avail":94170872,"statfs":{"total":96636764160,"available":96430972928,"internally_reserved":0,"allocated":21299200,"data_stored":21136716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":184483840},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":32.453000000000003,"15min":11.872},"min":{"1min":0.70699999999999996,"5min":0.52600000000000002,"15min":0.50800000000000001},"max":{"1min":2.0649999999999999,"5min":2116.4740000000002,"15min":2116.4740000000002},"last":1.377},{"interface":"front","average":{"1min":1.883,"5min":32.752000000000002,"15min":12.205},"min":{"1min":0.92300000000000004,"5min":0.71199999999999997,"15min":0.53600000000000003},"max":{"1min":3.8119999999999998,"5min":2116.5169999999998,"15min":2116.5169999999998},"last":3.4729999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":5.0190000000000001,"15min":2.7360000000000002},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.52700000000000002},"max":{"1min":19.291,"5min":52.777000000000001,"15min":52.777000000000001},"last":1.681},{"interface":"front","average":{"1min":3.2770000000000001,"5min":7.3639999999999999,"15min":3.5720000000000001},"min":{"1min":0.68799999999999994,"5min":0.59499999999999997,"15min":0.58499999999999996},"max":{"1min":19.581,"5min":207.23400000000001,"15min":207.23400000000001},"last":2.3530000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.591,"15min":1.6850000000000001},"min":{"1min":0.98099999999999998,"5min":0.71199999999999997,"15min":0.60199999999999998},"max":{"1min":2.7549999999999999,"5min":6.6840000000000002,"15min":7.742},"last":2.782},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.8140000000000001,"15min":1.9419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.60099999999999998},"max":{"1min":4.1100000000000003,"5min":5.4749999999999996,"15min":8.1899999999999995},"last":3.0840000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":5.1130000000000004,"15min":3.097},"min":{"1min":1.056,"5min":0.876,"15min":0.69099999999999995},"max":{"1min":4.2220000000000004,"5min":212.76300000000001,"15min":212.76300000000001},"last":2.4550000000000001},{"interface":"front","average":{"1min":2.306,"5min":5.2370000000000001,"15min":3.2530000000000001},"min":{"1min":0.93700000000000006,"5min":0.88200000000000001,"15min":0.85699999999999998},"max":{"1min":4.1980000000000004,"5min":212.83799999999999,"15min":212.83799999999999},"last":2.6749999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.7170000000000001,"15min":1.9179999999999999},"min":{"1min":0.88,"5min":0.79900000000000004,"15min":0.72799999999999998},"max":{"1min":3.4849999999999999,"5min":8.9629999999999992,"15min":13.430999999999999},"last":3.2410000000000001},{"interface":"front","average":{"1min":1.8859999999999999,"5min":2.137,"15min":2.1970000000000001},"min":{"1min":1.0569999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"max":{"1min":3.048,"5min":8.6210000000000004,"15min":9.3109999999999999},"last":2.9830000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.4169999999999998,"5min":2.645,"15min":2.4140000000000001},"min":{"1min":1.0269999999999999,"5min":0.81699999999999995,"15min":0.78600000000000003},"max":{"1min":4.2510000000000003,"5min":24.559000000000001,"15min":24.559000000000001},"last":3.8149999999999999},{"interface":"front","average":{"1min":2.3100000000000001,"5min":2.593,"15min":2.48},"min":{"1min":1.014,"5min":0.94399999999999995,"15min":0.88100000000000001},"max":{"1min":3.6360000000000001,"5min":24.847999999999999,"15min":24.847999999999999},"last":2.8199999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":2.3109999999999999,"15min":2.512},"min":{"1min":1.103,"5min":1.103,"15min":0.98099999999999998},"max":{"1min":3.782,"5min":9.2739999999999991,"15min":13.81},"last":3.0259999999999998},{"interface":"front","average":{"1min":2.1859999999999999,"5min":2.3039999999999998,"15min":2.4279999999999999},"min":{"1min":1.1639999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.4630000000000001,"5min":7.1020000000000003,"15min":8.9559999999999995},"last":3.169}]}]},{"osd":6,"up_from":13,"seq":55834575161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91072,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":90816,"kb_avail":94280768,"statfs":{"total":96636764160,"available":96543506432,"internally_reserved":0,"allocated":253952,"data_stored":100765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92995584},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":20.858000000000001,"15min":10.361000000000001},"min":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.52200000000000002},"max":{"1min":1.9990000000000001,"5min":1335.944,"15min":1335.944},"last":2.6760000000000002},{"interface":"front","average":{"1min":1.538,"5min":21.170999999999999,"15min":10.725},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"max":{"1min":2.9550000000000001,"5min":1336.0409999999999,"15min":1336.0409999999999},"last":2.5129999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.8599999999999999,"5min":3.5910000000000002,"15min":5.8570000000000002},"min":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.56399999999999995},"max":{"1min":26.742999999999999,"5min":40.345999999999997,"15min":725.73900000000003},"last":1.8460000000000001},{"interface":"front","average":{"1min":2.8079999999999998,"5min":3.9390000000000001,"15min":6.2930000000000001},"min":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"max":{"1min":26.501999999999999,"5min":41.792999999999999,"15min":721.18799999999999},"last":1.77}]},{"osd":2,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":1.7769999999999999,"15min":4.1340000000000003},"min":{"1min":0.88500000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"max":{"1min":5.8659999999999997,"5min":7.3540000000000001,"15min":720.64499999999998},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.903,"5min":1.9510000000000001,"15min":4.1929999999999996},"min":{"1min":0.88800000000000001,"5min":0.70699999999999996,"15min":0.68999999999999995},"max":{"1min":4.2629999999999999,"5min":11.244999999999999,"15min":725.26999999999998},"last":1.361}]},{"osd":3,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":6.2919999999999998,"5min":2.9409999999999998,"15min":5.1180000000000003},"min":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.65200000000000002},"max":{"1min":89.606999999999999,"5min":89.606999999999999,"15min":722.21600000000001},"last":2.1629999999999998},{"interface":"front","average":{"1min":6.7370000000000001,"5min":3.0379999999999998,"15min":5.194},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.79700000000000004},"max":{"1min":89.668999999999997,"5min":89.668999999999997,"15min":720.30899999999997},"last":3.4199999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.9059999999999999,"15min":4.306},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.69399999999999995},"max":{"1min":3.552,"5min":5.1820000000000004,"15min":726.67999999999995},"last":2.222},{"interface":"front","average":{"1min":2.0720000000000001,"5min":2.2309999999999999,"15min":4.6849999999999996},"min":{"1min":0.98999999999999999,"5min":0.96799999999999997,"15min":0.748},"max":{"1min":3.3999999999999999,"5min":6.7679999999999998,"15min":724.88699999999994},"last":2.9470000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.1749999999999998,"15min":4.7329999999999997},"min":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.872},"max":{"1min":4.3620000000000001,"5min":5.2229999999999999,"15min":721.94000000000005},"last":3.0510000000000002},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.2269999999999999,"15min":4.7640000000000002},"min":{"1min":1.1379999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":4.3230000000000004,"5min":5.3250000000000002,"15min":728.56399999999996},"last":2.5659999999999998}]},{"osd":7,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":2.3370000000000002,"15min":4.8739999999999997},"min":{"1min":1.0129999999999999,"5min":0.97199999999999998,"15min":0.81100000000000005},"max":{"1min":3.48,"5min":7.173,"15min":729},"last":2.7530000000000001},{"interface":"front","average":{"1min":2.3490000000000002,"5min":2.2069999999999999,"15min":4.8070000000000004},"min":{"1min":1.24,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.6739999999999999,"5min":6.1210000000000004,"15min":728.80600000000004},"last":3.79}]}]},{"osd":1,"up_from":13,"seq":55834575161,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":485740,"kb_used_data":100260,"kb_used_omap":0,"kb_used_meta":385472,"kb_avail":93886100,"statfs":{"total":96636764160,"available":96139366400,"internally_reserved":0,"allocated":102666240,"data_stored":102503789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":394723328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":9.1080000000000005,"5min":42.454000000000001,"15min":15.585000000000001},"min":{"1min":0.56699999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":51.396000000000001,"5min":2981.1959999999999,"15min":2981.1959999999999},"last":1.6499999999999999},{"interface":"front","average":{"1min":3.4430000000000001,"5min":42.100999999999999,"15min":15.234999999999999},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46500000000000002},"max":{"1min":30.646000000000001,"5min":2972.6509999999998,"15min":2972.6509999999998},"last":1.3320000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":4.9260000000000002,"5min":4.6420000000000003,"15min":2.819},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.50700000000000001},"max":{"1min":39.003,"5min":74.406000000000006,"15min":74.406000000000006},"last":2.0739999999999998},{"interface":"front","average":{"1min":5.673,"5min":4.7469999999999999,"15min":2.6720000000000002},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"max":{"1min":51.466999999999999,"5min":51.466999999999999,"15min":51.466999999999999},"last":2.1259999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":5.6600000000000001,"5min":6.7830000000000004,"15min":3.8730000000000002},"min":{"1min":0.80600000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":51.292999999999999,"5min":89.393000000000001,"15min":89.393000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":6.032,"5min":6.2160000000000002,"15min":3.1930000000000001},"min":{"1min":0.70999999999999996,"5min":0.624,"15min":0.58999999999999997},"max":{"1min":51.090000000000003,"5min":87.826999999999998,"15min":87.826999999999998},"last":2.3879999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":12.832000000000001,"5min":6.4009999999999998,"15min":3.456},"min":{"1min":0.94799999999999995,"5min":0.70199999999999996,"15min":0.60399999999999998},"max":{"1min":181.52000000000001,"5min":181.52000000000001,"15min":181.52000000000001},"last":2.4969999999999999},{"interface":"front","average":{"1min":7.3170000000000002,"5min":5.5709999999999997,"15min":3.5049999999999999},"min":{"1min":0.86699999999999999,"5min":0.79700000000000004,"15min":0.76700000000000002},"max":{"1min":53.615000000000002,"5min":60.997999999999998,"15min":60.997999999999998},"last":2.29}]},{"osd":5,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":6.367,"5min":5.7480000000000002,"15min":3.7829999999999999},"min":{"1min":0.97099999999999997,"5min":0.95499999999999996,"15min":0.72899999999999998},"max":{"1min":53.555999999999997,"5min":59.052999999999997,"15min":98.697999999999993},"last":2.782},{"interface":"front","average":{"1min":8.5860000000000003,"5min":6.8179999999999996,"15min":4.5030000000000001},"min":{"1min":0.98199999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":54.229999999999997,"5min":61.18,"15min":98.759},"last":3.1200000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":6.944,"15min":4.2199999999999998},"min":{"1min":1.3919999999999999,"5min":0.97799999999999998,"15min":0.84199999999999997},"max":{"1min":181.87299999999999,"5min":181.87299999999999,"15min":181.87299999999999},"last":2.7349999999999999},{"interface":"front","average":{"1min":6.5179999999999998,"5min":7.375,"15min":3.9100000000000001},"min":{"1min":1.327,"5min":1.1439999999999999,"15min":0.98099999999999998},"max":{"1min":53.758000000000003,"5min":59.18,"15min":59.18},"last":2.5960000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":7.5940000000000003,"5min":8.6050000000000004,"15min":4.7270000000000003},"min":{"1min":1.155,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":54.158999999999999,"5min":162.124,"15min":162.124},"last":2.6800000000000002},{"interface":"front","average":{"1min":13.234999999999999,"5min":8.9719999999999995,"15min":4.6920000000000002},"min":{"1min":1.2310000000000001,"5min":0.95599999999999996,"15min":0.92400000000000004},"max":{"1min":177.50200000000001,"5min":177.50200000000001,"15min":177.50200000000001},"last":2.948}]}]},{"osd":0,"up_from":13,"seq":55834575160,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421636,"kb_used_data":78076,"kb_used_omap":0,"kb_used_meta":343552,"kb_avail":93950204,"statfs":{"total":96636764160,"available":96205008896,"internally_reserved":0,"allocated":79949824,"data_stored":79792575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351797248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":6.0469999999999997,"5min":5.7089999999999996,"15min":3.1520000000000001},"min":{"1min":0.73599999999999999,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":32.566000000000003,"5min":35.283000000000001,"15min":81.277000000000001},"last":2.5009999999999999},{"interface":"front","average":{"1min":5.54,"5min":6.9889999999999999,"15min":3.8570000000000002},"min":{"1min":0.60099999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":32.427,"5min":40.186999999999998,"15min":81.471000000000004},"last":2.2599999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":2.1139999999999999,"15min":1.847},"min":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.48999999999999999},"max":{"1min":6.3360000000000003,"5min":38.624000000000002,"15min":38.624000000000002},"last":1.76},{"interface":"front","average":{"1min":2.1669999999999998,"5min":2.8359999999999999,"15min":2.0649999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.47899999999999998},"max":{"1min":8.8130000000000006,"5min":40.667999999999999,"15min":40.667999999999999},"last":1.8149999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":2.5350000000000001,"15min":1.9970000000000001},"min":{"1min":0.68600000000000005,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":8.7089999999999996,"5min":22.062999999999999,"15min":22.062999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.645,"15min":2.214},"min":{"1min":0.80200000000000005,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":5.9329999999999998,"5min":29.331,"15min":29.331},"last":2.0939999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":3.3999999999999999,"15min":4.9660000000000002},"min":{"1min":0.75800000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":5.7119999999999997,"5min":40.356999999999999,"15min":737.07799999999997},"last":2.452},{"interface":"front","average":{"1min":2.7650000000000001,"5min":2.6139999999999999,"15min":4.6360000000000001},"min":{"1min":1.107,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":8.8520000000000003,"5min":22.334,"15min":736.77800000000002},"last":2.2959999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":6.4359999999999999,"15min":4.4699999999999998},"min":{"1min":0.99199999999999999,"5min":0.79000000000000004,"15min":0.72799999999999998},"max":{"1min":6.5190000000000001,"5min":300.21800000000002,"15min":300.21800000000002},"last":1.452},{"interface":"front","average":{"1min":2.1709999999999998,"5min":6.6600000000000001,"15min":4.7060000000000004},"min":{"1min":0.95099999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":5.7910000000000004,"5min":300.31799999999998,"15min":300.31799999999998},"last":2.6469999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.9039999999999999,"5min":3.649,"15min":3.2679999999999998},"min":{"1min":1.1919999999999999,"5min":0.89800000000000002,"15min":0.86499999999999999},"max":{"1min":8.9740000000000002,"5min":52.329000000000001,"15min":144.44200000000001},"last":2.8039999999999998},{"interface":"front","average":{"1min":2.1899999999999999,"5min":3.2360000000000002,"15min":3.1589999999999998},"min":{"1min":1.23,"5min":0.96099999999999997,"15min":0.82199999999999995},"max":{"1min":6.133,"5min":29.690999999999999,"15min":143.72399999999999},"last":1.929}]},{"osd":7,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":3.75,"15min":2.891},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":0.95399999999999996},"max":{"1min":5.9699999999999998,"5min":40.509,"15min":40.509},"last":2.8570000000000002},{"interface":"front","average":{"1min":3.004,"5min":3.4300000000000002,"15min":2.629},"min":{"1min":1.2070000000000001,"5min":1.0449999999999999,"15min":1.034},"max":{"1min":8.9130000000000003,"5min":30.167999999999999,"15min":30.167999999999999},"last":3.2469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575161,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283756,"kb_used_data":67492,"kb_used_omap":0,"kb_used_meta":216256,"kb_avail":94088084,"statfs":{"total":96636764160,"available":96346198016,"internally_reserved":0,"allocated":69111808,"data_stored":68949357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221446144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":80.144999999999996,"15min":28.204000000000001},"min":{"1min":0.63200000000000001,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":11.33,"5min":5512.3900000000003,"15min":5512.3900000000003},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":79.501000000000005,"15min":27.98},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.02,"5min":5508.7870000000003,"15min":5508.7870000000003},"last":1.593}]},{"osd":1,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":8.0440000000000005,"5min":6.569,"15min":7.0469999999999997},"min":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.49299999999999999},"max":{"1min":30.960999999999999,"5min":71.078999999999994,"15min":812.93899999999996},"last":1.671},{"interface":"front","average":{"1min":8.6359999999999992,"5min":6.6500000000000004,"15min":7.3159999999999998},"min":{"1min":0.71099999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":31.152999999999999,"5min":71.881,"15min":824.13699999999994},"last":2.1030000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.597,"15min":1.9750000000000001},"min":{"1min":0.80000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.0629999999999997,"5min":7.8460000000000001,"15min":100.506},"last":2.0510000000000002},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.7849999999999999,"15min":2.1320000000000001},"min":{"1min":0.88700000000000001,"5min":0.68300000000000005,"15min":0.58999999999999997},"max":{"1min":4.6109999999999998,"5min":6.8300000000000001,"15min":101.16800000000001},"last":2.3570000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":2.4969999999999999,"15min":3.8690000000000002},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67600000000000005},"max":{"1min":3.7000000000000002,"5min":74.609999999999999,"15min":277.25},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6869999999999998,"15min":4.0970000000000004},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.2060000000000004,"5min":79.671999999999997,"15min":278.44600000000003},"last":2.2719999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":2.4590000000000001,"15min":6.3259999999999996},"min":{"1min":1.228,"5min":0.88300000000000001,"15min":0.69999999999999996},"max":{"1min":4.9790000000000001,"5min":7.4989999999999997,"15min":486.85599999999999},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1800000000000002,"15min":6.202},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"max":{"1min":6.0380000000000003,"5min":8.3320000000000007,"15min":487.04700000000003},"last":2.3319999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":2.7269999999999999,"15min":4.2050000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":4.532,"5min":70.768000000000001,"15min":277.32400000000001},"last":2.52},{"interface":"front","average":{"1min":2.3109999999999999,"5min":3.016,"15min":4.3650000000000002},"min":{"1min":1.296,"5min":1.0649999999999999,"15min":0.81100000000000005},"max":{"1min":4.7359999999999998,"5min":70.599999999999994,"15min":276.94499999999999},"last":2.722}]},{"osd":7,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":3.6419999999999999,"15min":4.5499999999999998},"min":{"1min":1.153,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":5.9139999999999997,"5min":74.421999999999997,"15min":282.084},"last":2.548},{"interface":"front","average":{"1min":2.2429999999999999,"5min":3.738,"15min":4.6689999999999996},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":4.3319999999999999,"5min":74.719999999999999,"15min":281.82299999999998},"last":3.1019999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":438032,"kb_used_data":90440,"kb_used_omap":0,"kb_used_meta":347584,"kb_avail":93933808,"statfs":{"total":96636764160,"available":96188219392,"internally_reserved":0,"allocated":92610560,"data_stored":92440044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":355926016},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":31.047999999999998,"15min":11.473000000000001},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":11.35,"5min":2604.2579999999998,"15min":2604.2579999999998},"last":2.2749999999999999},{"interface":"front","average":{"1min":2.101,"5min":30.957000000000001,"15min":11.455},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.210000000000001,"5min":2602.6849999999999,"15min":2602.6849999999999},"last":2.0019999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.3849999999999998,"5min":4.282,"15min":2.395},"min":{"1min":0.68500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":23.425999999999998,"5min":49.542999999999999,"15min":49.542999999999999},"last":1.9199999999999999},{"interface":"front","average":{"1min":3.7000000000000002,"5min":4.4710000000000001,"15min":2.6120000000000001},"min":{"1min":0.68999999999999995,"5min":0.57299999999999995,"15min":0.56399999999999995},"max":{"1min":20.125,"5min":31.414000000000001,"15min":31.414000000000001},"last":1.5249999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":2.1960000000000002,"15min":1.823},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"max":{"1min":6.1710000000000003,"5min":16.135999999999999,"15min":16.135999999999999},"last":1.633},{"interface":"front","average":{"1min":1.794,"5min":2.3420000000000001,"15min":1.988},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.61199999999999999},"max":{"1min":4.3550000000000004,"5min":16.859000000000002,"15min":16.859000000000002},"last":2.625}]},{"osd":4,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":2.6000000000000001,"15min":1.9910000000000001},"min":{"1min":0.90400000000000003,"5min":0.71799999999999997,"15min":0.628},"max":{"1min":5.7610000000000001,"5min":65.238,"15min":65.238},"last":1.6739999999999999},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.1850000000000001,"15min":2.395},"min":{"1min":1.073,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":6.2969999999999997,"5min":65.281999999999996,"15min":65.281999999999996},"last":2.6899999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":5.734,"15min":3.2970000000000002},"min":{"1min":0.90300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":6.4260000000000002,"5min":297.14100000000002,"15min":297.14100000000002},"last":3.1760000000000002},{"interface":"front","average":{"1min":2.2450000000000001,"5min":5.843,"15min":3.3559999999999999},"min":{"1min":1.298,"5min":0.83099999999999996,"15min":0.79000000000000004},"max":{"1min":5.3200000000000003,"5min":297.178,"15min":297.178},"last":3.452}]},{"osd":6,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":3.468,"15min":2.6150000000000002},"min":{"1min":1.337,"5min":0.92400000000000004,"15min":0.90000000000000002},"max":{"1min":5.8559999999999999,"5min":70.016000000000005,"15min":70.016000000000005},"last":3.0659999999999998},{"interface":"front","average":{"1min":2.2549999999999999,"5min":2.9039999999999999,"15min":2.206},"min":{"1min":1.075,"5min":0.877,"15min":0.753},"max":{"1min":6.2000000000000002,"5min":65.394999999999996,"15min":65.394999999999996},"last":2.2000000000000002}]},{"osd":7,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.024,"5min":3.4009999999999998,"15min":2.8940000000000001},"min":{"1min":1.093,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":9.3599999999999994,"5min":62.003999999999998,"15min":143.607},"last":2.823},{"interface":"front","average":{"1min":2.7429999999999999,"5min":3.8399999999999999,"15min":2.7949999999999999},"min":{"1min":1.171,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":9.7699999999999996,"5min":62.216000000000001,"15min":62.216000000000001},"last":2.96}]}]},{"osd":4,"up_from":13,"seq":55834575161,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257284,"kb_used_data":45308,"kb_used_omap":0,"kb_used_meta":211968,"kb_avail":94114556,"statfs":{"total":96636764160,"available":96373305344,"internally_reserved":0,"allocated":46395392,"data_stored":46238143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":217055232},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":72.212999999999994,"15min":25.486000000000001},"min":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.1720000000000002,"5min":4575.527,"15min":4575.527},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.704,"5min":72.381,"15min":28.355},"min":{"1min":0.72699999999999998,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":4.0049999999999999,"5min":4579.8609999999999,"15min":4579.8609999999999},"last":1.681}]},{"osd":1,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":3.8069999999999999,"15min":8.282},"min":{"1min":0.76500000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":8.8719999999999999,"5min":30.622,"15min":752.74000000000001},"last":2.2029999999999998},{"interface":"front","average":{"1min":2.0529999999999999,"5min":4.6479999999999997,"15min":5.9169999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":9.6229999999999993,"5min":47.741999999999997,"15min":594.72199999999998},"last":1.7849999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":1.96,"5min":1.8140000000000001,"15min":4.8360000000000003},"min":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.67700000000000005},"max":{"1min":4.9630000000000001,"5min":6.7380000000000004,"15min":752.94799999999998},"last":2.6659999999999999},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.994,"15min":2.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":3.5880000000000001,"5min":6.8719999999999999,"15min":31.030000000000001},"last":2.375}]},{"osd":3,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":1.9419999999999999,"15min":2.3039999999999998},"min":{"1min":1.107,"5min":0.747,"15min":0.747},"max":{"1min":15.199999999999999,"5min":15.199999999999999,"15min":124.405},"last":2.4300000000000002},{"interface":"front","average":{"1min":2.746,"5min":2.157,"15min":5.2629999999999999},"min":{"1min":0.89500000000000002,"5min":0.73799999999999999,"15min":0.68100000000000005},"max":{"1min":15.885999999999999,"5min":15.885999999999999,"15min":753.07100000000003},"last":1.8660000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":2.573,"15min":2.335},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2330000000000001,"5min":65.716999999999999,"15min":65.716999999999999},"last":2.7959999999999998},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.5680000000000001,"15min":2.3300000000000001},"min":{"1min":1.0960000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":4.0830000000000002,"5min":64.546000000000006,"15min":64.546000000000006},"last":2.077}]},{"osd":6,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":2.1360000000000001,"15min":5.7910000000000004},"min":{"1min":1.073,"5min":0.93500000000000005,"15min":0.79000000000000004},"max":{"1min":5.0750000000000002,"5min":6.6120000000000001,"15min":753.18700000000001},"last":3.0499999999999998},{"interface":"front","average":{"1min":2.3919999999999999,"5min":2.2999999999999998,"15min":3.0139999999999998},"min":{"1min":1.155,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.593,"5min":11.848000000000001,"15min":178.023},"last":2.153}]},{"osd":7,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":2.351,"15min":2.423},"min":{"1min":1.373,"5min":1.006,"15min":0.94899999999999995},"max":{"1min":4.4580000000000002,"5min":6.9950000000000001,"15min":7.3079999999999998},"last":2.7509999999999999},{"interface":"front","average":{"1min":2.5800000000000001,"5min":2.456,"15min":5.3520000000000003},"min":{"1min":1.343,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":5.5300000000000002,"5min":6.4610000000000003,"15min":753.30100000000004},"last":3.2629999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575161,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378952,"kb_used_data":69888,"kb_used_omap":0,"kb_used_meta":309056,"kb_avail":93992888,"statfs":{"total":96636764160,"available":96248717312,"internally_reserved":0,"allocated":71565312,"data_stored":71404093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316473344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":78.034999999999997,"15min":27.175999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":2.6469999999999998,"5min":4320.9859999999999,"15min":4320.9859999999999},"last":2.0529999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":78.102999999999994,"15min":27.228000000000002},"min":{"1min":0.66200000000000003,"5min":0.624,"15min":0.50900000000000001},"max":{"1min":2.4550000000000001,"5min":4324.4759999999997,"15min":4324.4759999999997},"last":1.7470000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":6.3230000000000004,"5min":6.6420000000000003,"15min":5.2039999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":42.215000000000003,"5min":97.617999999999995,"15min":532.33500000000004},"last":1.347},{"interface":"front","average":{"1min":6.5579999999999998,"5min":7.0579999999999998,"15min":5.556},"min":{"1min":0.81499999999999995,"5min":0.60899999999999999,"15min":0.57399999999999995},"max":{"1min":42.776000000000003,"5min":97.906000000000006,"15min":525.60599999999999},"last":2.73}]},{"osd":2,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.609,"15min":2.266},"min":{"1min":0.69699999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9889999999999999,"5min":86.805000000000007,"15min":86.805000000000007},"last":1.9419999999999999},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.4159999999999999,"15min":2.222},"min":{"1min":0.72899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.3150000000000004,"5min":86.688000000000002,"15min":86.688000000000002},"last":2.5179999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0459999999999998,"15min":2.609},"min":{"1min":0.82999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":6.5759999999999996,"5min":87.418999999999997,"15min":87.418999999999997},"last":1.2050000000000001},{"interface":"front","average":{"1min":2.0649999999999999,"5min":3.0779999999999998,"15min":2.5670000000000002},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.516,"5min":87.192999999999998,"15min":87.192999999999998},"last":2.1349999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.7879999999999998,"15min":2.6070000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.8730000000000002,"5min":86.876000000000005,"15min":86.876000000000005},"last":2.391},{"interface":"front","average":{"1min":2.218,"5min":2.919,"15min":2.7269999999999999},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0019999999999998,"5min":87.581999999999994,"15min":87.581999999999994},"last":2.3180000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.919,"15min":2.7669999999999999},"min":{"1min":0.92000000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":5.2830000000000004,"5min":87.760999999999996,"15min":87.760999999999996},"last":2.8879999999999999},{"interface":"front","average":{"1min":2.2629999999999999,"5min":3.153,"15min":2.968},"min":{"1min":1.0329999999999999,"5min":0.89600000000000002,"15min":0.88},"max":{"1min":4.0629999999999997,"5min":87.366,"15min":87.366},"last":2.9689999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.5350000000000001,"5min":3.1459999999999999,"15min":3.048},"min":{"1min":1.161,"5min":1.1060000000000001,"15min":1.024},"max":{"1min":4.8330000000000002,"5min":87.825000000000003,"15min":87.825000000000003},"last":2.6469999999999998},{"interface":"front","average":{"1min":2.6520000000000001,"5min":3.2450000000000001,"15min":3.081},"min":{"1min":1.169,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":5.0979999999999999,"5min":87.489000000000004,"15min":87.489000000000004},"last":3.254}]}]}]}} 2020-11-20T12:04:41.301 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.301 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.302 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.302 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.302 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.303 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.303 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.303 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.304 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.304 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.304 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.304 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T11:38:39.267196+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=39, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.305 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.305 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.305 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.306 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.306 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.306 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.307 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.307 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.308 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.308 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.308 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T11:38:52.566618+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=52, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.309 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T11:38:46.382176+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=46, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.309 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-11-20T11:38:49.551186+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=11, tm_min=38, tm_sec=49, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=4, tm_sec=36, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:04:41.309 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T12:05:01.311 INFO:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:05:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 Processor -- start 2020-11-20T12:05:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 -- start start 2020-11-20T12:05:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f744405be80 0x7f74440a9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f74440a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74440a5340 con 0x7f74440a7fc0 2020-11-20T12:05:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74440a9f00 con 0x7f744405be80 2020-11-20T12:05:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f744a19a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74440a55e0 con 0x7f74440a7260 2020-11-20T12:05:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7449999700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f74440a7fc0 0x7f74440a8470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48066/0 (socket says 172.21.15.161:48066) 2020-11-20T12:05:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7449999700 1 -- 172.21.15.161:0/145918633 learned_addr learned my addr 172.21.15.161:0/145918633 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:05:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7449198700 1 --2- 172.21.15.161:0/145918633 >> v2:172.21.15.186:3300/0 conn(0x7f744405be80 0x7f74440a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7448997700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f74440a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276300188 0 0) 0x7f74440a5340 con 0x7f74440a7fc0 2020-11-20T12:05:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.429+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f742c003240 con 0x7f74440a7fc0 2020-11-20T12:05:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7449198700 1 -- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 msgr2=0x7f74440a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:05:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7449198700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f74440a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7449198700 1 -- 172.21.15.161:0/145918633 >> v1:172.21.15.161:6789/0 conn(0x7f74440a7fc0 legacy=0x7f74440a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2825060055 0 0) 0x7f742c003240 con 0x7f74440a7fc0 2020-11-20T12:05:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7449198700 1 -- 172.21.15.161:0/145918633 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74440a5880 con 0x7f744405be80 2020-11-20T12:05:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7448997700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f74440a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:05:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7449198700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f744405be80 0x7f74440a9520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f743c006fd0 tx=0x7f743c0091a0).ready entity=mon.1 client_cookie=3d8855978d36485b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400014e0 con 0x7f744405be80 2020-11-20T12:05:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c005a50 con 0x7f744405be80 2020-11-20T12:05:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f7433fff700 1 -- 172.21.15.161:0/145918633 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c005dd0 con 0x7f744405be80 2020-11-20T12:05:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f744405be80 msgr2=0x7f74440a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.449 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f744405be80 0x7f74440a9520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f743c006fd0 tx=0x7f743c0091a0).stop 2020-11-20T12:05:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- 172.21.15.161:0/145918633 shutdown_connections 2020-11-20T12:05:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f744405be80 0x7f74440a9520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 --2- 172.21.15.161:0/145918633 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f74440a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.450 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- 172.21.15.161:0/145918633 >> 172.21.15.161:0/145918633 conn(0x7f74440ad620 msgr2=0x7f74440ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:05:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- 172.21.15.161:0/145918633 shutdown_connections 2020-11-20T12:05:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- 172.21.15.161:0/145918633 wait complete. 2020-11-20T12:05:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 Processor -- start 2020-11-20T12:05:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.433+0000 7f744a19a700 1 -- start start 2020-11-20T12:05:01.451 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f744409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 0x7f74440ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744409f980 con 0x7f744405be80 2020-11-20T12:05:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744409fb70 con 0x7f74440a7fc0 2020-11-20T12:05:01.452 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744409fe10 con 0x7f74440a7260 2020-11-20T12:05:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37828/0 (socket says 172.21.15.161:37828) 2020-11-20T12:05:01.453 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 -- 172.21.15.161:0/1984698377 learned_addr learned my addr 172.21.15.161:0/1984698377 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:05:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7448997700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f744409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449999700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 0x7f74440ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 -- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 msgr2=0x7f744409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.454 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f744409d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 -- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 msgr2=0x7f74440ac9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 0x7f74440ac9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 -- 172.21.15.161:0/1984698377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744409dbe0 con 0x7f744405be80 2020-11-20T12:05:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449999700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 0x7f74440ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:05:01.455 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7449198700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f74440648a0 tx=0x7f743c013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c006540 con 0x7f744405be80 2020-11-20T12:05:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c0066a0 con 0x7f744405be80 2020-11-20T12:05:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744412c580 con 0x7f744405be80 2020-11-20T12:05:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c011400 con 0x7f744405be80 2020-11-20T12:05:01.456 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74440ad060 con 0x7f744405be80 2020-11-20T12:05:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74440ad280 con 0x7f744405be80 2020-11-20T12:05:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f743c026030 con 0x7f744405be80 2020-11-20T12:05:01.457 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 0x7f741c057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f743c06ff00 con 0x7f744405be80 2020-11-20T12:05:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.437+0000 7f7448997700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 0x7f741c057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.441+0000 7f7448997700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 0x7f741c057c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f74441289b0 tx=0x7f7434008040).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.458 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.445+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f74440ad280 con 0x7f744405be80 2020-11-20T12:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.593+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 --> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74440ad280 con 0x7f741c0557c0 2020-11-20T12:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.597+0000 7f74317fa700 1 -- 172.21.15.161:0/1984698377 <== mgr.4104 v2:172.21.15.161:6832/14582 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+107083 (secure 0 0 0) 0x7f74440ad280 con 0x7f741c0557c0 2020-11-20T12:05:01.609 INFO:teuthology.orchestra.run.smithi161.stdout: 2020-11-20T12:05:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 msgr2=0x7f741c057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 0x7f741c057c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f74441289b0 tx=0x7f7434008040).stop 2020-11-20T12:05:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 msgr2=0x7f744412bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f74440648a0 tx=0x7f743c013000).stop 2020-11-20T12:05:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 shutdown_connections 2020-11-20T12:05:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f741c0557c0 0x7f741c057c80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74440a7fc0 0x7f74440ac9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f744405be80 0x7f744412bb50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 --2- 172.21.15.161:0/1984698377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74440a7260 0x7f744409d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 >> 172.21.15.161:0/1984698377 conn(0x7f74440ad620 msgr2=0x7f7444135f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:05:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 shutdown_connections 2020-11-20T12:05:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.601+0000 7f744a19a700 1 -- 172.21.15.161:0/1984698377 wait complete. 2020-11-20T12:05:01.614 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2020-11-20T12:05:01.625 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":807,"stamp":"2020-11-20T12:05:00.937181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":240879681,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":175131,"num_write_kb":3344890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6355,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158304,"ondisk_log_size":158304,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2569920,"kb_used_data":472512,"kb_used_omap":0,"kb_used_meta":2097344,"kb_avail":752404800,"statfs":{"total":773094113280,"available":770462515200,"internally_reserved":0,"allocated":483852288,"data_stored":482565482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2147680256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003858"},"pg_stats":[{"pgid":"4.2","version":"24'11613","reported_seq":"11627","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:51.612329+0000","last_change":"2020-11-20T12:04:51.612496+0000","last_active":"2020-11-20T12:04:51.612329+0000","last_peered":"2020-11-20T12:04:51.612329+0000","last_clean":"2020-11-20T12:04:51.612329+0000","last_became_active":"2020-11-20T11:38:53.591457+0000","last_became_peered":"2020-11-20T11:38:53.591457+0000","last_unstale":"2020-11-20T12:04:51.612329+0000","last_undegraded":"2020-11-20T12:04:51.612329+0000","last_fullsized":"2020-11-20T12:04:51.612329+0000","mapping_epoch":22,"log_start":"24'1601","ondisk_log_start":"24'1601","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11613","last_scrub_stamp":"2020-11-20T12:04:51.612321+0000","last_deep_scrub":"24'11613","last_deep_scrub_stamp":"2020-11-20T12:04:51.612321+0000","last_clean_scrub_stamp":"2020-11-20T12:04:51.612321+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8925,"num_write_kb":345594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:40.597032+0000","last_change":"2020-11-20T12:04:40.597156+0000","last_active":"2020-11-20T12:04:40.597032+0000","last_peered":"2020-11-20T12:04:40.597032+0000","last_clean":"2020-11-20T12:04:40.597032+0000","last_became_active":"2020-11-20T11:38:48.022698+0000","last_became_peered":"2020-11-20T11:38:48.022698+0000","last_unstale":"2020-11-20T12:04:40.597032+0000","last_undegraded":"2020-11-20T12:04:40.597032+0000","last_fullsized":"2020-11-20T12:04:40.597032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:40.597023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:40.597023+0000","last_clean_scrub_stamp":"2020-11-20T12:04:40.597023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"24'18664","reported_seq":"18679","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:47.553092+0000","last_change":"2020-11-20T12:04:47.553241+0000","last_active":"2020-11-20T12:04:47.553092+0000","last_peered":"2020-11-20T12:04:47.553092+0000","last_clean":"2020-11-20T12:04:47.553092+0000","last_became_active":"2020-11-20T11:38:50.586189+0000","last_became_peered":"2020-11-20T11:38:50.586189+0000","last_unstale":"2020-11-20T12:04:47.553092+0000","last_undegraded":"2020-11-20T12:04:47.553092+0000","last_fullsized":"2020-11-20T12:04:47.553092+0000","mapping_epoch":19,"log_start":"24'8600","ondisk_log_start":"24'8600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'18664","last_scrub_stamp":"2020-11-20T12:04:47.553080+0000","last_deep_scrub":"24'18664","last_deep_scrub_stamp":"2020-11-20T12:04:47.553080+0000","last_clean_scrub_stamp":"2020-11-20T12:04:47.553080+0000","log_size":10064,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748896,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18671,"num_write_kb":107323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"24'12047","reported_seq":"12061","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:52.643822+0000","last_change":"2020-11-20T12:04:52.643930+0000","last_active":"2020-11-20T12:04:52.643822+0000","last_peered":"2020-11-20T12:04:52.643822+0000","last_clean":"2020-11-20T12:04:52.643822+0000","last_became_active":"2020-11-20T11:38:53.597636+0000","last_became_peered":"2020-11-20T11:38:53.597636+0000","last_unstale":"2020-11-20T12:04:52.643822+0000","last_undegraded":"2020-11-20T12:04:52.643822+0000","last_fullsized":"2020-11-20T12:04:52.643822+0000","mapping_epoch":22,"log_start":"24'2000","ondisk_log_start":"24'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12047","last_scrub_stamp":"2020-11-20T12:04:52.643817+0000","last_deep_scrub":"24'12047","last_deep_scrub_stamp":"2020-11-20T12:04:52.643817+0000","last_clean_scrub_stamp":"2020-11-20T12:04:52.643817+0000","log_size":10047,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9313,"num_write_kb":332205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.394199+0000","last_change":"2020-11-20T12:04:41.394414+0000","last_active":"2020-11-20T12:04:41.394199+0000","last_peered":"2020-11-20T12:04:41.394199+0000","last_clean":"2020-11-20T12:04:41.394199+0000","last_became_active":"2020-11-20T11:38:47.415243+0000","last_became_peered":"2020-11-20T11:38:47.415243+0000","last_unstale":"2020-11-20T12:04:41.394199+0000","last_undegraded":"2020-11-20T12:04:41.394199+0000","last_fullsized":"2020-11-20T12:04:41.394199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:41.394184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:41.394184+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.394184+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"24'12186","reported_seq":"12201","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.909647+0000","last_change":"2020-11-20T12:04:41.909785+0000","last_active":"2020-11-20T12:04:41.909647+0000","last_peered":"2020-11-20T12:04:41.909647+0000","last_clean":"2020-11-20T12:04:41.909647+0000","last_became_active":"2020-11-20T11:38:50.584020+0000","last_became_peered":"2020-11-20T11:38:50.584020+0000","last_unstale":"2020-11-20T12:04:41.909647+0000","last_undegraded":"2020-11-20T12:04:41.909647+0000","last_fullsized":"2020-11-20T12:04:41.909647+0000","mapping_epoch":19,"log_start":"24'2100","ondisk_log_start":"24'2100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'12186","last_scrub_stamp":"2020-11-20T12:04:41.909638+0000","last_deep_scrub":"24'12186","last_deep_scrub_stamp":"2020-11-20T12:04:41.909638+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.909638+0000","log_size":10086,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12185,"num_write_kb":70894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5175,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"24'11355","reported_seq":"11369","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:55.702916+0000","last_change":"2020-11-20T12:04:55.703022+0000","last_active":"2020-11-20T12:04:55.702916+0000","last_peered":"2020-11-20T12:04:55.702916+0000","last_clean":"2020-11-20T12:04:55.702916+0000","last_became_active":"2020-11-20T11:38:53.591694+0000","last_became_peered":"2020-11-20T11:38:53.591694+0000","last_unstale":"2020-11-20T12:04:55.702916+0000","last_undegraded":"2020-11-20T12:04:55.702916+0000","last_fullsized":"2020-11-20T12:04:55.702916+0000","mapping_epoch":22,"log_start":"24'1301","ondisk_log_start":"24'1301","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11355","last_scrub_stamp":"2020-11-20T12:04:55.702911+0000","last_deep_scrub":"24'11355","last_deep_scrub_stamp":"2020-11-20T12:04:55.702911+0000","last_clean_scrub_stamp":"2020-11-20T12:04:55.702911+0000","log_size":10054,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":328628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:40.459922+0000","last_change":"2020-11-20T12:04:40.460013+0000","last_active":"2020-11-20T12:04:40.459922+0000","last_peered":"2020-11-20T12:04:40.459922+0000","last_clean":"2020-11-20T12:04:40.459922+0000","last_became_active":"2020-11-20T11:38:47.411779+0000","last_became_peered":"2020-11-20T11:38:47.411779+0000","last_unstale":"2020-11-20T12:04:40.459922+0000","last_undegraded":"2020-11-20T12:04:40.459922+0000","last_fullsized":"2020-11-20T12:04:40.459922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:40.459918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:40.459918+0000","last_clean_scrub_stamp":"2020-11-20T12:04:40.459918+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"24'14456","reported_seq":"14471","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:42.788396+0000","last_change":"2020-11-20T12:04:42.788482+0000","last_active":"2020-11-20T12:04:42.788396+0000","last_peered":"2020-11-20T12:04:42.788396+0000","last_clean":"2020-11-20T12:04:42.788396+0000","last_became_active":"2020-11-20T11:38:51.085703+0000","last_became_peered":"2020-11-20T11:38:51.085703+0000","last_unstale":"2020-11-20T12:04:42.788396+0000","last_undegraded":"2020-11-20T12:04:42.788396+0000","last_fullsized":"2020-11-20T12:04:42.788396+0000","mapping_epoch":19,"log_start":"24'4400","ondisk_log_start":"24'4400","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14456","last_scrub_stamp":"2020-11-20T12:04:42.788389+0000","last_deep_scrub":"24'14456","last_deep_scrub_stamp":"2020-11-20T12:04:42.788389+0000","last_clean_scrub_stamp":"2020-11-20T12:04:42.788389+0000","log_size":10056,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35293517,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14475,"num_write_kb":86024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"24'11375","reported_seq":"11389","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:43.228923+0000","last_change":"2020-11-20T12:04:43.229029+0000","last_active":"2020-11-20T12:04:43.228923+0000","last_peered":"2020-11-20T12:04:43.228923+0000","last_clean":"2020-11-20T12:04:43.228923+0000","last_became_active":"2020-11-20T11:38:53.601406+0000","last_became_peered":"2020-11-20T11:38:53.601406+0000","last_unstale":"2020-11-20T12:04:43.228923+0000","last_undegraded":"2020-11-20T12:04:43.228923+0000","last_fullsized":"2020-11-20T12:04:43.228923+0000","mapping_epoch":22,"log_start":"24'1300","ondisk_log_start":"24'1300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11375","last_scrub_stamp":"2020-11-20T12:04:43.228919+0000","last_deep_scrub":"24'11375","last_deep_scrub_stamp":"2020-11-20T12:04:43.228919+0000","last_clean_scrub_stamp":"2020-11-20T12:04:43.228919+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8639,"num_write_kb":269399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:45.364814+0000","last_change":"2020-11-20T12:04:45.365012+0000","last_active":"2020-11-20T12:04:45.364814+0000","last_peered":"2020-11-20T12:04:45.364814+0000","last_clean":"2020-11-20T12:04:45.364814+0000","last_became_active":"2020-11-20T11:38:47.415074+0000","last_became_peered":"2020-11-20T11:38:47.415074+0000","last_unstale":"2020-11-20T12:04:45.364814+0000","last_undegraded":"2020-11-20T12:04:45.364814+0000","last_fullsized":"2020-11-20T12:04:45.364814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:45.364802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:45.364802+0000","last_clean_scrub_stamp":"2020-11-20T12:04:45.364802+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'4","reported_seq":"25","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.145319+0000","last_change":"2020-11-20T12:04:41.145514+0000","last_active":"2020-11-20T12:04:41.145319+0000","last_peered":"2020-11-20T12:04:41.145319+0000","last_clean":"2020-11-20T12:04:41.145319+0000","last_became_active":"2020-11-20T11:38:42.661151+0000","last_became_peered":"2020-11-20T11:38:42.661151+0000","last_unstale":"2020-11-20T12:04:41.145319+0000","last_undegraded":"2020-11-20T12:04:41.145319+0000","last_fullsized":"2020-11-20T12:04:41.145319+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'4","last_scrub_stamp":"2020-11-20T12:04:41.145302+0000","last_deep_scrub":"24'4","last_deep_scrub_stamp":"2020-11-20T12:04:41.145302+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.145302+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"24'14778","reported_seq":"14793","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:39.992360+0000","last_change":"2020-11-20T12:04:39.992605+0000","last_active":"2020-11-20T12:04:39.992360+0000","last_peered":"2020-11-20T12:04:39.992360+0000","last_clean":"2020-11-20T12:04:39.992360+0000","last_became_active":"2020-11-20T11:38:50.576462+0000","last_became_peered":"2020-11-20T11:38:50.576462+0000","last_unstale":"2020-11-20T12:04:39.992360+0000","last_undegraded":"2020-11-20T12:04:39.992360+0000","last_fullsized":"2020-11-20T12:04:39.992360+0000","mapping_epoch":19,"log_start":"24'4700","ondisk_log_start":"24'4700","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'14778","last_scrub_stamp":"2020-11-20T12:04:39.992349+0000","last_deep_scrub":"24'14778","last_deep_scrub_stamp":"2020-11-20T12:04:39.992349+0000","last_clean_scrub_stamp":"2020-11-20T12:04:39.992349+0000","log_size":10078,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14791,"num_write_kb":88474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"24'11037","reported_seq":"11051","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:43.448562+0000","last_change":"2020-11-20T12:04:43.448663+0000","last_active":"2020-11-20T12:04:43.448562+0000","last_peered":"2020-11-20T12:04:43.448562+0000","last_clean":"2020-11-20T12:04:43.448562+0000","last_became_active":"2020-11-20T11:38:53.607661+0000","last_became_peered":"2020-11-20T11:38:53.607661+0000","last_unstale":"2020-11-20T12:04:43.448562+0000","last_undegraded":"2020-11-20T12:04:43.448562+0000","last_fullsized":"2020-11-20T12:04:43.448562+0000","mapping_epoch":22,"log_start":"24'1001","ondisk_log_start":"24'1001","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11037","last_scrub_stamp":"2020-11-20T12:04:43.448557+0000","last_deep_scrub":"24'11037","last_deep_scrub_stamp":"2020-11-20T12:04:43.448557+0000","last_clean_scrub_stamp":"2020-11-20T12:04:43.448557+0000","log_size":10036,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8436,"num_write_kb":207231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:42.081678+0000","last_change":"2020-11-20T12:04:42.081867+0000","last_active":"2020-11-20T12:04:42.081678+0000","last_peered":"2020-11-20T12:04:42.081678+0000","last_clean":"2020-11-20T12:04:42.081678+0000","last_became_active":"2020-11-20T11:38:47.412241+0000","last_became_peered":"2020-11-20T11:38:47.412241+0000","last_unstale":"2020-11-20T12:04:42.081678+0000","last_undegraded":"2020-11-20T12:04:42.081678+0000","last_fullsized":"2020-11-20T12:04:42.081678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:42.081664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:42.081664+0000","last_clean_scrub_stamp":"2020-11-20T12:04:42.081664+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"24'10899","reported_seq":"13345","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:38.417386+0000","last_change":"2020-11-20T12:04:38.417701+0000","last_active":"2020-11-20T12:04:38.417386+0000","last_peered":"2020-11-20T12:04:38.417386+0000","last_clean":"2020-11-20T12:04:38.417386+0000","last_became_active":"2020-11-20T11:38:50.579603+0000","last_became_peered":"2020-11-20T11:38:50.579603+0000","last_unstale":"2020-11-20T12:04:38.417386+0000","last_undegraded":"2020-11-20T12:04:38.417386+0000","last_fullsized":"2020-11-20T12:04:38.417386+0000","mapping_epoch":19,"log_start":"24'800","ondisk_log_start":"24'800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'10899","last_scrub_stamp":"2020-11-20T12:04:38.417361+0000","last_deep_scrub":"24'10899","last_deep_scrub_stamp":"2020-11-20T12:04:38.417361+0000","last_clean_scrub_stamp":"2020-11-20T12:04:38.417361+0000","log_size":10099,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2431,"num_read_kb":5766,"num_write":10900,"num_write_kb":58738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"24'11812","reported_seq":"11826","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.377996+0000","last_change":"2020-11-20T12:04:41.378103+0000","last_active":"2020-11-20T12:04:41.377996+0000","last_peered":"2020-11-20T12:04:41.377996+0000","last_clean":"2020-11-20T12:04:41.377996+0000","last_became_active":"2020-11-20T11:38:53.599863+0000","last_became_peered":"2020-11-20T11:38:53.599863+0000","last_unstale":"2020-11-20T12:04:41.377996+0000","last_undegraded":"2020-11-20T12:04:41.377996+0000","last_fullsized":"2020-11-20T12:04:41.377996+0000","mapping_epoch":22,"log_start":"24'1800","ondisk_log_start":"24'1800","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11812","last_scrub_stamp":"2020-11-20T12:04:41.377990+0000","last_deep_scrub":"24'11812","last_deep_scrub_stamp":"2020-11-20T12:04:41.377990+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.377990+0000","log_size":10012,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9018,"num_write_kb":558745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:44.036034+0000","last_change":"2020-11-20T12:04:44.036237+0000","last_active":"2020-11-20T12:04:44.036034+0000","last_peered":"2020-11-20T12:04:44.036034+0000","last_clean":"2020-11-20T12:04:44.036034+0000","last_became_active":"2020-11-20T11:38:48.026363+0000","last_became_peered":"2020-11-20T11:38:48.026363+0000","last_unstale":"2020-11-20T12:04:44.036034+0000","last_undegraded":"2020-11-20T12:04:44.036034+0000","last_fullsized":"2020-11-20T12:04:44.036034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:44.036023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:44.036023+0000","last_clean_scrub_stamp":"2020-11-20T12:04:44.036023+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"24'11563","reported_seq":"11578","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:49.776981+0000","last_change":"2020-11-20T12:04:49.777062+0000","last_active":"2020-11-20T12:04:49.776981+0000","last_peered":"2020-11-20T12:04:49.776981+0000","last_clean":"2020-11-20T12:04:49.776981+0000","last_became_active":"2020-11-20T11:38:51.086037+0000","last_became_peered":"2020-11-20T11:38:51.086037+0000","last_unstale":"2020-11-20T12:04:49.776981+0000","last_undegraded":"2020-11-20T12:04:49.776981+0000","last_fullsized":"2020-11-20T12:04:49.776981+0000","mapping_epoch":19,"log_start":"24'1500","ondisk_log_start":"24'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11563","last_scrub_stamp":"2020-11-20T12:04:49.776975+0000","last_deep_scrub":"24'11563","last_deep_scrub_stamp":"2020-11-20T12:04:49.776975+0000","last_clean_scrub_stamp":"2020-11-20T12:04:49.776975+0000","log_size":10063,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33555075,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11581,"num_write_kb":66598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"24'11671","reported_seq":"11685","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:54.847174+0000","last_change":"2020-11-20T12:04:54.847291+0000","last_active":"2020-11-20T12:04:54.847174+0000","last_peered":"2020-11-20T12:04:54.847174+0000","last_clean":"2020-11-20T12:04:54.847174+0000","last_became_active":"2020-11-20T11:38:53.599001+0000","last_became_peered":"2020-11-20T11:38:53.599001+0000","last_unstale":"2020-11-20T12:04:54.847174+0000","last_undegraded":"2020-11-20T12:04:54.847174+0000","last_fullsized":"2020-11-20T12:04:54.847174+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11671","last_scrub_stamp":"2020-11-20T12:04:54.847170+0000","last_deep_scrub":"24'11671","last_deep_scrub_stamp":"2020-11-20T12:04:54.847170+0000","last_clean_scrub_stamp":"2020-11-20T12:04:54.847170+0000","log_size":10071,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8874,"num_write_kb":388797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"24'7460","reported_seq":"7486","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.942962+0000","last_change":"2020-11-20T12:04:41.943116+0000","last_active":"2020-11-20T12:04:41.942962+0000","last_peered":"2020-11-20T12:04:41.942962+0000","last_clean":"2020-11-20T12:04:41.942962+0000","last_became_active":"2020-11-20T11:38:51.327330+0000","last_became_peered":"2020-11-20T11:38:51.327330+0000","last_unstale":"2020-11-20T12:04:41.942962+0000","last_undegraded":"2020-11-20T12:04:41.942962+0000","last_fullsized":"2020-11-20T12:04:41.942962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'7460","last_scrub_stamp":"2020-11-20T12:04:41.942950+0000","last_deep_scrub":"24'7460","last_deep_scrub_stamp":"2020-11-20T12:04:41.942950+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.942950+0000","log_size":7460,"ondisk_log_size":7460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21035951,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":11,"num_read_kb":70,"num_write":7501,"num_write_kb":44392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:41.640726+0000","last_change":"2020-11-20T12:04:41.640927+0000","last_active":"2020-11-20T12:04:41.640726+0000","last_peered":"2020-11-20T12:04:41.640726+0000","last_clean":"2020-11-20T12:04:41.640726+0000","last_became_active":"2020-11-20T11:38:47.411044+0000","last_became_peered":"2020-11-20T11:38:47.411044+0000","last_unstale":"2020-11-20T12:04:41.640726+0000","last_undegraded":"2020-11-20T12:04:41.640726+0000","last_fullsized":"2020-11-20T12:04:41.640726+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:41.640716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:41.640716+0000","last_clean_scrub_stamp":"2020-11-20T12:04:41.640716+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"24'11668","reported_seq":"11682","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:48.814136+0000","last_change":"2020-11-20T12:04:48.814258+0000","last_active":"2020-11-20T12:04:48.814136+0000","last_peered":"2020-11-20T12:04:48.814136+0000","last_clean":"2020-11-20T12:04:48.814136+0000","last_became_active":"2020-11-20T11:38:53.601560+0000","last_became_peered":"2020-11-20T11:38:53.601560+0000","last_unstale":"2020-11-20T12:04:48.814136+0000","last_undegraded":"2020-11-20T12:04:48.814136+0000","last_fullsized":"2020-11-20T12:04:48.814136+0000","mapping_epoch":22,"log_start":"24'1600","ondisk_log_start":"24'1600","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'11668","last_scrub_stamp":"2020-11-20T12:04:48.814131+0000","last_deep_scrub":"24'11668","last_deep_scrub_stamp":"2020-11-20T12:04:48.814131+0000","last_clean_scrub_stamp":"2020-11-20T12:04:48.814131+0000","log_size":10068,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8969,"num_write_kb":306187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"17","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:42.203100+0000","last_change":"2020-11-20T12:04:42.203193+0000","last_active":"2020-11-20T12:04:42.203100+0000","last_peered":"2020-11-20T12:04:42.203100+0000","last_clean":"2020-11-20T12:04:42.203100+0000","last_became_active":"2020-11-20T11:38:47.413633+0000","last_became_peered":"2020-11-20T11:38:47.413633+0000","last_unstale":"2020-11-20T12:04:42.203100+0000","last_undegraded":"2020-11-20T12:04:42.203100+0000","last_fullsized":"2020-11-20T12:04:42.203100+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:04:42.203096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:04:42.203096+0000","last_clean_scrub_stamp":"2020-11-20T12:04:42.203096+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'13619","reported_seq":"13634","reported_epoch":"24","state":"active+clean","last_fresh":"2020-11-20T12:04:40.465954+0000","last_change":"2020-11-20T12:04:40.466032+0000","last_active":"2020-11-20T12:04:40.465954+0000","last_peered":"2020-11-20T12:04:40.465954+0000","last_clean":"2020-11-20T12:04:40.465954+0000","last_became_active":"2020-11-20T11:38:50.583037+0000","last_became_peered":"2020-11-20T11:38:50.583037+0000","last_unstale":"2020-11-20T12:04:40.465954+0000","last_undegraded":"2020-11-20T12:04:40.465954+0000","last_fullsized":"2020-11-20T12:04:40.465954+0000","mapping_epoch":19,"log_start":"24'3600","ondisk_log_start":"24'3600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'13619","last_scrub_stamp":"2020-11-20T12:04:40.465948+0000","last_deep_scrub":"24'13619","last_deep_scrub_stamp":"2020-11-20T12:04:40.465948+0000","last_clean_scrub_stamp":"2020-11-20T12:04:40.465948+0000","log_size":10019,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14212,"num_write_kb":85659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70813,"num_write_kb":2736786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80375,"ondisk_log_size":80375,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":240879681,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":2442,"num_read_kb":5836,"num_write":104316,"num_write_kb":608102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5175,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":481820672,"data_stored":481759362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77925,"ondisk_log_size":77925,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575165,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":205128,"kb_used_data":20800,"kb_used_omap":0,"kb_used_meta":184320,"kb_avail":94166712,"statfs":{"total":96636764160,"available":96426713088,"internally_reserved":0,"allocated":21299200,"data_stored":21136716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":188743680},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":32.453000000000003,"15min":11.872},"min":{"1min":0.70699999999999996,"5min":0.52600000000000002,"15min":0.50800000000000001},"max":{"1min":2.0649999999999999,"5min":2116.4740000000002,"15min":2116.4740000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.883,"5min":32.752000000000002,"15min":12.205},"min":{"1min":0.92300000000000004,"5min":0.71199999999999997,"15min":0.53600000000000003},"max":{"1min":3.8119999999999998,"5min":2116.5169999999998,"15min":2116.5169999999998},"last":2.5430000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":5.0190000000000001,"15min":2.7360000000000002},"min":{"1min":0.72299999999999998,"5min":0.60499999999999998,"15min":0.52700000000000002},"max":{"1min":19.291,"5min":52.777000000000001,"15min":52.777000000000001},"last":1.6950000000000001},{"interface":"front","average":{"1min":3.2770000000000001,"5min":7.3639999999999999,"15min":3.5720000000000001},"min":{"1min":0.68799999999999994,"5min":0.59499999999999997,"15min":0.58499999999999996},"max":{"1min":19.581,"5min":207.23400000000001,"15min":207.23400000000001},"last":2.0459999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.591,"15min":1.6850000000000001},"min":{"1min":0.98099999999999998,"5min":0.71199999999999997,"15min":0.60199999999999998},"max":{"1min":2.7549999999999999,"5min":6.6840000000000002,"15min":7.742},"last":1.9259999999999999},{"interface":"front","average":{"1min":2.0840000000000001,"5min":1.8140000000000001,"15min":1.9419999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.60099999999999998},"max":{"1min":4.1100000000000003,"5min":5.4749999999999996,"15min":8.1899999999999995},"last":2.1539999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":5.1130000000000004,"15min":3.097},"min":{"1min":1.056,"5min":0.876,"15min":0.69099999999999995},"max":{"1min":4.2220000000000004,"5min":212.76300000000001,"15min":212.76300000000001},"last":2.1200000000000001},{"interface":"front","average":{"1min":2.306,"5min":5.2370000000000001,"15min":3.2530000000000001},"min":{"1min":0.93700000000000006,"5min":0.88200000000000001,"15min":0.85699999999999998},"max":{"1min":4.1980000000000004,"5min":212.83799999999999,"15min":212.83799999999999},"last":2.9660000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.7170000000000001,"15min":1.9179999999999999},"min":{"1min":0.88,"5min":0.79900000000000004,"15min":0.72799999999999998},"max":{"1min":3.4849999999999999,"5min":8.9629999999999992,"15min":13.430999999999999},"last":2.4700000000000002},{"interface":"front","average":{"1min":1.8859999999999999,"5min":2.137,"15min":2.1970000000000001},"min":{"1min":1.0569999999999999,"5min":0.84999999999999998,"15min":0.80100000000000005},"max":{"1min":3.048,"5min":8.6210000000000004,"15min":9.3109999999999999},"last":2.306}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.4169999999999998,"5min":2.645,"15min":2.4140000000000001},"min":{"1min":1.0269999999999999,"5min":0.81699999999999995,"15min":0.78600000000000003},"max":{"1min":4.2510000000000003,"5min":24.559000000000001,"15min":24.559000000000001},"last":2.7519999999999998},{"interface":"front","average":{"1min":2.3100000000000001,"5min":2.593,"15min":2.48},"min":{"1min":1.014,"5min":0.94399999999999995,"15min":0.88100000000000001},"max":{"1min":3.6360000000000001,"5min":24.847999999999999,"15min":24.847999999999999},"last":2.6819999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5030000000000001,"5min":2.3109999999999999,"15min":2.512},"min":{"1min":1.103,"5min":1.103,"15min":0.98099999999999998},"max":{"1min":3.782,"5min":9.2739999999999991,"15min":13.81},"last":3.2120000000000002},{"interface":"front","average":{"1min":2.1859999999999999,"5min":2.3039999999999998,"15min":2.4279999999999999},"min":{"1min":1.1639999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":3.4630000000000001,"5min":7.1020000000000003,"15min":8.9559999999999995},"last":2.605}]}]},{"osd":6,"up_from":13,"seq":55834575165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91072,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":90816,"kb_avail":94280768,"statfs":{"total":96636764160,"available":96543506432,"internally_reserved":0,"allocated":253952,"data_stored":100765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":92995584},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":20.858000000000001,"15min":10.361000000000001},"min":{"1min":0.56000000000000005,"5min":0.54200000000000004,"15min":0.52200000000000002},"max":{"1min":1.9990000000000001,"5min":1335.944,"15min":1335.944},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.538,"5min":21.170999999999999,"15min":10.725},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54100000000000004},"max":{"1min":2.9550000000000001,"5min":1336.0409999999999,"15min":1336.0409999999999},"last":2.669}]},{"osd":1,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.8599999999999999,"5min":3.5910000000000002,"15min":5.8570000000000002},"min":{"1min":0.63100000000000001,"5min":0.59499999999999997,"15min":0.56399999999999995},"max":{"1min":26.742999999999999,"5min":40.345999999999997,"15min":725.73900000000003},"last":3.0049999999999999},{"interface":"front","average":{"1min":2.8079999999999998,"5min":3.9390000000000001,"15min":6.2930000000000001},"min":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"max":{"1min":26.501999999999999,"5min":41.792999999999999,"15min":721.18799999999999},"last":1.9490000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.9990000000000001,"5min":1.7769999999999999,"15min":4.1340000000000003},"min":{"1min":0.88500000000000001,"5min":0.64900000000000002,"15min":0.64400000000000002},"max":{"1min":5.8659999999999997,"5min":7.3540000000000001,"15min":720.64499999999998},"last":2.2549999999999999},{"interface":"front","average":{"1min":1.903,"5min":1.9510000000000001,"15min":4.1929999999999996},"min":{"1min":0.88800000000000001,"5min":0.70699999999999996,"15min":0.68999999999999995},"max":{"1min":4.2629999999999999,"5min":11.244999999999999,"15min":725.26999999999998},"last":1.8080000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":6.2919999999999998,"5min":2.9409999999999998,"15min":5.1180000000000003},"min":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.65200000000000002},"max":{"1min":89.606999999999999,"5min":89.606999999999999,"15min":722.21600000000001},"last":3.0600000000000001},{"interface":"front","average":{"1min":6.7370000000000001,"5min":3.0379999999999998,"15min":5.194},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.79700000000000004},"max":{"1min":89.668999999999997,"5min":89.668999999999997,"15min":720.30899999999997},"last":2.7610000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":1.986,"5min":1.9059999999999999,"15min":4.306},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.69399999999999995},"max":{"1min":3.552,"5min":5.1820000000000004,"15min":726.67999999999995},"last":2.528},{"interface":"front","average":{"1min":2.0720000000000001,"5min":2.2309999999999999,"15min":4.6849999999999996},"min":{"1min":0.98999999999999999,"5min":0.96799999999999997,"15min":0.748},"max":{"1min":3.3999999999999999,"5min":6.7679999999999998,"15min":724.88699999999994},"last":3.794}]},{"osd":5,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.1749999999999998,"15min":4.7329999999999997},"min":{"1min":1.0649999999999999,"5min":0.92100000000000004,"15min":0.872},"max":{"1min":4.3620000000000001,"5min":5.2229999999999999,"15min":721.94000000000005},"last":2.9670000000000001},{"interface":"front","average":{"1min":2.3079999999999998,"5min":2.2269999999999999,"15min":4.7640000000000002},"min":{"1min":1.1379999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":4.3230000000000004,"5min":5.3250000000000002,"15min":728.56399999999996},"last":3.2200000000000002}]},{"osd":7,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":2.3370000000000002,"15min":4.8739999999999997},"min":{"1min":1.0129999999999999,"5min":0.97199999999999998,"15min":0.81100000000000005},"max":{"1min":3.48,"5min":7.173,"15min":729},"last":3.4500000000000002},{"interface":"front","average":{"1min":2.3490000000000002,"5min":2.2069999999999999,"15min":4.8070000000000004},"min":{"1min":1.24,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":3.6739999999999999,"5min":6.1210000000000004,"15min":728.80600000000004},"last":3.1760000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575165,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":489900,"kb_used_data":100260,"kb_used_omap":0,"kb_used_meta":389632,"kb_avail":93881940,"statfs":{"total":96636764160,"available":96135106560,"internally_reserved":0,"allocated":102666240,"data_stored":102503789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":398983168},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":9.1080000000000005,"5min":42.454000000000001,"15min":15.585000000000001},"min":{"1min":0.56699999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":51.396000000000001,"5min":2981.1959999999999,"15min":2981.1959999999999},"last":2.0019999999999998},{"interface":"front","average":{"1min":3.4430000000000001,"5min":42.100999999999999,"15min":15.234999999999999},"min":{"1min":0.58899999999999997,"5min":0.53500000000000003,"15min":0.46500000000000002},"max":{"1min":30.646000000000001,"5min":2972.6509999999998,"15min":2972.6509999999998},"last":1.532}]},{"osd":2,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":4.9260000000000002,"5min":4.6420000000000003,"15min":2.819},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.50700000000000001},"max":{"1min":39.003,"5min":74.406000000000006,"15min":74.406000000000006},"last":1.5800000000000001},{"interface":"front","average":{"1min":5.673,"5min":4.7469999999999999,"15min":2.6720000000000002},"min":{"1min":0.60599999999999998,"5min":0.54900000000000004,"15min":0.53900000000000003},"max":{"1min":51.466999999999999,"5min":51.466999999999999,"15min":51.466999999999999},"last":1.627}]},{"osd":3,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":5.6600000000000001,"5min":6.7830000000000004,"15min":3.8730000000000002},"min":{"1min":0.80600000000000005,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":51.292999999999999,"5min":89.393000000000001,"15min":89.393000000000001},"last":2.1030000000000002},{"interface":"front","average":{"1min":6.032,"5min":6.2160000000000002,"15min":3.1930000000000001},"min":{"1min":0.70999999999999996,"5min":0.624,"15min":0.58999999999999997},"max":{"1min":51.090000000000003,"5min":87.826999999999998,"15min":87.826999999999998},"last":2.3399999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":12.832000000000001,"5min":6.4009999999999998,"15min":3.456},"min":{"1min":0.94799999999999995,"5min":0.70199999999999996,"15min":0.60399999999999998},"max":{"1min":181.52000000000001,"5min":181.52000000000001,"15min":181.52000000000001},"last":2.2930000000000001},{"interface":"front","average":{"1min":7.3170000000000002,"5min":5.5709999999999997,"15min":3.5049999999999999},"min":{"1min":0.86699999999999999,"5min":0.79700000000000004,"15min":0.76700000000000002},"max":{"1min":53.615000000000002,"5min":60.997999999999998,"15min":60.997999999999998},"last":2.226}]},{"osd":5,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":6.367,"5min":5.7480000000000002,"15min":3.7829999999999999},"min":{"1min":0.97099999999999997,"5min":0.95499999999999996,"15min":0.72899999999999998},"max":{"1min":53.555999999999997,"5min":59.052999999999997,"15min":98.697999999999993},"last":3.4279999999999999},{"interface":"front","average":{"1min":8.5860000000000003,"5min":6.8179999999999996,"15min":4.5030000000000001},"min":{"1min":0.98199999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":54.229999999999997,"5min":61.18,"15min":98.759},"last":3.0779999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":13.24,"5min":6.944,"15min":4.2199999999999998},"min":{"1min":1.3919999999999999,"5min":0.97799999999999998,"15min":0.84199999999999997},"max":{"1min":181.87299999999999,"5min":181.87299999999999,"15min":181.87299999999999},"last":2.8820000000000001},{"interface":"front","average":{"1min":6.5179999999999998,"5min":7.375,"15min":3.9100000000000001},"min":{"1min":1.327,"5min":1.1439999999999999,"15min":0.98099999999999998},"max":{"1min":53.758000000000003,"5min":59.18,"15min":59.18},"last":3.1709999999999998}]},{"osd":7,"last update":"Fri Nov 20 12:04:34 2020","interfaces":[{"interface":"back","average":{"1min":7.5940000000000003,"5min":8.6050000000000004,"15min":4.7270000000000003},"min":{"1min":1.155,"5min":0.95799999999999996,"15min":0.95799999999999996},"max":{"1min":54.158999999999999,"5min":162.124,"15min":162.124},"last":2.5099999999999998},{"interface":"front","average":{"1min":13.234999999999999,"5min":8.9719999999999995,"15min":4.6920000000000002},"min":{"1min":1.2310000000000001,"5min":0.95599999999999996,"15min":0.92400000000000004},"max":{"1min":177.50200000000001,"5min":177.50200000000001,"15min":177.50200000000001},"last":3.258}]}]},{"osd":0,"up_from":13,"seq":55834575164,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421636,"kb_used_data":78076,"kb_used_omap":0,"kb_used_meta":343552,"kb_avail":93950204,"statfs":{"total":96636764160,"available":96205008896,"internally_reserved":0,"allocated":79949824,"data_stored":79792575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351797248},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":6.0469999999999997,"5min":5.7089999999999996,"15min":3.1520000000000001},"min":{"1min":0.73599999999999999,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":32.566000000000003,"5min":35.283000000000001,"15min":81.277000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":5.54,"5min":6.9889999999999999,"15min":3.8570000000000002},"min":{"1min":0.60099999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":32.427,"5min":40.186999999999998,"15min":81.471000000000004},"last":1.72}]},{"osd":2,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9790000000000001,"5min":2.1139999999999999,"15min":1.847},"min":{"1min":0.54900000000000004,"5min":0.53100000000000003,"15min":0.48999999999999999},"max":{"1min":6.3360000000000003,"5min":38.624000000000002,"15min":38.624000000000002},"last":1.0640000000000001},{"interface":"front","average":{"1min":2.1669999999999998,"5min":2.8359999999999999,"15min":2.0649999999999999},"min":{"1min":0.626,"5min":0.52000000000000002,"15min":0.47899999999999998},"max":{"1min":8.8130000000000006,"5min":40.667999999999999,"15min":40.667999999999999},"last":1.5649999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":2.5350000000000001,"15min":1.9970000000000001},"min":{"1min":0.68600000000000005,"5min":0.58099999999999996,"15min":0.54100000000000004},"max":{"1min":8.7089999999999996,"5min":22.062999999999999,"15min":22.062999999999999},"last":1.837},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.645,"15min":2.214},"min":{"1min":0.80200000000000005,"5min":0.68899999999999995,"15min":0.57899999999999996},"max":{"1min":5.9329999999999998,"5min":29.331,"15min":29.331},"last":2.0019999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":3.3999999999999999,"15min":4.9660000000000002},"min":{"1min":0.75800000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":5.7119999999999997,"5min":40.356999999999999,"15min":737.07799999999997},"last":1.2989999999999999},{"interface":"front","average":{"1min":2.7650000000000001,"5min":2.6139999999999999,"15min":4.6360000000000001},"min":{"1min":1.107,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":8.8520000000000003,"5min":22.334,"15min":736.77800000000002},"last":2.1579999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":1.9670000000000001,"5min":6.4359999999999999,"15min":4.4699999999999998},"min":{"1min":0.99199999999999999,"5min":0.79000000000000004,"15min":0.72799999999999998},"max":{"1min":6.5190000000000001,"5min":300.21800000000002,"15min":300.21800000000002},"last":1.764},{"interface":"front","average":{"1min":2.1709999999999998,"5min":6.6600000000000001,"15min":4.7060000000000004},"min":{"1min":0.95099999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":5.7910000000000004,"5min":300.31799999999998,"15min":300.31799999999998},"last":2.1230000000000002}]},{"osd":6,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.9039999999999999,"5min":3.649,"15min":3.2679999999999998},"min":{"1min":1.1919999999999999,"5min":0.89800000000000002,"15min":0.86499999999999999},"max":{"1min":8.9740000000000002,"5min":52.329000000000001,"15min":144.44200000000001},"last":2.375},{"interface":"front","average":{"1min":2.1899999999999999,"5min":3.2360000000000002,"15min":3.1589999999999998},"min":{"1min":1.23,"5min":0.96099999999999997,"15min":0.82199999999999995},"max":{"1min":6.133,"5min":29.690999999999999,"15min":143.72399999999999},"last":2.2210000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:04:28 2020","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":3.75,"15min":2.891},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":0.95399999999999996},"max":{"1min":5.9699999999999998,"5min":40.509,"15min":40.509},"last":1.9410000000000001},{"interface":"front","average":{"1min":3.004,"5min":3.4300000000000002,"15min":2.629},"min":{"1min":1.2070000000000001,"5min":1.0449999999999999,"15min":1.034},"max":{"1min":8.9130000000000003,"5min":30.167999999999999,"15min":30.167999999999999},"last":2.5579999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575165,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283756,"kb_used_data":67492,"kb_used_omap":0,"kb_used_meta":216256,"kb_avail":94088084,"statfs":{"total":96636764160,"available":96346198016,"internally_reserved":0,"allocated":69111808,"data_stored":68949357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":221446144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":80.144999999999996,"15min":28.204000000000001},"min":{"1min":0.63200000000000001,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":11.33,"5min":5512.3900000000003,"15min":5512.3900000000003},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":79.501000000000005,"15min":27.98},"min":{"1min":0.53200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.02,"5min":5508.7870000000003,"15min":5508.7870000000003},"last":2.1179999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":8.0440000000000005,"5min":6.569,"15min":7.0469999999999997},"min":{"1min":0.55000000000000004,"5min":0.54800000000000004,"15min":0.49299999999999999},"max":{"1min":30.960999999999999,"5min":71.078999999999994,"15min":812.93899999999996},"last":1.5089999999999999},{"interface":"front","average":{"1min":8.6359999999999992,"5min":6.6500000000000004,"15min":7.3159999999999998},"min":{"1min":0.71099999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":31.152999999999999,"5min":71.881,"15min":824.13699999999994},"last":2.0129999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.597,"15min":1.9750000000000001},"min":{"1min":0.80000000000000004,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":4.0629999999999997,"5min":7.8460000000000001,"15min":100.506},"last":1.923},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.7849999999999999,"15min":2.1320000000000001},"min":{"1min":0.88700000000000001,"5min":0.68300000000000005,"15min":0.58999999999999997},"max":{"1min":4.6109999999999998,"5min":6.8300000000000001,"15min":101.16800000000001},"last":2.2690000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":1.694,"5min":2.4969999999999999,"15min":3.8690000000000002},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67600000000000005},"max":{"1min":3.7000000000000002,"5min":74.609999999999999,"15min":277.25},"last":2.3570000000000002},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6869999999999998,"15min":4.0970000000000004},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.2060000000000004,"5min":79.671999999999997,"15min":278.44600000000003},"last":2.1819999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.4129999999999998,"5min":2.4590000000000001,"15min":6.3259999999999996},"min":{"1min":1.228,"5min":0.88300000000000001,"15min":0.69999999999999996},"max":{"1min":4.9790000000000001,"5min":7.4989999999999997,"15min":486.85599999999999},"last":3.532},{"interface":"front","average":{"1min":2.0649999999999999,"5min":2.1800000000000002,"15min":6.202},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.82299999999999995},"max":{"1min":6.0380000000000003,"5min":8.3320000000000007,"15min":487.04700000000003},"last":3.125}]},{"osd":6,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1019999999999999,"5min":2.7269999999999999,"15min":4.2050000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":4.532,"5min":70.768000000000001,"15min":277.32400000000001},"last":3.1699999999999999},{"interface":"front","average":{"1min":2.3109999999999999,"5min":3.016,"15min":4.3650000000000002},"min":{"1min":1.296,"5min":1.0649999999999999,"15min":0.81100000000000005},"max":{"1min":4.7359999999999998,"5min":70.599999999999994,"15min":276.94499999999999},"last":2.879}]},{"osd":7,"last update":"Fri Nov 20 12:04:26 2020","interfaces":[{"interface":"back","average":{"1min":2.1320000000000001,"5min":3.6419999999999999,"15min":4.5499999999999998},"min":{"1min":1.153,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":5.9139999999999997,"5min":74.421999999999997,"15min":282.084},"last":2.976},{"interface":"front","average":{"1min":2.2429999999999999,"5min":3.738,"15min":4.6689999999999996},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":4.3319999999999999,"5min":74.719999999999999,"15min":281.82299999999998},"last":2.7730000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575165,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442128,"kb_used_data":90440,"kb_used_omap":0,"kb_used_meta":351680,"kb_avail":93929712,"statfs":{"total":96636764160,"available":96184025088,"internally_reserved":0,"allocated":92610560,"data_stored":92440044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":360120320},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":31.047999999999998,"15min":11.473000000000001},"min":{"1min":0.57699999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":11.35,"5min":2604.2579999999998,"15min":2604.2579999999998},"last":2.113},{"interface":"front","average":{"1min":2.101,"5min":30.957000000000001,"15min":11.455},"min":{"1min":0.55400000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":11.210000000000001,"5min":2602.6849999999999,"15min":2602.6849999999999},"last":1.742}]},{"osd":1,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.3849999999999998,"5min":4.282,"15min":2.395},"min":{"1min":0.68500000000000005,"5min":0.5,"15min":0.5},"max":{"1min":23.425999999999998,"5min":49.542999999999999,"15min":49.542999999999999},"last":2.02},{"interface":"front","average":{"1min":3.7000000000000002,"5min":4.4710000000000001,"15min":2.6120000000000001},"min":{"1min":0.68999999999999995,"5min":0.57299999999999995,"15min":0.56399999999999995},"max":{"1min":20.125,"5min":31.414000000000001,"15min":31.414000000000001},"last":2.5790000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":2.1960000000000002,"15min":1.823},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.56000000000000005},"max":{"1min":6.1710000000000003,"5min":16.135999999999999,"15min":16.135999999999999},"last":3.411},{"interface":"front","average":{"1min":1.794,"5min":2.3420000000000001,"15min":1.988},"min":{"1min":0.88400000000000001,"5min":0.66800000000000004,"15min":0.61199999999999999},"max":{"1min":4.3550000000000004,"5min":16.859000000000002,"15min":16.859000000000002},"last":3.3519999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0790000000000002,"5min":2.6000000000000001,"15min":1.9910000000000001},"min":{"1min":0.90400000000000003,"5min":0.71799999999999997,"15min":0.628},"max":{"1min":5.7610000000000001,"5min":65.238,"15min":65.238},"last":1.9670000000000001},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.1850000000000001,"15min":2.395},"min":{"1min":1.073,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":6.2969999999999997,"5min":65.281999999999996,"15min":65.281999999999996},"last":3.0600000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.2650000000000001,"5min":5.734,"15min":3.2970000000000002},"min":{"1min":0.90300000000000002,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":6.4260000000000002,"5min":297.14100000000002,"15min":297.14100000000002},"last":3.6579999999999999},{"interface":"front","average":{"1min":2.2450000000000001,"5min":5.843,"15min":3.3559999999999999},"min":{"1min":1.298,"5min":0.83099999999999996,"15min":0.79000000000000004},"max":{"1min":5.3200000000000003,"5min":297.178,"15min":297.178},"last":4.5099999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":2.5750000000000002,"5min":3.468,"15min":2.6150000000000002},"min":{"1min":1.337,"5min":0.92400000000000004,"15min":0.90000000000000002},"max":{"1min":5.8559999999999999,"5min":70.016000000000005,"15min":70.016000000000005},"last":4.2590000000000003},{"interface":"front","average":{"1min":2.2549999999999999,"5min":2.9039999999999999,"15min":2.206},"min":{"1min":1.075,"5min":0.877,"15min":0.753},"max":{"1min":6.2000000000000002,"5min":65.394999999999996,"15min":65.394999999999996},"last":2.5209999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:04:23 2020","interfaces":[{"interface":"back","average":{"1min":3.024,"5min":3.4009999999999998,"15min":2.8940000000000001},"min":{"1min":1.093,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":9.3599999999999994,"5min":62.003999999999998,"15min":143.607},"last":2.4119999999999999},{"interface":"front","average":{"1min":2.7429999999999999,"5min":3.8399999999999999,"15min":2.7949999999999999},"min":{"1min":1.171,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":9.7699999999999996,"5min":62.216000000000001,"15min":62.216000000000001},"last":4.0469999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575165,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":257284,"kb_used_data":45308,"kb_used_omap":0,"kb_used_meta":211968,"kb_avail":94114556,"statfs":{"total":96636764160,"available":96373305344,"internally_reserved":0,"allocated":46395392,"data_stored":46238143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":217055232},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":72.212999999999994,"15min":25.486000000000001},"min":{"1min":0.60799999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.1720000000000002,"5min":4575.527,"15min":4575.527},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.704,"5min":72.381,"15min":28.355},"min":{"1min":0.72699999999999998,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":4.0049999999999999,"5min":4579.8609999999999,"15min":4579.8609999999999},"last":2.7919999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":3.8069999999999999,"15min":8.282},"min":{"1min":0.76500000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":8.8719999999999999,"5min":30.622,"15min":752.74000000000001},"last":1.6930000000000001},{"interface":"front","average":{"1min":2.0529999999999999,"5min":4.6479999999999997,"15min":5.9169999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":9.6229999999999993,"5min":47.741999999999997,"15min":594.72199999999998},"last":2.0329999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":1.96,"5min":1.8140000000000001,"15min":4.8360000000000003},"min":{"1min":0.76300000000000001,"5min":0.74299999999999999,"15min":0.67700000000000005},"max":{"1min":4.9630000000000001,"5min":6.7380000000000004,"15min":752.94799999999998},"last":2.2519999999999998},{"interface":"front","average":{"1min":1.9730000000000001,"5min":1.994,"15min":2.2050000000000001},"min":{"1min":0.85099999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":3.5880000000000001,"5min":6.8719999999999999,"15min":31.030000000000001},"last":2.8490000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":1.9419999999999999,"15min":2.3039999999999998},"min":{"1min":1.107,"5min":0.747,"15min":0.747},"max":{"1min":15.199999999999999,"5min":15.199999999999999,"15min":124.405},"last":2.5529999999999999},{"interface":"front","average":{"1min":2.746,"5min":2.157,"15min":5.2629999999999999},"min":{"1min":0.89500000000000002,"5min":0.73799999999999999,"15min":0.68100000000000005},"max":{"1min":15.885999999999999,"5min":15.885999999999999,"15min":753.07100000000003},"last":2.6309999999999998}]},{"osd":5,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":2.573,"15min":2.335},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":3.2330000000000001,"5min":65.716999999999999,"15min":65.716999999999999},"last":2.476},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.5680000000000001,"15min":2.3300000000000001},"min":{"1min":1.0960000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":4.0830000000000002,"5min":64.546000000000006,"15min":64.546000000000006},"last":3.2090000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.3639999999999999,"5min":2.1360000000000001,"15min":5.7910000000000004},"min":{"1min":1.073,"5min":0.93500000000000005,"15min":0.79000000000000004},"max":{"1min":5.0750000000000002,"5min":6.6120000000000001,"15min":753.18700000000001},"last":3.0419999999999998},{"interface":"front","average":{"1min":2.3919999999999999,"5min":2.2999999999999998,"15min":3.0139999999999998},"min":{"1min":1.155,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.593,"5min":11.848000000000001,"15min":178.023},"last":3.2509999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:04:35 2020","interfaces":[{"interface":"back","average":{"1min":2.2999999999999998,"5min":2.351,"15min":2.423},"min":{"1min":1.373,"5min":1.006,"15min":0.94899999999999995},"max":{"1min":4.4580000000000002,"5min":6.9950000000000001,"15min":7.3079999999999998},"last":3},{"interface":"front","average":{"1min":2.5800000000000001,"5min":2.456,"15min":5.3520000000000003},"min":{"1min":1.343,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":5.5300000000000002,"5min":6.4610000000000003,"15min":753.30100000000004},"last":3.3809999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575165,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379016,"kb_used_data":69888,"kb_used_omap":0,"kb_used_meta":309120,"kb_avail":93992824,"statfs":{"total":96636764160,"available":96248651776,"internally_reserved":0,"allocated":71565312,"data_stored":71404093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316538880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.3799999999999999,"5min":78.034999999999997,"15min":27.175999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.48899999999999999},"max":{"1min":2.6469999999999998,"5min":4320.9859999999999,"15min":4320.9859999999999},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":78.102999999999994,"15min":27.228000000000002},"min":{"1min":0.66200000000000003,"5min":0.624,"15min":0.50900000000000001},"max":{"1min":2.4550000000000001,"5min":4324.4759999999997,"15min":4324.4759999999997},"last":1.7290000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":6.3230000000000004,"5min":6.6420000000000003,"15min":5.2039999999999997},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":42.215000000000003,"5min":97.617999999999995,"15min":532.33500000000004},"last":1.859},{"interface":"front","average":{"1min":6.5579999999999998,"5min":7.0579999999999998,"15min":5.556},"min":{"1min":0.81499999999999995,"5min":0.60899999999999999,"15min":0.57399999999999995},"max":{"1min":42.776000000000003,"5min":97.906000000000006,"15min":525.60599999999999},"last":2.0059999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":1.7130000000000001,"5min":2.609,"15min":2.266},"min":{"1min":0.69699999999999995,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.9889999999999999,"5min":86.805000000000007,"15min":86.805000000000007},"last":2.1120000000000001},{"interface":"front","average":{"1min":1.7769999999999999,"5min":2.4159999999999999,"15min":2.222},"min":{"1min":0.72899999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.3150000000000004,"5min":86.688000000000002,"15min":86.688000000000002},"last":1.522}]},{"osd":3,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0459999999999998,"15min":2.609},"min":{"1min":0.82999999999999996,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":6.5759999999999996,"5min":87.418999999999997,"15min":87.418999999999997},"last":2.5680000000000001},{"interface":"front","average":{"1min":2.0649999999999999,"5min":3.0779999999999998,"15min":2.5670000000000002},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.516,"5min":87.192999999999998,"15min":87.192999999999998},"last":2.7480000000000002}]},{"osd":4,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.0259999999999998,"5min":2.7879999999999998,"15min":2.6070000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.8730000000000002,"5min":86.876000000000005,"15min":86.876000000000005},"last":2.5019999999999998},{"interface":"front","average":{"1min":2.218,"5min":2.919,"15min":2.7269999999999999},"min":{"1min":0.88200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0019999999999998,"5min":87.581999999999994,"15min":87.581999999999994},"last":2.8410000000000002}]},{"osd":6,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.919,"15min":2.7669999999999999},"min":{"1min":0.92000000000000004,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":5.2830000000000004,"5min":87.760999999999996,"15min":87.760999999999996},"last":2.427},{"interface":"front","average":{"1min":2.2629999999999999,"5min":3.153,"15min":2.968},"min":{"1min":1.0329999999999999,"5min":0.89600000000000002,"15min":0.88},"max":{"1min":4.0629999999999997,"5min":87.366,"15min":87.366},"last":2.9119999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:04:29 2020","interfaces":[{"interface":"back","average":{"1min":2.5350000000000001,"5min":3.1459999999999999,"15min":3.048},"min":{"1min":1.161,"5min":1.1060000000000001,"15min":1.024},"max":{"1min":4.8330000000000002,"5min":87.825000000000003,"15min":87.825000000000003},"last":3.5670000000000002},{"interface":"front","average":{"1min":2.6520000000000001,"5min":3.2450000000000001,"15min":3.081},"min":{"1min":1.169,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":5.0979999999999999,"5min":87.489000000000004,"15min":87.489000000000004},"last":3.1389999999999998}]}]}]}} 2020-11-20T12:05:01.630 INFO:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T12:05:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 Processor -- start 2020-11-20T12:05:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- start start 2020-11-20T12:05:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3250061300 0x7f32501376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500a78e0 con 0x7f32500a0c20 2020-11-20T12:05:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32500a1070 con 0x7f32500a7480 2020-11-20T12:05:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3250138660 con 0x7f3250061300 2020-11-20T12:05:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3255e5b700 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3250061300 0x7f32501376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f325665c700 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32500a0c20 0x7f3250141f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:48080/0 (socket says 172.21.15.161:48080) 2020-11-20T12:05:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f325665c700 1 -- 172.21.15.161:0/836277891 learned_addr learned my addr 172.21.15.161:0/836277891 (peer_addr_for_me v1:172.21.15.161:0/0) 2020-11-20T12:05:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3255e5b700 1 -- 172.21.15.161:0/836277891 >> v1:172.21.15.186:6789/0 conn(0x7f32500a7480 legacy=0x7f32500a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3255e5b700 1 -- 172.21.15.161:0/836277891 >> v1:172.21.15.161:6789/0 conn(0x7f32500a0c20 legacy=0x7f3250141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3255e5b700 1 -- 172.21.15.161:0/836277891 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325005c170 con 0x7f3250061300 2020-11-20T12:05:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3255e5b700 1 --2- 172.21.15.161:0/836277891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3250061300 0x7f32501376c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f324800b9a0 tx=0x7f3248006df0).ready entity=mon.0 client_cookie=86bf110438f24cea server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3254e59700 1 -- 172.21.15.161:0/836277891 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32480096b0 con 0x7f3250061300 2020-11-20T12:05:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3254e59700 1 -- 172.21.15.161:0/836277891 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3248009810 con 0x7f3250061300 2020-11-20T12:05:01.751 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3254e59700 1 -- 172.21.15.161:0/836277891 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248009b90 con 0x7f3250061300 2020-11-20T12:05:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- 172.21.15.161:0/836277891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3250061300 msgr2=0x7f32501376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 --2- 172.21.15.161:0/836277891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3250061300 0x7f32501376c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f324800b9a0 tx=0x7f3248006df0).stop 2020-11-20T12:05:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- 172.21.15.161:0/836277891 shutdown_connections 2020-11-20T12:05:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 --2- 172.21.15.161:0/836277891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3250061300 0x7f32501376c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- 172.21.15.161:0/836277891 >> 172.21.15.161:0/836277891 conn(0x7f32500adf90 msgr2=0x7f32500a9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:05:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- 172.21.15.161:0/836277891 shutdown_connections 2020-11-20T12:05:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.737+0000 7f3256e5d700 1 -- 172.21.15.161:0/836277891 wait complete. 2020-11-20T12:05:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 Processor -- start 2020-11-20T12:05:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- start start 2020-11-20T12:05:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3250061300 0x7f325013ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32500a0c20 0x7f325014d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32500a8760 con 0x7f32500a7480 2020-11-20T12:05:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325014dc70 con 0x7f32500a0c20 2020-11-20T12:05:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325014df10 con 0x7f3250061300 2020-11-20T12:05:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37844/0 (socket says 172.21.15.161:37844) 2020-11-20T12:05:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 -- 172.21.15.161:0/1637300030 learned_addr learned my addr 172.21.15.161:0/1637300030 (peer_addr_for_me v2:172.21.15.161:0/0) 2020-11-20T12:05:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325565a700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32500a0c20 0x7f325014d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.757 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3255e5b700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3250061300 0x7f325013ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 -- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3250061300 msgr2=0x7f325013ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3250061300 0x7f325013ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 -- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32500a0c20 msgr2=0x7f325014d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32500a0c20 0x7f325014d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 -- 172.21.15.161:0/1637300030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3250149c00 con 0x7f32500a7480 2020-11-20T12:05:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f325665c700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f324000cb50 tx=0x7f3240007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240005bd0 con 0x7f32500a7480 2020-11-20T12:05:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240005d30 con 0x7f32500a7480 2020-11-20T12:05:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325014a0a0 con 0x7f32500a7480 2020-11-20T12:05:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240005ea0 con 0x7f32500a7480 2020-11-20T12:05:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.741+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325014a570 con 0x7f32500a7480 2020-11-20T12:05:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250149d90 con 0x7f32500a7480 2020-11-20T12:05:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 66655+0+0 (secure 0 0 0) 0x7f3240010030 con 0x7f32500a7480 2020-11-20T12:05:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f324dffb700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 0x7f3228057c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:05:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f324006e9a0 con 0x7f32500a7480 2020-11-20T12:05:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f3255e5b700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 0x7f3228057c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:05:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.745+0000 7f3255e5b700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 0x7f3228057c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f324800b150 tx=0x7f3248015000).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:05:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.749+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3240044660 con 0x7f32500a7480 2020-11-20T12:05:01.912 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.901+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f3250044f60 con 0x7f32500a7480 2020-11-20T12:05:01.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3240044660 con 0x7f32500a7480 2020-11-20T12:05:01.922 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f324dffb700 1 -- 172.21.15.161:0/1637300030 <== mon.0 v2:172.21.15.161:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3240047c80 con 0x7f32500a7480 2020-11-20T12:05:01.925 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 msgr2=0x7f3228057c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.926 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 0x7f3228057c80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f324800b150 tx=0x7f3248015000).stop 2020-11-20T12:05:01.926 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 msgr2=0x7f325014d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:05:01.926 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f324000cb50 tx=0x7f3240007ef0).stop 2020-11-20T12:05:01.926 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 shutdown_connections 2020-11-20T12:05:01.926 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:6832/14582,v1:172.21.15.161:6833/14582] conn(0x7f32280557c0 0x7f3228057c80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32500a7480 0x7f325014d6c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3250061300 0x7f325013ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 --2- 172.21.15.161:0/1637300030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f32500a0c20 0x7f325014d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:05:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 >> 172.21.15.161:0/1637300030 conn(0x7f32500adf90 msgr2=0x7f32500608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:05:01.928 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 shutdown_connections 2020-11-20T12:05:01.928 INFO:teuthology.orchestra.run.smithi161.stderr:2020-11-20T12:05:01.913+0000 7f3256e5d700 1 -- 172.21.15.161:0/1637300030 wait complete. 2020-11-20T12:05:01.941 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T12:05:01.941 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T12:05:01.942 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:01.952 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T12:05:01.953 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T12:05:01.953 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:05.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-11-20T12:05:08.054 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T12:05:08.055 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T12:05:08.056 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T12:05:08.056 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:11.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2020-11-20T12:05:11.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-11-20T12:05:14.158 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T12:05:14.159 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T12:05:14.159 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:17.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2020-11-20T12:05:17.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2020-11-20T12:05:20.261 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T12:05:20.263 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T12:05:20.263 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:20.348 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T12:05:20.349 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T12:05:20.349 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:23.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2020-11-20T12:05:23.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2020-11-20T12:05:26.451 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T12:05:26.452 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T12:05:26.452 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:29.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2020-11-20T12:05:29.074 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2020-11-20T12:05:32.276 INFO:teuthology.orchestra.run.smithi161.stderr:ceph-osd: no process found 2020-11-20T12:05:32.555 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T12:05:32.556 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T12:05:32.556 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:34.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2020-11-20T12:05:34.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2020-11-20T12:05:38.658 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T12:05:38.659 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T12:05:38.659 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.736 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T12:05:38.737 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T12:05:38.737 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.834 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T12:05:38.835 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T12:05:38.835 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T12:05:38.836 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.859 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T12:05:38.860 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T12:05:38.860 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.887 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T12:05:38.888 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T12:05:38.888 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T12:05:38.888 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.920 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T12:05:38.921 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T12:05:38.921 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:38.950 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T12:05:38.950 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T12:05:38.951 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:05:39.010 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T12:05:39.011 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T12:05:39.011 INFO:teuthology.orchestra.run.smithi161:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-11-20T12:05:39.331 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T12:05:39.332 INFO:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T12:05:39.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2020-11-20T12:05:40.204 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T12:05:40.205 INFO:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T12:05:40.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T12:05:40.488 INFO:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T12:05:40.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi161.front.sepia.ceph.com 2020-11-20T12:05:40.720 INFO:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T12:05:40.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T12:05:40.924 INFO:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T12:05:41.490 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T12:05:41.490 INFO:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T12:05:41.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T12:05:41.707 INFO:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T12:05:41.882 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2020-11-20T12:05:41.883 INFO:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T12:05:42.062 INFO:tasks.ceph:Archiving mon data... 2020-11-20T12:05:42.064 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/data/mon.a.tgz 2020-11-20T12:05:42.065 INFO:teuthology.orchestra.run.smithi161:> mktemp 2020-11-20T12:05:42.152 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.8qHc6XvzBK 2020-11-20T12:05:42.152 INFO:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.8qHc6XvzBK 2020-11-20T12:05:42.475 INFO:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.8qHc6XvzBK 2020-11-20T12:05:42.849 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.8qHc6XvzBK is 580KB 2020-11-20T12:05:42.919 INFO:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.8qHc6XvzBK 2020-11-20T12:05:42.926 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/data/mon.b.tgz 2020-11-20T12:05:42.926 INFO:teuthology.orchestra.run.smithi186:> mktemp 2020-11-20T12:05:42.948 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.69zkpCQp8c 2020-11-20T12:05:42.948 INFO:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.69zkpCQp8c 2020-11-20T12:05:43.219 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.69zkpCQp8c 2020-11-20T12:05:43.343 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.69zkpCQp8c is 596KB 2020-11-20T12:05:43.461 INFO:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.69zkpCQp8c 2020-11-20T12:05:43.481 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/data/mon.c.tgz 2020-11-20T12:05:43.482 INFO:teuthology.orchestra.run.smithi186:> mktemp 2020-11-20T12:05:43.536 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.ptSUbMNKOa 2020-11-20T12:05:43.536 INFO:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ptSUbMNKOa 2020-11-20T12:05:43.786 INFO:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.ptSUbMNKOa 2020-11-20T12:05:43.851 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.ptSUbMNKOa is 596KB 2020-11-20T12:05:43.915 INFO:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.ptSUbMNKOa 2020-11-20T12:05:43.921 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T12:05:43.921 INFO:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:05:43.924 INFO:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:05:43.984 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T12:05:43.985 INFO:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:05:43.987 INFO:teuthology.orchestra.run.smithi186:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:05:44.068 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:05:44.073 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:05:44.095 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T12:05:44.098 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/remote/smithi161/crash 2020-11-20T12:05:44.099 INFO:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:05:44.116 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/remote/smithi186/crash 2020-11-20T12:05:44.121 INFO:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:05:44.141 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T12:20:35.659 INFO:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:35.882 INFO:teuthology.orchestra.run.smithi186:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:35.912 INFO:tasks.ceph:Compressing logs... 2020-11-20T12:20:35.912 INFO:teuthology.orchestra.run.smithi161:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:20:35.914 INFO:teuthology.orchestra.run.smithi186:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:20:35.957 INFO:tasks.ceph:Archiving logs... 2020-11-20T12:20:35.959 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640265/remote/smithi161/log 2020-11-20T12:20:35.960 INFO:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/log/ceph -- .