2020-07-16T20:19:51.283 INFO:root:teuthology version: 1.0.0-10de4c5 2020-07-16T20:19:51.286 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi --archive /home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370 --description fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_quota} --verbose --block --lock -- /tmp/teuthology-worker.o_zt01hi.tmp 2020-07-16T20:19:51.329 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:19:51.406 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370 branch: wip-pdonnell-testing-20200716.140830 description: fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_quota} email: pdonnell@redhat.com first_in_suite: false job_id: '5231370' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200716.140830 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200716.140830 sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a owner: scheduled_pdonnell@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.1 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - client.2 - client.3 sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20200716.140830 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - fs/quota teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.20769 2020-07-16T20:19:51.407 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa; will attempt to use it 2020-07-16T20:19:51.408 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks 2020-07-16T20:19:51.408 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-07-16T20:19:51.411 INFO:teuthology.task.internal:Checking packages... 2020-07-16T20:19:51.439 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a' 2020-07-16T20:19:51.440 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-07-16T20:19:51.441 INFO:teuthology.packaging:ref: None 2020-07-16T20:19:51.442 INFO:teuthology.packaging:tag: None 2020-07-16T20:19:51.442 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200716.140830 2020-07-16T20:19:51.442 INFO:teuthology.packaging:sha1: 8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:19:51.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200716.140830 2020-07-16T20:19:51.631 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-3565.g8e60ca350a5 2020-07-16T20:19:51.631 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-07-16T20:19:51.642 INFO:teuthology.task.internal:no buildpackages task found 2020-07-16T20:19:51.642 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-07-16T20:19:51.660 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-07-16T20:19:51.661 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:19:51.723 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-07-16T20:20:01.747 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370'} 2020-07-16T20:20:01.775 DEBUG:teuthology.lock.ops:locked ubuntu@smithi022.front.sepia.ceph.com, ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:20:01.863 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75d980e8c8>, signals=[15]) 2020-07-16T20:20:02.101 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.1 2020-07-16T20:20:02.107 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.1 2020-07-16T20:20:02.490 INFO:teuthology.orchestra.console:Power off smithi022 2020-07-16T20:20:02.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T20:20:02.526 INFO:teuthology.orchestra.console:Power off smithi116 2020-07-16T20:20:02.527 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-07-16T20:20:02.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:02.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:06.594 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:06.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:10.710 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:10.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:14.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:14.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:15.065 INFO:teuthology.orchestra.console:Power off for smithi022 completed 2020-07-16T20:20:15.088 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2020-07-16T20:20:15.167 INFO:teuthology.orchestra.console:Power on smithi022 2020-07-16T20:20:15.167 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T20:20:15.189 INFO:teuthology.orchestra.console:Power on smithi116 2020-07-16T20:20:15.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-07-16T20:20:15.211 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:15.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:19.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:19.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-07-16T20:20:19.466 INFO:teuthology.orchestra.console:Power on for smithi022 completed 2020-07-16T20:20:19.481 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2020-07-16T20:20:19.568 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2020-07-16T20:20:19.582 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2020-07-16T20:22:50.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:22:50.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:22:59.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:22:59.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:09.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:09.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:18.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:18.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:27.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:27.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:36.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:36.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:23:45.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:42.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:42.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T20:24:42.564 INFO:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T20:24:42.868 INFO:teuthology.provision.fog.smithi022:Node is ready 2020-07-16T20:24:42.869 INFO:teuthology.orchestra.run.smithi022:> hostname 2020-07-16T20:24:42.885 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2020-07-16T20:24:42.886 INFO:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2020-07-16T20:24:42.941 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2020-07-16T20:24:42.942 INFO:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2020-07-16T20:24:43.049 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2020-07-16T20:24:43.083 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2020-07-16T20:24:43.164 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2020-07-16T20:24:43.236 INFO:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2020-07-16T20:24:43.307 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2020-07-16T20:24:43.308 DEBUG:teuthology.parallel:result is None 2020-07-16T20:24:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:51.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-07-16T20:24:51.776 INFO:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-07-16T20:24:52.088 INFO:teuthology.provision.fog.smithi116:Node is ready 2020-07-16T20:24:52.089 INFO:teuthology.orchestra.run.smithi116:> hostname 2020-07-16T20:24:52.104 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2020-07-16T20:24:52.104 INFO:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2020-07-16T20:24:52.159 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2020-07-16T20:24:52.160 INFO:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2020-07-16T20:24:52.272 INFO:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2020-07-16T20:24:52.308 INFO:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2020-07-16T20:24:52.375 INFO:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2020-07-16T20:24:52.444 INFO:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2020-07-16T20:24:52.511 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2020-07-16T20:24:52.512 DEBUG:teuthology.parallel:result is None 2020-07-16T20:24:52.681 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2020-07-16T20:24:52.682 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T20:24:52.726 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2020-07-16T20:24:52.727 INFO:teuthology.lock.ops:New key found. Updating... 2020-07-16T20:24:52.752 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2020-07-16T20:24:52.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:24:52.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:52.831 INFO:teuthology.orchestra.run.smithi022:> true 2020-07-16T20:24:53.013 INFO:teuthology.orchestra.run.smithi022:> uname -m 2020-07-16T20:24:53.068 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2020-07-16T20:24:53.069 INFO:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2020-07-16T20:24:53.123 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux" 2020-07-16T20:24:53.123 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8 (Core)" 2020-07-16T20:24:53.123 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2020-07-16T20:24:53.124 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:24:53.124 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2020-07-16T20:24:53.124 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:24:53.124 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:24:53.125 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2020-07-16T20:24:53.125 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:24:53.125 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:24:53.125 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:24:53.125 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:24:53.126 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:24:53.126 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:24:53.126 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:24:53.126 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:24:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:24:53.128 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2020-07-16T20:24:53.152 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2020-07-16T20:24:53.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:24:53.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:53.226 INFO:teuthology.orchestra.run.smithi116:> true 2020-07-16T20:24:53.387 INFO:teuthology.orchestra.run.smithi116:> uname -m 2020-07-16T20:24:53.441 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2020-07-16T20:24:53.442 INFO:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2020-07-16T20:24:53.495 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Linux" 2020-07-16T20:24:53.496 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8 (Core)" 2020-07-16T20:24:53.496 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2020-07-16T20:24:53.496 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:24:53.496 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2020-07-16T20:24:53.497 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:24:53.497 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:24:53.497 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2020-07-16T20:24:53.497 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:24:53.498 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:24:53.498 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:24:53.498 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:24:53.498 INFO:teuthology.orchestra.run.smithi116.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:24:53.498 INFO:teuthology.orchestra.run.smithi116.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:24:53.499 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:24:53.499 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:24:53.499 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:24:53.500 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2020-07-16T20:24:53.521 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-07-16T20:24:53.564 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmxN04BxgFeYgOJwQ0OYfbOOmqYjfAxfew/Vig6hQIIL/Nbi2lfhBkIBorbvRoP9uLACkE59F28CI6wnjFgJz+bbpN+k/XmW8wPvD1pJq5UnOkV3wYHtBQcS+JolTZKERO2O8Uap6YUw6u6Rm3zsP5Kq1nFhFyLF8EujS3QAdvRXpW4BjyCy+4T1Z3QltnEEJKlor86fXf6ES3bRAMccRSkc6CXAmF+Qe1wyMkFKdURZexZfbPRtfNLfzx5r2vv/AjEvqH1U1NS53ZfBB+r+PhuZZmbR/of1RtRBRNbuJahNnfBZnR3FSIyz+y67sHHO8Zh5VEJ3BZMO4IG4UF9KDZmOGQspjhk4f4+h/kxL/nU4qG/X83xqP4hlTmPaIyyG+BPSL3y61w3Poc63yjZf/vz4x3kOKZC5ZgpCaoJayjWBPxSgMjDASSjOS5Zxehdf5E0xViaESg1MO0ceouAgO6CyiHECnY6hKU0sFj/Bj2HS7+WpnHKb+VyAo6mNLB8ZE= smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3dED3ClCadtbbAg6Aph0wHVKavzBwCQcgrO93bnqBUNG+tsMWeHyvdDcfYZGz0P8x/xCcg5H3bxHQdCPtc6OQyRwX//P3WPv6+k5+X2mQWl5E9la5ZSBN24eLCNE4w4VPv6779GY/b3fB5dDiXFU9KFNdi5vCfnKpqB3BK0PpS6V+7oA0B5mUoiMuXuZN379SQIaK2S+tHoJB4uQzcddUeZn30TK1Oifpq6Zd40wfWExWTS43yL6n0g2F/bFNs9BCfTsvXcT2fgex/E1qcaEaPXK4orU6uCDq2svs4WDQEqerGLitMxKtrxX/HwsOc5omjPVwMgn8guAhzpfAHxnE8z6fGptSg7EI7l5K9+uZxy34QNGeJYBDwMC1dPB26I+2Eozy2nZyHvi9cIItuGfMOJhXvyqQm4ECWGUTONBJ/779IBT73XjxpdOlocGpOvAh8ehC7ccvQcmZUz+ykkBKQMverS+VU9HUJ3mXjvsbimWhPI5pb9yHuNUgdaGpKmk= 2020-07-16T20:24:53.565 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-07-16T20:24:53.623 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-07-16T20:24:53.642 INFO:teuthology.task.internal:Saving configuration 2020-07-16T20:24:53.663 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-07-16T20:24:53.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-07-16T20:24:53.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 20:20:01.756541', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEQ95NG9S+vHWuNGy5wBenDwmIY2ODkmoaly7qkaHAzvvwg/R823Z6+9X73vNYwJBCWode5ZBngEQHf1M+PQqpY=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi022.front.sepia.ceph.com'} 2020-07-16T20:24:53.738 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-07-16 20:20:01.756562', 'description': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEURHHyaiJmmNd8AR1y6gVBrrXGJH0qDSPuSOpr0ORX0ppIoQvejVcoFm38dSRSUbboMcGycUWh6a4bQW/G8JiA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi116.front.sepia.ceph.com'} 2020-07-16T20:24:53.739 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-07-16T20:24:53.752 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'] 2020-07-16T20:24:53.753 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3'] 2020-07-16T20:24:53.753 INFO:teuthology.run_tasks:Running task console_log... 2020-07-16T20:24:53.854 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f75d9742d90>, signals=[15]) 2020-07-16T20:24:53.856 INFO:teuthology.run_tasks:Running task internal.connect... 2020-07-16T20:24:53.866 INFO:teuthology.task.internal:Opening connections... 2020-07-16T20:24:53.867 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:24:53.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:53.989 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:24:53.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:24:54.068 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-07-16T20:24:54.078 INFO:teuthology.orchestra.run.smithi022:> uname -m 2020-07-16T20:24:54.128 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2020-07-16T20:24:54.129 INFO:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2020-07-16T20:24:54.184 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Linux" 2020-07-16T20:24:54.184 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8 (Core)" 2020-07-16T20:24:54.184 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2020-07-16T20:24:54.184 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:24:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2020-07-16T20:24:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:24:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:24:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2020-07-16T20:24:54.185 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:24:54.186 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:24:54.186 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:24:54.186 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:24:54.186 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:24:54.186 INFO:teuthology.orchestra.run.smithi022.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:24:54.187 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:24:54.187 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:24:54.187 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:24:54.187 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2020-07-16T20:24:54.210 INFO:teuthology.orchestra.run.smithi116:> uname -m 2020-07-16T20:24:54.235 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2020-07-16T20:24:54.236 INFO:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2020-07-16T20:24:54.293 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Linux" 2020-07-16T20:24:54.293 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8 (Core)" 2020-07-16T20:24:54.294 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2020-07-16T20:24:54.294 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2020-07-16T20:24:54.294 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2020-07-16T20:24:54.295 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2020-07-16T20:24:54.295 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-07-16T20:24:54.295 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2020-07-16T20:24:54.296 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-07-16T20:24:54.296 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.centos.org/" 2020-07-16T20:24:54.296 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-07-16T20:24:54.297 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:24:54.297 INFO:teuthology.orchestra.run.smithi116.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-07-16T20:24:54.297 INFO:teuthology.orchestra.run.smithi116.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-07-16T20:24:54.299 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-07-16T20:24:54.299 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-07-16T20:24:54.299 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:24:54.300 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2020-07-16T20:24:54.324 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-07-16T20:24:55.336 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-07-16T20:24:55.347 INFO:teuthology.task.internal:Checking for old test directory... 2020-07-16T20:24:55.348 INFO:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2020-07-16T20:24:55.353 INFO:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2020-07-16T20:24:55.370 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-07-16T20:24:55.399 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-07-16T20:24:55.400 INFO:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2020-07-16T20:24:55.413 INFO:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2020-07-16T20:24:55.452 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-07-16T20:24:55.515 INFO:teuthology.run_tasks:Running task kernel... 2020-07-16T20:24:55.565 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.2': {'kdb': True, 'sha1': 'distro'}, 'client.3': {'kdb': True, 'sha1': 'distro'}} 2020-07-16T20:24:55.566 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-07-16T20:24:55.567 INFO:teuthology.orchestra.run.smithi022:> uname -r 2020-07-16T20:24:55.584 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:24:55.585 INFO:teuthology.task.kernel:Running kernel on smithi022: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:24:55.585 INFO:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2020-07-16T20:24:58.209 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - AppStream 32 MB/s | 7.0 MB 00:00 2020-07-16T20:24:59.504 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:24:59.964 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Extras 86 kB/s | 5.5 kB 00:00 2020-07-16T20:25:00.388 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 20 MB/s | 7.4 MB 00:00 2020-07-16T20:25:01.994 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-07-16T20:25:03.093 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T20:25:03.093 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-07-16T20:25:03.242 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2020-07-16T20:25:03.243 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2020-07-16T20:25:03.243 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2020-07-16T20:25:03.361 INFO:teuthology.orchestra.run.smithi022:> echo no | sudo yum reinstall kernel || true 2020-07-16T20:25:03.791 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 08:25:01 PM UTC. 2020-07-16T20:25:04.049 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:04.049 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:04.135 INFO:teuthology.orchestra.run.smithi022:> sudo yum reinstall -y kernel || true 2020-07-16T20:25:04.560 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:03 ago on Thu 16 Jul 2020 08:25:01 PM UTC. 2020-07-16T20:25:04.911 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:04.911 INFO:teuthology.orchestra.run.smithi022.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:04.945 INFO:teuthology.orchestra.run.smithi022.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:04.984 INFO:teuthology.orchestra.run.smithi022:> rpm -q kernel --last | head -n 1 2020-07-16T20:25:05.057 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Thu 16 Jul 2020 06:30:18 PM UTC 2020-07-16T20:25:05.063 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:05.063 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T20:25:05.064 INFO:teuthology.orchestra.run.smithi116:> uname -r 2020-07-16T20:25:05.083 INFO:teuthology.orchestra.run.smithi116.stdout:4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:05.083 INFO:teuthology.task.kernel:Running kernel on smithi116: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:05.084 INFO:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2020-07-16T20:25:07.654 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - AppStream 40 MB/s | 7.0 MB 00:00 2020-07-16T20:25:08.852 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-07-16T20:25:09.277 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-07-16T20:25:09.643 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T20:25:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 4.3 MB/s | 20 kB 00:00 2020-07-16T20:25:12.063 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-07-16T20:25:12.063 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-193.6.3.el8_2.x86_64 is already installed. 2020-07-16T20:25:12.217 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2020-07-16T20:25:12.218 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2020-07-16T20:25:12.219 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2020-07-16T20:25:12.335 INFO:teuthology.orchestra.run.smithi116:> echo no | sudo yum reinstall kernel || true 2020-07-16T20:25:12.732 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:01 ago on Thu 16 Jul 2020 08:25:11 PM UTC. 2020-07-16T20:25:12.990 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:12.990 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:13.031 INFO:teuthology.orchestra.run.smithi116.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:13.079 INFO:teuthology.orchestra.run.smithi116:> sudo yum reinstall -y kernel || true 2020-07-16T20:25:13.475 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:02 ago on Thu 16 Jul 2020 08:25:11 PM UTC. 2020-07-16T20:25:13.714 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-147.el8.x86_64 (from anaconda) not available. 2020-07-16T20:25:13.715 INFO:teuthology.orchestra.run.smithi116.stdout:Installed package kernel-4.18.0-193.6.3.el8_2.x86_64 (from BaseOS) not available. 2020-07-16T20:25:13.752 INFO:teuthology.orchestra.run.smithi116.stderr:Error: No packages marked for reinstall. 2020-07-16T20:25:13.795 INFO:teuthology.orchestra.run.smithi116:> rpm -q kernel --last | head -n 1 2020-07-16T20:25:13.863 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-4.18.0-193.6.3.el8_2.x86_64 Thu 16 Jul 2020 06:30:18 PM UTC 2020-07-16T20:25:13.865 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-193.6.3.el8_2.x86_64 2020-07-16T20:25:13.865 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-07-16T20:25:13.866 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-07-16T20:25:13.866 INFO:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T20:25:13.910 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2020-07-16T20:25:13.923 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-07-16T20:25:13.924 INFO:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-07-16T20:25:13.963 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2020-07-16T20:25:13.975 INFO:teuthology.run_tasks:Running task internal.base... 2020-07-16T20:25:13.986 INFO:teuthology.task.internal:Creating test directory... 2020-07-16T20:25:13.987 INFO:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T20:25:13.989 INFO:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-07-16T20:25:14.039 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-07-16T20:25:14.050 INFO:teuthology.run_tasks:Running task internal.archive... 2020-07-16T20:25:14.066 INFO:teuthology.task.internal:Creating archive directory... 2020-07-16T20:25:14.068 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T20:25:14.071 INFO:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-07-16T20:25:14.105 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-07-16T20:25:14.117 INFO:teuthology.task.internal:Enabling coredump saving... 2020-07-16T20:25:14.118 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T20:25:14.135 INFO:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-07-16T20:25:14.173 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:14.186 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:14.189 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:14.199 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-07-16T20:25:14.200 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-07-16T20:25:14.213 INFO:teuthology.task.internal:Configuring sudo... 2020-07-16T20:25:14.213 INFO:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T20:25:14.233 INFO:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-07-16T20:25:14.271 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-07-16T20:25:14.288 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-07-16T20:25:14.290 INFO:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T20:25:14.310 INFO:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-07-16T20:25:14.325 INFO:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:14.404 INFO:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:14.457 INFO:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:14.572 INFO:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:14.618 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T20:25:14.703 INFO:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:14.741 INFO:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-07-16T20:25:14.802 INFO:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:14.877 INFO:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-07-16T20:25:14.925 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-07-16T20:25:15.010 INFO:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2020-07-16T20:25:15.013 INFO:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2020-07-16T20:25:15.081 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T20:25:15.111 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-07-16T20:25:15.522 INFO:teuthology.run_tasks:Running task internal.timer... 2020-07-16T20:25:15.534 INFO:teuthology.task.internal:Starting timer... 2020-07-16T20:25:15.534 INFO:teuthology.run_tasks:Running task pcp... 2020-07-16T20:25:15.578 INFO:teuthology.run_tasks:Running task selinux... 2020-07-16T20:25:15.602 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-07-16T20:25:15.604 INFO:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2020-07-16T20:25:15.673 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: [ OK ] 2020-07-16T20:25:15.675 INFO:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2020-07-16T20:25:15.734 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: [ OK ] 2020-07-16T20:25:15.735 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-07-16T20:25:15.736 INFO:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2020-07-16T20:25:15.760 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2020-07-16T20:25:15.761 INFO:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2020-07-16T20:25:15.776 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2020-07-16T20:25:15.777 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2020-07-16T20:25:15.778 INFO:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T20:25:15.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:25:15.836 INFO:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-07-16T20:25:15.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:25:15.866 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-07-16T20:25:15.866 INFO:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2020-07-16T20:25:15.931 INFO:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2020-07-16T20:25:15.982 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-07-16T20:25:15.992 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-07-16T20:25:15.993 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-07-16T20:25:16.028 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-07-16T20:25:16.030 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-07-16T20:25:16.585 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-07-16T20:25:17.673 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-07-16T20:25:20.762 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-07-16T20:25:20.796 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:20 +0000 (0:00:00.117) 0:00:00.117 ********* 2020-07-16T20:25:20.818 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:20 +0000 (0:00:00.021) 0:00:00.139 ********* 2020-07-16T20:25:22.464 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi116.front.sepia.ceph.com] 2020-07-16T20:25:22.546 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:22 +0000 (0:00:01.724) 0:00:01.863 ********* 2020-07-16T20:25:22.588 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] 2020-07-16T20:25:22.681 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:22 +0000 (0:00:00.138) 0:00:02.002 ********* 2020-07-16T20:25:23.069 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:25:23.109 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.427) 0:00:02.430 ********* 2020-07-16T20:25:23.110 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:23.124 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:25:23.126 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:23.187 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.077) 0:00:02.508 ********* 2020-07-16T20:25:23.740 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-07-16T20:25:23.742 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T20:25:23.791 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.603) 0:00:03.111 ********* 2020-07-16T20:25:23.804 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-07-16T20:25:23.859 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.067) 0:00:03.179 ********* 2020-07-16T20:25:23.869 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-07-16T20:25:23.871 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:23.914 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.055) 0:00:03.235 ********* 2020-07-16T20:25:23.929 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:23.960 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:23 +0000 (0:00:00.046) 0:00:03.281 ********* 2020-07-16T20:25:24.443 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-07-16T20:25:24.446 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:24.487 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:24 +0000 (0:00:00.526) 0:00:03.808 ********* 2020-07-16T20:25:24.498 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:24.549 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:24 +0000 (0:00:00.059) 0:00:03.867 ********* 2020-07-16T20:25:25.600 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-07-16T20:25:25.603 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594931124.5056543-57947464452936/source", "state": "file", "uid": 0} 2020-07-16T20:25:25.668 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:25 +0000 (0:00:01.119) 0:00:04.987 ********* 2020-07-16T20:25:25.677 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1594931124.5650032-41698431198399/source", "state": "file", "uid": 0} 2020-07-16T20:25:25.720 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:25 +0000 (0:00:00.051) 0:00:05.039 ********* 2020-07-16T20:25:26.183 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-07-16T20:25:26.185 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T20:25:26.218 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-07-16T20:25:26.220 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-07-16T20:25:26.349 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2020-07-16T20:25:26.350 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-07-16T20:25:26.363 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-07-16T20:25:26.534 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:26 +0000 (0:00:00.815) 0:00:05.854 ********* 2020-07-16T20:25:26.584 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:26 +0000 (0:00:00.043) 0:00:05.897 ********* 2020-07-16T20:25:27.316 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi116.front.sepia.ceph.com] 2020-07-16T20:25:27.333 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] 2020-07-16T20:25:27.460 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-07-16T20:25:27.463 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:27 +0000 (0:00:00.883) 0:00:06.781 ********* 2020-07-16T20:25:27.531 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:27 +0000 (0:00:00.069) 0:00:06.851 ********* 2020-07-16T20:25:28.234 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-07-16T20:25:28.236 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.219835", "end": "2020-07-16 20:25:28.167378", "rc": 0, "start": "2020-07-16 20:25:27.947543", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:28.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.755) 0:00:07.606 ********* 2020-07-16T20:25:28.298 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.247320", "end": "2020-07-16 20:25:28.202325", "rc": 0, "start": "2020-07-16 20:25:27.955005", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:28.337 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.051) 0:00:07.658 ********* 2020-07-16T20:25:28.567 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-07-16T20:25:28.569 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.037005", "end": "2020-07-16 20:25:28.535753", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:28.498748", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.006579", "end": "2020-07-16 20:25:28.542083", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:28.535504", "stderr": "", "stderr_lines": [], "stdout": "d2c541f972f084049b707e8806b2858a9ab4fb83", "stdout_lines": ["d2c541f972f084049b707e8806b2858a9ab4fb83"]} 2020-07-16T20:25:28.609 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.271) 0:00:07.930 ********* 2020-07-16T20:25:28.655 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.045) 0:00:07.975 ********* 2020-07-16T20:25:28.663 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-07-16T20:25:28.665 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-07-16T20:25:28.702 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.047) 0:00:08.023 ********* 2020-07-16T20:25:28.712 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-07-16T20:25:28.763 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.060) 0:00:08.084 ********* 2020-07-16T20:25:28.774 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-07-16T20:25:28.776 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:28.815 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.051) 0:00:08.136 ********* 2020-07-16T20:25:28.825 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:28.871 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.056) 0:00:08.192 ********* 2020-07-16T20:25:28.881 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-07-16T20:25:28.883 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:28.924 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.052) 0:00:08.245 ********* 2020-07-16T20:25:28.933 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:28.970 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:28 +0000 (0:00:00.046) 0:00:08.291 ********* 2020-07-16T20:25:28.980 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-07-16T20:25:28.982 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.020 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.049) 0:00:08.340 ********* 2020-07-16T20:25:29.030 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.082 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.062) 0:00:08.403 ********* 2020-07-16T20:25:29.091 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-07-16T20:25:29.093 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.128 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.045) 0:00:08.448 ********* 2020-07-16T20:25:29.139 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.179 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.049) 0:00:08.498 ********* 2020-07-16T20:25:29.191 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-07-16T20:25:29.194 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.239 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.061) 0:00:08.560 ********* 2020-07-16T20:25:29.255 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.304 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:29 +0000 (0:00:00.064) 0:00:08.624 ********* 2020-07-16T20:25:29.337 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-07-16T20:25:29.340 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.358 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.366 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.378 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.389 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.391 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.401 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.404 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.417 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.422 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.435 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.471 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.494 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.496 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVN 2020-07-16T20:25:29.498 INFO:teuthology.task.ansible.out:TUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.529 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.531 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ub 2020-07-16T20:25:29.533 INFO:teuthology.task.ansible.out:untu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2020-07-16T20:25:29.535 INFO:teuthology.task.ansible.out:"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.546 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.592 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.603 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.615 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.618 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.620 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.622 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.623 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.645 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratzas@laptop 65tzczvq6U9MaLuTtZUWJA 36cc4b5af314d8d2ae1cc974086b62fd4d9a722b1469f7cf00ba647241b834c9"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.647 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281a 2020-07-16T20:25:29.649 INFO:teuthology.task.ansible.out:o7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c 2020-07-16T20:25:29.650 INFO:teuthology.task.ansible.out:895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFy 2020-07-16T20:25:29.652 INFO:teuthology.task.ansible.out:Phf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditiona 2020-07-16T20:25:29.654 INFO:teuthology.task.ansible.out:l result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'davidz 2020-07-16T20:25:29.656 INFO:teuthology.task.ansible.out:', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "chan 2020-07-16T20:25:29.657 INFO:teuthology.task.ansible.out:ged": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.662 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.663 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.663 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.664 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.664 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.665 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8 2020-07-16T20:25:29.666 INFO:teuthology.task.ansible.out:f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6d 2020-07-16T20:25:29.668 INFO:teuthology.task.ansible.out:f367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_rea 2020-07-16T20:25:29.670 INFO:teuthology.task.ansible.out:son": "Conditional result was False"} 2020-07-16T20:25:29.678 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.680 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (it 2020-07-16T20:25:29.683 INFO:teuthology.task.ansible.out:em={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0 2020-07-16T20:25:29.685 INFO:teuthology.task.ansible.out:aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603 2020-07-16T20:25:29.686 INFO:teuthology.task.ansible.out:b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.697 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.712 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.714 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.726 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.728 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.730 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.732 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.765 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.767 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.769 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.770 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.770 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.771 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 2020-07-16T20:25:29.772 INFO:teuthology.task.ansible.out: f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.784 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.795 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.797 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.819 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.821 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vas 2020-07-16T20:25:29.823 INFO:teuthology.task.ansible.out:u", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d6 2020-07-16T20:25:29.825 INFO:teuthology.task.ansible.out:0cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.836 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.838 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.840 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.843 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": fal 2020-07-16T20:25:29.844 INFO:teuthology.task.ansible.out:se, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.855 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.865 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.887 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.889 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': ' 2020-07-16T20:25:29.891 INFO:teuthology.task.ansible.out:gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430 2020-07-16T20:25:29.893 INFO:teuthology.task.ansible.out:c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.902 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.903 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.905 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.907 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.908 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.910 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.916 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.923 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.934 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.936 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "ite 2020-07-16T20:25:29.938 INFO:teuthology.task.ansible.out:m": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.949 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.950 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.951 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.962 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.964 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.975 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.977 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.987 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:29.992 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.002 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.004 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.013 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.016 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.016 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loo 2020-07-16T20:25:30.018 INFO:teuthology.task.ansible.out:p_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.031 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.033 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.050 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika 2020-07-16T20:25:30.053 INFO:teuthology.task.ansible.out:@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon iDR2L3LMuqFG10t1dKdXtA 61f19801e4ab7abb7597df1606036f11b0cf6a27df853dca2df8f0bb071318e1"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.078 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.080 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.081 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.092 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.093 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.112 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.120 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.121 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.122 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2020-07-16T20:25:30.125 INFO:teuthology.task.ansible.out:"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@ 2020-07-16T20:25:30.129 INFO:teuthology.task.ansible.out:suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.149 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.167 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.178 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.180 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.193 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'toabctl' 2020-07-16T20:25:30.195 INFO:teuthology.task.ansible.out:, 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.215 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.218 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@hrk-thinkpad 6DWhbAZZDUo789PultFaJw f586e852c2dab5f56e3e12237dadd8f76f61d9136479329698e6f7dcd91f9034"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad" 2020-07-16T20:25:30.221 INFO:teuthology.task.ansible.out:, "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2 2020-07-16T20:25:30.223 INFO:teuthology.task.ansible.out:mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.256 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.952) 0:00:09.577 ********* 2020-07-16T20:25:30.267 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.269 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.270 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'name': 'ml 2020-07-16T20:25:30.273 INFO:teuthology.task.ansible.out:atimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.324 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.061) 0:00:09.639 ********* 2020-07-16T20:25:30.332 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-07-16T20:25:30.380 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.060) 0:00:09.699 ********* 2020-07-16T20:25:30.424 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.045) 0:00:09.744 ********* 2020-07-16T20:25:30.432 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-07-16T20:25:30.434 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.475 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.050) 0:00:09.795 ********* 2020-07-16T20:25:30.484 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.538 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.063) 0:00:09.859 ********* 2020-07-16T20:25:30.550 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-07-16T20:25:30.552 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.596 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.057) 0:00:09.916 ********* 2020-07-16T20:25:30.611 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.659 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.063) 0:00:09.980 ********* 2020-07-16T20:25:30.669 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.719 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.059) 0:00:10.040 ********* 2020-07-16T20:25:30.729 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.784 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.056) 0:00:10.096 ********* 2020-07-16T20:25:30.790 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.830 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.054) 0:00:10.151 ********* 2020-07-16T20:25:30.849 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.884 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.053) 0:00:10.204 ********* 2020-07-16T20:25:30.894 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.931 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.047) 0:00:10.252 ********* 2020-07-16T20:25:30.946 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.984 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:30 +0000 (0:00:00.051) 0:00:10.304 ********* 2020-07-16T20:25:30.993 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-07-16T20:25:30.995 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.997 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:30.999 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.000 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.014 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.016 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.026 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.039 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.053 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.055 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.070 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.072 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.084 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.085 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.087 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.090 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.102 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.115 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.126 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.134 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.155 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.158 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.158 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.159 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.170 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.172 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.184 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.186 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.196 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.199 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.210 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.212 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.222 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.224 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.235 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.237 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.249 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.251 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.253 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.306 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:31 +0000 (0:00:00.318) 0:00:10.623 ********* 2020-07-16T20:25:31.317 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.319 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.339 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.350 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.352 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:31.399 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:31 +0000 (0:00:00.096) 0:00:10.719 ********* 2020-07-16T20:25:32.299 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "c6bfe134f92d5cc325c43b188dcccb7cdd63c6be", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-07-16T20:25:32.357 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.950) 0:00:11.669 ********* 2020-07-16T20:25:32.402 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.052) 0:00:11.722 ********* 2020-07-16T20:25:32.414 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-07-16T20:25:32.417 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => { "msg": "Host smithi022.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-07-16T20:25:32.464 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.062) 0:00:11.784 ********* 2020-07-16T20:25:32.474 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => { "msg": "Host smithi116.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-07-16T20:25:32.519 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.055) 0:00:11.839 ********* 2020-07-16T20:25:32.530 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-07-16T20:25:32.582 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.063) 0:00:11.903 ********* 2020-07-16T20:25:32.592 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-07-16T20:25:32.631 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.049) 0:00:11.952 ********* 2020-07-16T20:25:32.640 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-07-16T20:25:32.642 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:32.676 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.045) 0:00:11.997 ********* 2020-07-16T20:25:32.687 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:32.724 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:32 +0000 (0:00:00.047) 0:00:12.044 ********* 2020-07-16T20:25:33.246 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-07-16T20:25:33.249 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.335422", "end": "2020-07-16 20:25:33.224345", "rc": 0, "start": "2020-07-16 20:25:32.888923", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T20:25:33.283 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.558) 0:00:12.603 ********* 2020-07-16T20:25:33.292 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.321639", "end": "2020-07-16 20:25:33.247635", "rc": 0, "start": "2020-07-16 20:25:32.925996", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-07-16T20:25:33.334 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.047) 0:00:12.651 ********* 2020-07-16T20:25:33.350 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.381 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.050) 0:00:12.701 ********* 2020-07-16T20:25:33.390 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.430 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.049) 0:00:12.751 ********* 2020-07-16T20:25:33.444 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-07-16T20:25:33.446 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.488 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.057) 0:00:12.809 ********* 2020-07-16T20:25:33.502 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.538 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.050) 0:00:12.859 ********* 2020-07-16T20:25:33.551 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-07-16T20:25:33.553 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.593 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.054) 0:00:12.913 ********* 2020-07-16T20:25:33.616 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.650 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.057) 0:00:12.971 ********* 2020-07-16T20:25:33.661 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-07-16T20:25:33.664 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.699 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.049) 0:00:13.020 ********* 2020-07-16T20:25:33.713 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.750 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.050) 0:00:13.071 ********* 2020-07-16T20:25:33.761 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-07-16T20:25:33.763 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.807 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.056) 0:00:13.128 ********* 2020-07-16T20:25:33.817 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.854 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.046) 0:00:13.174 ********* 2020-07-16T20:25:33.864 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.914 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.053) 0:00:13.227 ********* 2020-07-16T20:25:33.916 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:33.978 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:33 +0000 (0:00:00.071) 0:00:13.299 ********* 2020-07-16T20:25:33.996 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-07-16T20:25:33.997 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:33.999 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.046 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.068) 0:00:13.367 ********* 2020-07-16T20:25:34.058 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.060 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.112 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.065) 0:00:13.433 ********* 2020-07-16T20:25:34.125 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-07-16T20:25:34.126 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.176 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.063) 0:00:13.497 ********* 2020-07-16T20:25:34.186 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.236 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.059) 0:00:13.557 ********* 2020-07-16T20:25:34.246 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-07-16T20:25:34.249 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.287 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.051) 0:00:13.608 ********* 2020-07-16T20:25:34.298 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.338 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.050) 0:00:13.658 ********* 2020-07-16T20:25:34.347 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-07-16T20:25:34.349 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.056) 0:00:13.715 ********* 2020-07-16T20:25:34.408 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.459 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.064) 0:00:13.779 ********* 2020-07-16T20:25:34.468 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.506 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.047) 0:00:13.827 ********* 2020-07-16T20:25:34.519 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.557 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.051) 0:00:13.878 ********* 2020-07-16T20:25:34.570 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-07-16T20:25:34.573 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.608 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.050) 0:00:13.929 ********* 2020-07-16T20:25:34.617 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:34.658 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.044) 0:00:13.974 ********* 2020-07-16T20:25:34.660 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-07-16T20:25:34.662 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.701 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.048) 0:00:14.022 ********* 2020-07-16T20:25:34.714 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.753 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.052) 0:00:14.074 ********* 2020-07-16T20:25:34.764 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-07-16T20:25:34.766 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.800 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.046) 0:00:14.121 ********* 2020-07-16T20:25:34.809 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.850 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.049) 0:00:14.170 ********* 2020-07-16T20:25:34.859 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-07-16T20:25:34.860 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.894 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.044) 0:00:14.215 ********* 2020-07-16T20:25:34.904 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.940 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.045) 0:00:14.260 ********* 2020-07-16T20:25:34.949 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:34.996 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:34 +0000 (0:00:00.053) 0:00:14.314 ********* 2020-07-16T20:25:35.003 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.052 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.058) 0:00:14.373 ********* 2020-07-16T20:25:35.064 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-07-16T20:25:35.066 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:35.104 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.052) 0:00:14.425 ********* 2020-07-16T20:25:35.114 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:35.153 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.048) 0:00:14.473 ********* 2020-07-16T20:25:35.309 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 16 July 2020 20:25:35 +0000 (0:00:00.050) 0:00:14.524 ********* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 16 July 2020 20:25:35 +0000 (0:00:00.058) 0:00:14.582 ********* TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 16 July 2020 20:25:35 +0000 (0:00:00.047) 0:00:14.629 ********* 2020-07-16T20:25:35.318 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.357 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.048) 0:00:14.677 ********* 2020-07-16T20:25:35.366 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-07-16T20:25:35.368 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.406 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.049) 0:00:14.727 ********* 2020-07-16T20:25:35.416 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.455 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.047) 0:00:14.775 ********* 2020-07-16T20:25:35.464 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-07-16T20:25:35.467 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.507 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.052) 0:00:14.828 ********* 2020-07-16T20:25:35.520 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.567 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.059) 0:00:14.888 ********* 2020-07-16T20:25:35.576 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-07-16T20:25:35.578 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.618 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.050) 0:00:14.939 ********* 2020-07-16T20:25:35.626 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.684 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.066) 0:00:15.005 ********* 2020-07-16T20:25:35.694 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-07-16T20:25:35.694 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.734 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.047) 0:00:15.053 ********* 2020-07-16T20:25:35.742 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.782 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.049) 0:00:15.103 ********* 2020-07-16T20:25:35.793 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-07-16T20:25:35.795 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:35.840 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.057) 0:00:15.161 ********* 2020-07-16T20:25:35.850 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-07-16T20:25:35.894 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.054) 0:00:15.215 ********* 2020-07-16T20:25:35.904 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-07-16T20:25:35.906 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.943 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.048) 0:00:15.264 ********* 2020-07-16T20:25:35.952 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:35.992 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:35 +0000 (0:00:00.049) 0:00:15.313 ********* 2020-07-16T20:25:36.000 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-07-16T20:25:36.004 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:36.040 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:36 +0000 (0:00:00.047) 0:00:15.361 ********* 2020-07-16T20:25:36.057 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:36.100 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:36 +0000 (0:00:00.058) 0:00:15.420 ********* 2020-07-16T20:25:36.293 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-07-16T20:25:36.295 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:36.330 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:36 +0000 (0:00:00.231) 0:00:15.651 ********* 2020-07-16T20:25:36.338 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:36.393 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:36 +0000 (0:00:00.062) 0:00:15.714 ********* 2020-07-16T20:25:36.923 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-07-16T20:25:36.928 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T20:25:36.968 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-07-16T20:25:37.448 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T20:25:37.497 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:37 +0000 (0:00:01.103) 0:00:16.817 ********* 2020-07-16T20:25:37.511 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-07-16T20:25:37.578 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:37 +0000 (0:00:00.081) 0:00:16.899 ********* 2020-07-16T20:25:38.090 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi116.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T20:25:38.196 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-07-16T20:25:38.633 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T20:25:38.683 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:01.104) 0:00:18.003 ********* 2020-07-16T20:25:38.738 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T20:25:38.740 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:38.775 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:00.092) 0:00:18.096 ********* 2020-07-16T20:25:38.789 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-07-16T20:25:38.791 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-07-16T20:25:38.839 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:00.063) 0:00:18.159 ********* 2020-07-16T20:25:38.849 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:25:38.851 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:38.891 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:00.052) 0:00:18.212 ********* 2020-07-16T20:25:38.902 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-07-16T20:25:38.904 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:38.943 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:00.051) 0:00:18.264 ********* 2020-07-16T20:25:38.958 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-16T20:25:38.960 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.000 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:38 +0000 (0:00:00.056) 0:00:18.320 ********* 2020-07-16T20:25:39.011 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:25:39.013 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.050 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.050) 0:00:18.371 ********* 2020-07-16T20:25:39.063 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-07-16T20:25:39.065 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.101 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.050) 0:00:18.422 ********* 2020-07-16T20:25:39.124 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-07-16T20:25:39.125 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.161 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.058) 0:00:18.481 ********* 2020-07-16T20:25:39.172 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:25:39.173 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.215 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.054) 0:00:18.535 ********* 2020-07-16T20:25:39.232 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.284 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.069) 0:00:18.605 ********* 2020-07-16T20:25:39.301 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.345 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.060) 0:00:18.665 ********* 2020-07-16T20:25:39.360 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-07-16T20:25:39.362 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.403 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.058) 0:00:18.724 ********* 2020-07-16T20:25:39.415 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-07-16T20:25:39.417 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.462 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.050) 0:00:18.776 ********* 2020-07-16T20:25:39.466 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-07-16T20:25:39.468 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.508 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.052) 0:00:18.829 ********* 2020-07-16T20:25:39.532 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-07-16T20:25:39.534 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.598 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.087) 0:00:18.916 ********* 2020-07-16T20:25:39.605 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-07-16T20:25:39.607 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.662 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.067) 0:00:18.983 ********* 2020-07-16T20:25:39.680 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.713 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.050) 0:00:19.034 ********* 2020-07-16T20:25:39.724 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-07-16T20:25:39.731 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.763 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.049) 0:00:19.083 ********* 2020-07-16T20:25:39.812 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:39.850 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:39 +0000 (0:00:00.087) 0:00:19.171 ********* 2020-07-16T20:25:40.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-07-16T20:25:40.524 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.594510", "end": "2020-07-16 20:25:40.500362", "rc": 0, "start": "2020-07-16 20:25:39.905852", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:25:40.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:40 +0000 (0:00:00.734) 0:00:19.906 ********* 2020-07-16T20:25:40.595 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.445814", "end": "2020-07-16 20:25:40.500344", "rc": 0, "start": "2020-07-16 20:25:40.054530", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:25:40.633 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:40 +0000 (0:00:00.048) 0:00:19.954 ********* 2020-07-16T20:25:42.753 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-07-16T20:25:42.755 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T20:25:42.821 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:42 +0000 (0:00:02.187) 0:00:22.141 ********* 2020-07-16T20:25:42.836 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-07-16T20:25:42.889 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:42 +0000 (0:00:00.068) 0:00:22.210 ********* 2020-07-16T20:25:42.899 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:42.938 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:42 +0000 (0:00:00.049) 0:00:22.259 ********* 2020-07-16T20:25:42.949 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:42.994 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:42 +0000 (0:00:00.056) 0:00:22.315 ********* 2020-07-16T20:25:43.014 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-07-16T20:25:43.016 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.057 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.062) 0:00:22.378 ********* 2020-07-16T20:25:43.067 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.110 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.052) 0:00:22.430 ********* 2020-07-16T20:25:43.121 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-07-16T20:25:43.123 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.176 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.066) 0:00:22.497 ********* 2020-07-16T20:25:43.185 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.231 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.055) 0:00:22.552 ********* 2020-07-16T20:25:43.243 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-07-16T20:25:43.244 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.299 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.067) 0:00:22.620 ********* 2020-07-16T20:25:43.309 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:43.355 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.056) 0:00:22.676 ********* 2020-07-16T20:25:43.846 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-07-16T20:25:43.849 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T20:25:43.898 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:43 +0000 (0:00:00.543) 0:00:23.219 ********* 2020-07-16T20:25:43.970 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-07-16T20:25:44.011 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.112) 0:00:23.332 ********* 2020-07-16T20:25:44.826 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-07-16T20:25:44.828 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T20:25:44.869 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:44 +0000 (0:00:00.858) 0:00:24.190 ********* 2020-07-16T20:25:44.994 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-07-16T20:25:45.058 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:45 +0000 (0:00:00.188) 0:00:24.379 ********* 2020-07-16T20:25:45.067 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:45.466 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi116.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T20:25:45.651 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-07-16T20:25:45.982 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T20:25:46.251 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-07-16T20:25:46.559 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T20:25:46.638 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:46 +0000 (0:00:01.579) 0:00:25.959 ********* 2020-07-16T20:25:46.786 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-07-16T20:25:46.837 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:46 +0000 (0:00:00.198) 0:00:26.158 ********* 2020-07-16T20:25:46.882 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:25:46.930 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:46 +0000 (0:00:00.093) 0:00:26.251 ********* 2020-07-16T20:25:47.058 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:25:47.099 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:47 +0000 (0:00:00.168) 0:00:26.419 ********* 2020-07-16T20:25:47.484 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T20:25:47.486 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T20:25:47.669 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-07-16T20:25:47.978 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T20:25:48.220 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-07-16T20:25:48.575 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T20:25:48.629 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:48 +0000 (0:00:01.529) 0:00:27.949 ********* 2020-07-16T20:25:48.687 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T20:25:48.689 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:48.749 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:48 +0000 (0:00:00.116) 0:00:28.066 ********* 2020-07-16T20:25:48.810 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T20:25:48.813 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T20:25:48.853 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:48 +0000 (0:00:00.108) 0:00:28.174 ********* 2020-07-16T20:25:48.863 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-07-16T20:25:48.865 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-07-16T20:25:48.921 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:48 +0000 (0:00:00.068) 0:00:28.242 ********* 2020-07-16T20:25:48.973 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-07-16T20:25:48.975 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.012 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.091) 0:00:28.333 ********* 2020-07-16T20:25:49.065 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-16T20:25:49.067 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T20:25:49.105 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.092) 0:00:28.425 ********* 2020-07-16T20:25:49.114 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-07-16T20:25:49.116 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-07-16T20:25:49.162 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.057) 0:00:28.483 ********* 2020-07-16T20:25:49.185 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi116.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.197 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.208 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:49.266 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:49 +0000 (0:00:00.102) 0:00:28.586 ********* 2020-07-16T20:25:50.195 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-07-16T20:25:50.198 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-07-16T20:25:50.257 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.992) 0:00:29.578 ********* 2020-07-16T20:25:50.302 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T20:25:50.304 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.354 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.096) 0:00:29.674 ********* 2020-07-16T20:25:50.416 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-07-16T20:25:50.418 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-07-16T20:25:50.482 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.123) 0:00:29.798 ********* 2020-07-16T20:25:50.546 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-07-16T20:25:50.548 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.569 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.601 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.614 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:50.668 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:50 +0000 (0:00:00.189) 0:00:29.988 ********* 2020-07-16T20:25:50.981 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T20:25:51.051 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.383) 0:00:30.372 ********* 2020-07-16T20:25:51.611 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-07-16T20:25:51.613 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T20:25:51.652 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.600) 0:00:30.972 ********* 2020-07-16T20:25:51.714 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-07-16T20:25:51.768 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.115) 0:00:31.088 ********* 2020-07-16T20:25:51.782 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T20:25:51.784 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.847 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.079) 0:00:31.168 ********* 2020-07-16T20:25:51.857 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-07-16T20:25:51.859 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:51.905 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:51 +0000 (0:00:00.057) 0:00:31.225 ********* 2020-07-16T20:25:52.064 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T20:25:52.066 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:52.118 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.212) 0:00:31.439 ********* 2020-07-16T20:25:52.399 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi116.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T20:25:52.469 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.351) 0:00:31.790 ********* 2020-07-16T20:25:52.491 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-07-16T20:25:52.493 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-07-16T20:25:52.548 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.079) 0:00:31.869 ********* 2020-07-16T20:25:52.551 INFO:teuthology.task.ansible.out: 2020-07-16T20:25:52.564 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T20:25:52.566 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:52.643 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:52 +0000 (0:00:00.094) 0:00:31.964 ********* 2020-07-16T20:25:53.142 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-07-16T20:25:53.206 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.553) 0:00:32.517 ********* 2020-07-16T20:25:53.250 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-16T20:25:53.252 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-07-16T20:25:53.319 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.121) 0:00:32.639 ********* 2020-07-16T20:25:53.331 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-07-16T20:25:53.333 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-07-16T20:25:53.378 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.059) 0:00:32.698 ********* 2020-07-16T20:25:53.688 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-07-16T20:25:53.690 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:25:53.751 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:53 +0000 (0:00:00.373) 0:00:33.072 ********* 2020-07-16T20:25:54.034 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-07-16T20:25:54.036 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-07-16T20:25:54.092 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.341) 0:00:33.413 ********* 2020-07-16T20:25:54.147 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-07-16T20:25:54.149 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:25:54.187 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.094) 0:00:33.507 ********* 2020-07-16T20:25:54.263 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-07-16T20:25:54.266 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:17 UTC", "ActiveEnterTimestampMonotonic": "15666325", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target sysinit.target tmp.mount network.target systemd-journald.socket -.mount systemd-tmpfiles-setup.service basic.target time-sync.target nss-lookup.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:17 UTC", "AssertTimestampMonotonic": "15665289", "Before": "shutdown.target getty@tty1.service xdm.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:17 UTC", "ConditionTimestampMonotonic": "15665289", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-07-16T20:25:54.268 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2499", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:17 UTC", "ExecMainStartTimestampMonotonic": "15666298", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:17 UTC] ; stop_time=[n/a] ; pid=2499 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:17 UTC", "InactiveExitTimestampMonotonic": "15666325", "InvocationID": "6f13804ba11448b8a30530cc5f83c841", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-07-16T20:25:54.270 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2499", "MemoryAccounting": "yes", "MemoryCurrent": "1216512", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-07-16T20:25:54.272 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:17 UTC", "StateChangeTimestampMonotonic": "15666325", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:17 UTC", "WatchdogTimestampMonotonic": "15666324", "WatchdogUSec": "0"}} 2020-07-16T20:25:54.305 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.118) 0:00:33.626 ********* 2020-07-16T20:25:54.520 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-07-16T20:25:54.522 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001715", "end": "2020-07-16 20:25:54.490017", "rc": 0, "start": "2020-07-16 20:25:54.488302", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T20:25:54.577 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.271) 0:00:33.898 ********* 2020-07-16T20:25:54.752 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-07-16T20:25:54.753 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-07-16T20:25:54.801 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:54 +0000 (0:00:00.224) 0:00:34.122 ********* 2020-07-16T20:25:55.151 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-07-16T20:25:55.152 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:14 UTC", "ActiveEnterTimestampMonotonic": "19015211", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount network.target systemd-tmpfiles-setup.service sysinit.target local-fs.target system.slice nss-lookup.target time-sync.target var-run.mount systemd-journald.socket -.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:14 UTC", "AssertTimestampMonotonic": "19014410", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:14 UTC", "ConditionTimestampMonotonic": "19014410", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-07-16T20:25:55.154 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2487", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:14 UTC", "ExecMainStartTimestampMonotonic": "19015178", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:14 UTC] ; stop_time=[n/a] ; pid=2487 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:14 UTC", "InactiveExitTimestampMonotonic": "19015211", "InvocationID": "a2c6afa4192848338eb3dd999da8f199", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-07-16T20:25:55.155 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2487", "MemoryAccounting": "yes", "MemoryCurrent": "1167360", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-07-16T20:25:55.157 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:14 UTC", "StateChangeTimestampMonotonic": "19015211", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:14 UTC", "WatchdogTimestampMonotonic": "19015210", "WatchdogUSec": "0"}} 2020-07-16T20:25:55.200 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.399) 0:00:34.521 ********* 2020-07-16T20:25:55.419 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001687", "end": "2020-07-16 20:25:55.390419", "rc": 0, "start": "2020-07-16 20:25:55.388732", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-07-16T20:25:55.467 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.266) 0:00:34.788 ********* 2020-07-16T20:25:55.523 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-07-16T20:25:55.525 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T20:25:55.578 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:55 +0000 (0:00:00.110) 0:00:34.898 ********* 2020-07-16T20:25:56.484 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-07-16T20:25:56.549 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.966) 0:00:35.865 ********* 2020-07-16T20:25:56.554 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-07-16T20:25:56.556 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-07-16T20:25:56.608 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:56 +0000 (0:00:00.064) 0:00:35.929 ********* 2020-07-16T20:25:57.532 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-07-16T20:25:57.574 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:57 +0000 (0:00:00.966) 0:00:36.895 ********* 2020-07-16T20:25:58.202 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-07-16T20:25:58.204 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T20:25:58.264 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:58 +0000 (0:00:00.690) 0:00:37.585 ********* 2020-07-16T20:25:58.666 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-07-16T20:25:58.708 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:25:58 +0000 (0:00:00.442) 0:00:38.028 ********* 2020-07-16T20:26:14.994 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-07-16T20:26:14.997 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.491897", "end": "2020-07-16 20:26:14.957414", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:58.465517", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T20:26:15.051 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:16.342) 0:00:54.371 ********* 2020-07-16T20:26:15.577 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-16T20:26:15.578 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-07-16T20:26:15.611 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.560) 0:00:54.932 ********* 2020-07-16T20:26:15.832 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-07-16T20:26:15.834 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011369", "end": "2020-07-16 20:26:15.805112", "rc": 0, "start": "2020-07-16 20:26:15.793743", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:15.869 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.257) 0:00:55.190 ********* 2020-07-16T20:26:15.932 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-07-16T20:26:15.934 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.986473", "end": "2020-07-16 20:26:15.887897", "failed_when_result": false, "rc": 0, "start": "2020-07-16 20:25:58.901424", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-07-16T20:26:15.969 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:15 +0000 (0:00:00.099) 0:00:55.290 ********* 2020-07-16T20:26:16.098 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-07-16T20:26:16.100 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014037", "end": "2020-07-16 20:26:16.065948", "rc": 0, "start": "2020-07-16 20:26:16.051911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:16.163 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:16 +0000 (0:00:00.190) 0:00:55.480 ********* 2020-07-16T20:26:16.545 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-07-16T20:26:16.547 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-07-16T20:26:16.587 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:16 +0000 (0:00:00.427) 0:00:55.907 ********* 2020-07-16T20:26:16.821 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-07-16T20:26:16.823 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011481", "end": "2020-07-16 20:26:16.798749", "rc": 0, "start": "2020-07-16 20:26:16.787268", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:16.861 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:16 +0000 (0:00:00.274) 0:00:56.181 ********* 2020-07-16T20:26:17.095 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-07-16T20:26:17.097 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014170", "end": "2020-07-16 20:26:17.073898", "rc": 0, "start": "2020-07-16 20:26:17.059728", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:17.163 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:17 +0000 (0:00:00.302) 0:00:56.484 ********* 2020-07-16T20:26:32.758 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.364218", "end": "2020-07-16 20:26:32.726222", "rc": 0, "start": "2020-07-16 20:26:16.362004", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:32.805 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:32 +0000 (0:00:15.642) 0:01:12.126 ********* 2020-07-16T20:26:33.035 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T20:26:33.073 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.267) 0:01:12.393 ********* 2020-07-16T20:26:33.130 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T20:26:33.168 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.095) 0:01:12.489 ********* 2020-07-16T20:26:33.233 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi116.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:33.267 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.099) 0:01:12.588 ********* 2020-07-16T20:26:33.345 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T20:26:33.346 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-07-16T20:26:33.393 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.125) 0:01:12.714 ********* 2020-07-16T20:26:33.450 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi116.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:33.491 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.097) 0:01:12.811 ********* 2020-07-16T20:26:33.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:26:33.762 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:33 +0000 (0:00:00.267) 0:01:13.079 ********* 2020-07-16T20:26:33.989 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-07-16T20:26:33.990 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T20:26:34.036 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.276) 0:01:13.355 ********* 2020-07-16T20:26:34.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-07-16T20:26:34.080 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:34.132 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.097) 0:01:13.453 ********* 2020-07-16T20:26:34.165 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-16T20:26:34.167 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:34.211 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.078) 0:01:13.531 ********* 2020-07-16T20:26:34.307 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-07-16T20:26:34.309 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.893573", "end": "2020-07-16 20:26:34.275162", "rc": 0, "start": "2020-07-16 20:26:17.381589", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:34.363 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.152) 0:01:13.683 ********* 2020-07-16T20:26:34.467 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi116.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-07-16T20:26:34.510 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.146) 0:01:13.830 ********* 2020-07-16T20:26:34.660 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-07-16T20:26:34.662 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-07-16T20:26:34.714 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.201) 0:01:14.032 ********* 2020-07-16T20:26:34.753 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-07-16T20:26:34.755 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-07-16T20:26:34.807 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.095) 0:01:14.127 ********* 2020-07-16T20:26:34.868 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-07-16T20:26:34.871 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:34.919 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:34 +0000 (0:00:00.112) 0:01:14.240 ********* 2020-07-16T20:26:34.986 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-07-16T20:26:34.988 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-07-16T20:26:35.029 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.109) 0:01:14.349 ********* 2020-07-16T20:26:35.124 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-07-16T20:26:35.126 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-07-16T20:26:35.203 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.174) 0:01:14.524 ********* 2020-07-16T20:26:35.213 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-16T20:26:35.215 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T20:26:35.273 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.067) 0:01:14.592 ********* 2020-07-16T20:26:35.330 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi116"}, "changed": false} 2020-07-16T20:26:35.362 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.091) 0:01:14.683 ********* 2020-07-16T20:26:35.438 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-07-16T20:26:35.446 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-07-16T20:26:35.484 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.110) 0:01:14.793 ********* 2020-07-16T20:26:35.714 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "name": "ubuntu", "state": "present", "system": false} 2020-07-16T20:26:35.765 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.292) 0:01:15.086 ********* 2020-07-16T20:26:35.797 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-07-16T20:26:35.798 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:35.834 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.069) 0:01:15.155 ********* 2020-07-16T20:26:35.877 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-07-16T20:26:35.879 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:35.920 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:35 +0000 (0:00:00.085) 0:01:15.240 ********* 2020-07-16T20:26:36.188 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-07-16T20:26:36.190 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-07-16T20:26:36.255 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.335) 0:01:15.575 ********* 2020-07-16T20:26:36.548 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-07-16T20:26:36.550 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi116", "ansible_hostname": "smithi116", "ansible_nodename": "smithi116"}, "changed": false, "name": "smithi116"} 2020-07-16T20:26:36.610 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.351) 0:01:15.927 ********* 2020-07-16T20:26:36.929 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-07-16T20:26:36.931 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-07-16T20:26:36.978 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:36 +0000 (0:00:00.362) 0:01:16.290 ********* 2020-07-16T20:26:37.025 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi022"}, "changed": false} 2020-07-16T20:26:37.065 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:37 +0000 (0:00:00.095) 0:01:16.385 ********* 2020-07-16T20:26:37.145 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-07-16T20:26:37.147 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T20:26:37.196 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:37 +0000 (0:00:00.131) 0:01:16.516 ********* 2020-07-16T20:26:37.737 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi022", "ansible_hostname": "smithi022", "ansible_nodename": "smithi022"}, "changed": false, "name": "smithi022"} 2020-07-16T20:26:37.778 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:37 +0000 (0:00:00.582) 0:01:17.099 ********* 2020-07-16T20:26:37.788 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-07-16T20:26:37.790 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T20:26:37.832 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:37 +0000 (0:00:00.053) 0:01:17.153 ********* 2020-07-16T20:26:38.356 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-07-16T20:26:38.417 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:38 +0000 (0:00:00.584) 0:01:17.737 ********* 2020-07-16T20:26:38.489 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-07-16T20:26:38.491 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T20:26:38.537 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:38 +0000 (0:00:00.119) 0:01:17.857 ********* 2020-07-16T20:26:39.007 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-07-16T20:26:39.009 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-07-16T20:26:39.053 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.516) 0:01:18.374 ********* 2020-07-16T20:26:39.087 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-07-16T20:26:39.089 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T20:26:39.146 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.092) 0:01:18.466 ********* 2020-07-16T20:26:39.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:26:39.388 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:26:39.426 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.280) 0:01:18.746 ********* 2020-07-16T20:26:39.646 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:26:39.648 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-07-16T20:26:39.694 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.263) 0:01:19.009 ********* 2020-07-16T20:26:39.711 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-07-16T20:26:39.713 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-07-16T20:26:39.754 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.065) 0:01:19.075 ********* 2020-07-16T20:26:39.947 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:26:39.949 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1224, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T20:26:39.986 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:39 +0000 (0:00:00.231) 0:01:19.306 ********* 2020-07-16T20:26:40.386 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-07-16T20:26:40.388 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-07-16T20:26:40.432 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:40 +0000 (0:00:00.446) 0:01:19.753 ********* 2020-07-16T20:26:40.523 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:26:40.525 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T20:26:40.560 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:40 +0000 (0:00:00.128) 0:01:19.881 ********* 2020-07-16T20:26:40.706 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:26:40.708 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:26:40.743 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:40 +0000 (0:00:00.182) 0:01:20.064 ********* 2020-07-16T20:26:41.003 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:26:41.008 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-07-16T20:26:41.047 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:41 +0000 (0:00:00.303) 0:01:20.368 ********* 2020-07-16T20:26:41.122 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:26:41.124 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T20:26:41.184 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:41 +0000 (0:00:00.136) 0:01:20.504 ********* 2020-07-16T20:26:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:26:41.307 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1224, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-07-16T20:26:41.358 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:41 +0000 (0:00:00.167) 0:01:20.672 ********* 2020-07-16T20:26:41.894 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:26:41.895 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-07-16T20:26:41.946 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:41 +0000 (0:00:00.594) 0:01:21.267 ********* 2020-07-16T20:26:42.524 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:26:42.526 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-07-16T20:26:42.575 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:42 +0000 (0:00:00.628) 0:01:21.895 ********* 2020-07-16T20:26:43.098 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:26:43.100 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.705975", "end": "2020-07-16 20:26:43.069989", "rc": 0, "start": "2020-07-16 20:26:41.364014", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:43.140 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:43 +0000 (0:00:00.565) 0:01:22.460 ********* 2020-07-16T20:26:43.698 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:26:43.700 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-07-16T20:26:44.195 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-07-16T20:26:44.432 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:26:44.433 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.635427", "end": "2020-07-16 20:26:44.403824", "rc": 0, "start": "2020-07-16 20:26:42.768397", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:26:44.479 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:44 +0000 (0:00:01.339) 0:01:23.800 ********* 2020-07-16T20:26:44.686 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:26:44.689 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-07-16T20:26:44.746 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:44 +0000 (0:00:00.266) 0:01:24.066 ********* 2020-07-16T20:26:45.137 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-07-16T20:26:45.352 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-16T20:26:45.354 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T20:26:45.390 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:45 +0000 (0:00:00.643) 0:01:24.710 ********* 2020-07-16T20:26:45.690 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:26:45.692 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-07-16T20:26:45.960 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-07-16T20:26:46.241 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-07-16T20:26:46.243 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-07-16T20:26:46.293 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:46 +0000 (0:00:00.902) 0:01:25.613 ********* 2020-07-16T20:26:46.490 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:26:46.492 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-07-16T20:26:46.895 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-07-16T20:26:46.897 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-07-16T20:26:46.936 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:46 +0000 (0:00:00.643) 0:01:26.257 ********* 2020-07-16T20:26:47.029 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:26:47.031 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-07-16T20:26:47.108 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.172) 0:01:26.429 ********* 2020-07-16T20:26:47.208 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T20:26:47.246 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.138) 0:01:26.567 ********* 2020-07-16T20:26:47.290 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-07-16T20:26:47.292 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.348 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.101) 0:01:26.668 ********* 2020-07-16T20:26:47.405 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-16T20:26:47.407 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.417 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.466 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.117) 0:01:26.786 ********* 2020-07-16T20:26:47.545 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-07-16T20:26:47.547 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.590 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.123) 0:01:26.910 ********* 2020-07-16T20:26:47.624 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:26:47.627 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-07-16T20:26:47.649 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:26:47.651 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-07-16T20:26:47.700 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.110) 0:01:27.021 ********* 2020-07-16T20:26:47.758 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-16T20:26:47.760 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.795 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.095) 0:01:27.116 ********* 2020-07-16T20:26:47.836 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T20:26:47.838 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:47.874 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:47 +0000 (0:00:00.078) 0:01:27.194 ********* 2020-07-16T20:26:48.117 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-16T20:26:48.119 INFO:teuthology.task.ansible.out:fatal: [smithi116.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006912", "end": "2020-07-16 20:26:48.091715", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:26:48.084803", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-07-16T20:26:48.154 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:48 +0000 (0:00:00.280) 0:01:27.474 ********* 2020-07-16T20:26:48.178 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:26:48.180 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-07-16T20:26:48.202 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-07-16T20:26:48.204 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:48.254 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:48 +0000 (0:00:00.091) 0:01:27.566 ********* 2020-07-16T20:26:48.713 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-07-16T20:26:48.716 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-07-16T20:26:48.781 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:48 +0000 (0:00:00.535) 0:01:28.101 ********* 2020-07-16T20:26:48.819 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-07-16T20:26:48.865 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:48 +0000 (0:00:00.084) 0:01:28.186 ********* 2020-07-16T20:26:48.911 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:48.964 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:48 +0000 (0:00:00.098) 0:01:28.285 ********* 2020-07-16T20:26:49.036 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-07-16T20:26:49.038 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.040 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.099 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.135) 0:01:28.420 ********* 2020-07-16T20:26:49.155 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.206 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.106) 0:01:28.527 ********* 2020-07-16T20:26:49.269 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:26:49.272 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-07-16T20:26:49.326 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.118) 0:01:28.646 ********* 2020-07-16T20:26:49.380 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-07-16T20:26:49.382 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.432 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.106) 0:01:28.753 ********* 2020-07-16T20:26:49.485 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-07-16T20:26:49.487 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.541 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.108) 0:01:28.862 ********* 2020-07-16T20:26:49.797 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-07-16T20:26:49.798 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007232", "end": "2020-07-16 20:26:49.767003", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:26:49.759771", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-07-16T20:26:49.836 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.294) 0:01:29.156 ********* 2020-07-16T20:26:49.896 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:49.942 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:49 +0000 (0:00:00.106) 0:01:29.263 ********* 2020-07-16T20:26:50.527 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T20:26:50.529 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T20:26:50.573 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:50 +0000 (0:00:00.630) 0:01:29.893 ********* 2020-07-16T20:26:52.504 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:26:52.506 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-07-16T20:26:52.555 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:52 +0000 (0:00:01.982) 0:01:31.876 ********* 2020-07-16T20:26:52.565 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T20:26:52.567 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-07-16T20:26:52.631 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:52 +0000 (0:00:00.075) 0:01:31.951 ********* 2020-07-16T20:26:54.670 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:26:54.672 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-07-16T20:26:54.705 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:54 +0000 (0:00:02.074) 0:01:34.026 ********* 2020-07-16T20:26:55.626 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:26:55.628 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-07-16T20:26:55.671 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.966) 0:01:34.992 ********* 2020-07-16T20:26:55.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-16T20:26:55.722 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:55.762 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:55 +0000 (0:00:00.091) 0:01:35.083 ********* 2020-07-16T20:26:56.729 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:26:56.731 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-07-16T20:26:56.790 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:56 +0000 (0:00:01.027) 0:01:36.110 ********* 2020-07-16T20:26:56.830 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:56.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:56 +0000 (0:00:00.094) 0:01:36.205 ********* 2020-07-16T20:26:57.213 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-07-16T20:26:57.214 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice sysinit.target dbus.service dbus.socket polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service shutdown.target iptables.service ip6tables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-07-16T20:26:57.216 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", 2020-07-16T20:26:57.218 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target dbus.socket system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-07-16T20:26:57.219 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T20:26:57.256 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.371) 0:01:36.577 ********* 2020-07-16T20:26:57.563 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi116.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-07-16T20:26:57.609 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.353) 0:01:36.930 ********* 2020-07-16T20:26:57.856 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:26:57.858 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-07-16T20:26:57.915 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:57 +0000 (0:00:00.306) 0:01:37.236 ********* 2020-07-16T20:26:57.964 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-07-16T20:26:57.966 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.014 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.096) 0:01:37.332 ********* 2020-07-16T20:26:58.504 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T20:26:58.544 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.531) 0:01:37.864 ********* 2020-07-16T20:26:58.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-16T20:26:58.576 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.636 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.091) 0:01:37.956 ********* 2020-07-16T20:26:58.680 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-07-16T20:26:58.681 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.730 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.093) 0:01:38.050 ********* 2020-07-16T20:26:58.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-16T20:26:58.762 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.798 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.068) 0:01:38.118 ********* 2020-07-16T20:26:58.831 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.868 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.069) 0:01:38.188 ********* 2020-07-16T20:26:58.919 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:58.966 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:58 +0000 (0:00:00.099) 0:01:38.287 ********* 2020-07-16T20:26:59.014 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.050 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.083) 0:01:38.371 ********* 2020-07-16T20:26:59.076 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-07-16T20:26:59.129 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.078) 0:01:38.449 ********* 2020-07-16T20:26:59.139 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-16T20:26:59.186 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.056) 0:01:38.506 ********* 2020-07-16T20:26:59.188 INFO:teuthology.task.ansible.out: 2020-07-16T20:26:59.195 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:26:59.197 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.234 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.048) 0:01:38.555 ********* 2020-07-16T20:26:59.244 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-07-16T20:26:59.246 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.282 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.048) 0:01:38.603 ********* 2020-07-16T20:26:59.323 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-16T20:26:59.325 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.368 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.085) 0:01:38.688 ********* 2020-07-16T20:26:59.429 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-16T20:26:59.431 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.487 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.119) 0:01:38.808 ********* 2020-07-16T20:26:59.534 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.572 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.085) 0:01:38.893 ********* 2020-07-16T20:26:59.584 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-07-16T20:26:59.585 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket sysinit.target system.slice dbus.service basic.target polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ipset.service shutdown.target ip6tables.service iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-07-16T20:26:59.587 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", 2020-07-16T20:26:59.589 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-07-16T20:26:59.591 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-07-16T20:26:59.623 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.050) 0:01:38.944 ********* 2020-07-16T20:26:59.634 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-16T20:26:59.673 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.049) 0:01:38.994 ********* 2020-07-16T20:26:59.718 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-16T20:26:59.721 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.774 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.100) 0:01:39.095 ********* 2020-07-16T20:26:59.818 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.854 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.080) 0:01:39.175 ********* 2020-07-16T20:26:59.909 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-07-16T20:26:59.911 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:26:59.952 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:26:59 +0000 (0:00:00.097) 0:01:39.272 ********* 2020-07-16T20:26:59.982 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-07-16T20:26:59.984 INFO:teuthology.task.ansible.out:fatal: [smithi022.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-07-16T20:27:00.032 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.080) 0:01:39.353 ********* 2020-07-16T20:27:00.043 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:00.045 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.098 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.066) 0:01:39.419 ********* 2020-07-16T20:27:00.155 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-16T20:27:00.157 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.205 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.106) 0:01:39.525 ********* 2020-07-16T20:27:00.236 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:00.238 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.080) 0:01:39.606 ********* 2020-07-16T20:27:00.316 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-16T20:27:00.318 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.370 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.082) 0:01:39.689 ********* 2020-07-16T20:27:00.378 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-07-16T20:27:00.380 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-07-16T20:27:00.437 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.068) 0:01:39.757 ********* 2020-07-16T20:27:00.447 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-16T20:27:00.449 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.492 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.055) 0:01:39.812 ********* 2020-07-16T20:27:00.501 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-07-16T20:27:00.503 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.555 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.063) 0:01:39.876 ********* 2020-07-16T20:27:00.565 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-16T20:27:00.567 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.609 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.053) 0:01:39.930 ********* 2020-07-16T20:27:00.619 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.656 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.047) 0:01:39.977 ********* 2020-07-16T20:27:00.665 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-07-16T20:27:00.667 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.717 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.060) 0:01:40.038 ********* 2020-07-16T20:27:00.729 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-07-16T20:27:00.730 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.767 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.050) 0:01:40.088 ********* 2020-07-16T20:27:00.779 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-07-16T20:27:00.781 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.822 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.054) 0:01:40.142 ********* 2020-07-16T20:27:00.831 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-07-16T20:27:00.834 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.876 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.054) 0:01:40.197 ********* 2020-07-16T20:27:00.887 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-16T20:27:00.889 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.941 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.065) 0:01:40.262 ********* 2020-07-16T20:27:00.952 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-07-16T20:27:00.954 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:00.994 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:00 +0000 (0:00:00.052) 0:01:40.315 ********* 2020-07-16T20:27:01.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-07-16T20:27:01.013 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.058 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.063) 0:01:40.379 ********* 2020-07-16T20:27:01.072 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-07-16T20:27:01.073 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.125 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.066) 0:01:40.445 ********* 2020-07-16T20:27:01.137 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-16T20:27:01.138 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.177 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.052) 0:01:40.497 ********* 2020-07-16T20:27:01.189 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-07-16T20:27:01.230 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.052) 0:01:40.550 ********* 2020-07-16T20:27:01.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.292 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.062) 0:01:40.613 ********* 2020-07-16T20:27:01.302 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-07-16T20:27:01.305 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.462 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.169) 0:01:40.782 ********* 2020-07-16T20:27:01.471 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:27:01.473 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.517 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.055) 0:01:40.838 ********* 2020-07-16T20:27:01.531 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-07-16T20:27:01.538 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.572 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.055) 0:01:40.893 ********* 2020-07-16T20:27:01.582 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:27:01.584 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.635 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.062) 0:01:40.955 ********* 2020-07-16T20:27:01.643 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-07-16T20:27:01.646 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.687 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.052) 0:01:41.008 ********* 2020-07-16T20:27:01.697 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:27:01.699 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.744 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.055) 0:01:41.063 ********* 2020-07-16T20:27:01.752 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-07-16T20:27:01.755 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.808 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.065) 0:01:41.129 ********* 2020-07-16T20:27:01.818 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:27:01.820 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.867 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.058) 0:01:41.187 ********* 2020-07-16T20:27:01.879 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-07-16T20:27:01.933 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.066) 0:01:41.253 ********* 2020-07-16T20:27:01.945 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:27:01.947 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:01.983 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:01 +0000 (0:00:00.050) 0:01:41.304 ********* 2020-07-16T20:27:01.996 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-07-16T20:27:01.997 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.035 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.051) 0:01:41.355 ********* 2020-07-16T20:27:02.045 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T20:27:02.047 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.082 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.046) 0:01:41.402 ********* 2020-07-16T20:27:02.091 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-07-16T20:27:02.093 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.134 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.052) 0:01:41.455 ********* 2020-07-16T20:27:02.147 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.182 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.048) 0:01:41.503 ********* 2020-07-16T20:27:02.192 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-07-16T20:27:02.193 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.248 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.065) 0:01:41.569 ********* 2020-07-16T20:27:02.258 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:02.260 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.295 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.046) 0:01:41.616 ********* 2020-07-16T20:27:02.304 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.358 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.062) 0:01:41.678 ********* 2020-07-16T20:27:02.370 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.416 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.058) 0:01:41.737 ********* 2020-07-16T20:27:02.425 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-07-16T20:27:02.427 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.477 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.060) 0:01:41.798 ********* 2020-07-16T20:27:02.489 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:02.494 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.529 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.051) 0:01:41.849 ********* 2020-07-16T20:27:02.537 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:02.539 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.578 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.047) 0:01:41.897 ********* 2020-07-16T20:27:02.587 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:02.589 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.634 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.057) 0:01:41.954 ********* 2020-07-16T20:27:02.656 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-07-16T20:27:02.658 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.703 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.069) 0:01:42.023 ********* 2020-07-16T20:27:02.713 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:02.716 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.762 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.059) 0:01:42.083 ********* 2020-07-16T20:27:02.773 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-07-16T20:27:02.775 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.824 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.061) 0:01:42.144 ********* 2020-07-16T20:27:02.876 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-07-16T20:27:02.878 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.915 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.091) 0:01:42.236 ********* 2020-07-16T20:27:02.949 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:02.985 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:02 +0000 (0:00:00.069) 0:01:42.306 ********* 2020-07-16T20:27:03.016 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:03.018 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-07-16T20:27:03.078 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.080) 0:01:42.387 ********* TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.118 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.051) 0:01:42.438 ********* 2020-07-16T20:27:03.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-07-16T20:27:03.164 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.201 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.081) 0:01:42.520 ********* 2020-07-16T20:27:03.241 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.292 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.091) 0:01:42.612 ********* 2020-07-16T20:27:03.312 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:03.315 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:03.350 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.058) 0:01:42.670 ********* 2020-07-16T20:27:03.361 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-07-16T20:27:03.363 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.412 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.061) 0:01:42.732 ********* 2020-07-16T20:27:03.454 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-07-16T20:27:03.456 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.500 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.088) 0:01:42.821 ********* 2020-07-16T20:27:03.542 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-07-16T20:27:03.544 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.085) 0:01:42.906 ********* 2020-07-16T20:27:03.596 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:03.598 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-07-16T20:27:03.650 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.064) 0:01:42.971 ********* 2020-07-16T20:27:03.659 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-07-16T20:27:03.661 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.707 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.056) 0:01:43.028 ********* 2020-07-16T20:27:03.722 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.757 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.049) 0:01:43.077 ********* 2020-07-16T20:27:03.766 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-07-16T20:27:03.768 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.805 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.048) 0:01:43.126 ********* 2020-07-16T20:27:03.818 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.853 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.048) 0:01:43.174 ********* 2020-07-16T20:27:03.867 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-07-16T20:27:03.869 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.917 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.063) 0:01:43.237 ********* 2020-07-16T20:27:03.927 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:03.983 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:03 +0000 (0:00:00.066) 0:01:43.304 ********* 2020-07-16T20:27:03.994 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-07-16T20:27:03.996 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.047 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.063) 0:01:43.368 ********* 2020-07-16T20:27:04.061 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.122 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.075) 0:01:43.443 ********* 2020-07-16T20:27:04.131 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-07-16T20:27:04.133 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.170 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.047) 0:01:43.490 ********* 2020-07-16T20:27:04.179 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:04.182 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.220 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.050) 0:01:43.540 ********* 2020-07-16T20:27:04.229 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-07-16T20:27:04.231 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.270 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.050) 0:01:43.591 ********* 2020-07-16T20:27:04.293 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:04.295 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.334 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.063) 0:01:43.655 ********* 2020-07-16T20:27:04.343 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:04.345 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.395 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.061) 0:01:43.716 ********* 2020-07-16T20:27:04.408 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.461 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.065) 0:01:43.782 ********* 2020-07-16T20:27:04.471 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-07-16T20:27:04.474 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.515 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.054) 0:01:43.836 ********* 2020-07-16T20:27:04.524 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:04.527 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.580 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.064) 0:01:43.901 ********* 2020-07-16T20:27:04.591 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-07-16T20:27:04.593 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.647 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.066) 0:01:43.967 ********* 2020-07-16T20:27:04.662 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:04.664 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.714 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.067) 0:01:44.035 ********* 2020-07-16T20:27:04.727 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-07-16T20:27:04.729 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.773 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.058) 0:01:44.093 ********* 2020-07-16T20:27:04.784 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-07-16T20:27:04.786 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.828 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.055) 0:01:44.149 ********* 2020-07-16T20:27:04.843 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:04.845 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.894 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.065) 0:01:44.215 ********* 2020-07-16T20:27:04.905 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-07-16T20:27:04.907 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:04.948 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:04 +0000 (0:00:00.049) 0:01:44.264 ********* 2020-07-16T20:27:04.982 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:04.984 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.032 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.089) 0:01:44.353 ********* 2020-07-16T20:27:05.080 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.143 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.110) 0:01:44.463 ********* 2020-07-16T20:27:05.165 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:05.167 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-07-16T20:27:05.210 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.067) 0:01:44.531 ********* 2020-07-16T20:27:05.221 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-07-16T20:27:05.223 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.262 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.051) 0:01:44.583 ********* 2020-07-16T20:27:05.306 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-16T20:27:05.315 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.363 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.100) 0:01:44.683 ********* 2020-07-16T20:27:05.395 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-07-16T20:27:05.397 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.448 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.085) 0:01:44.769 ********* 2020-07-16T20:27:05.482 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-16T20:27:05.484 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:05.535 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.086) 0:01:44.855 ********* 2020-07-16T20:27:05.537 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:05.598 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.059) 0:01:44.915 ********* 2020-07-16T20:27:05.637 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-16T20:27:05.639 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.685 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.090) 0:01:45.005 ********* 2020-07-16T20:27:05.730 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-16T20:27:05.731 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.770 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.085) 0:01:45.091 ********* 2020-07-16T20:27:05.783 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-07-16T20:27:05.784 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-07-16T20:27:05.828 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.057) 0:01:45.148 ********* 2020-07-16T20:27:05.841 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-16T20:27:05.842 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.891 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.063) 0:01:45.212 ********* 2020-07-16T20:27:05.903 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:05.906 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:05.964 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:05 +0000 (0:00:00.072) 0:01:45.285 ********* 2020-07-16T20:27:05.980 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-16T20:27:05.982 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.035 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.070) 0:01:45.356 ********* 2020-07-16T20:27:06.044 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T20:27:06.048 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.086 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.051) 0:01:45.407 ********* 2020-07-16T20:27:06.110 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.162 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.076) 0:01:45.483 ********* 2020-07-16T20:27:06.174 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-07-16T20:27:06.176 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.229 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.066) 0:01:45.550 ********* 2020-07-16T20:27:06.239 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:06.241 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T20:27:06.290 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.059) 0:01:45.610 ********* 2020-07-16T20:27:06.306 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.371 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.079) 0:01:45.690 ********* 2020-07-16T20:27:06.398 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi116.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.407 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T20:27:06.418 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi116.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.486 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.113) 0:01:45.803 ********* 2020-07-16T20:27:06.500 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.522 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.524 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.526 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.579 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.096) 0:01:45.899 ********* 2020-07-16T20:27:06.648 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.069) 0:01:45.968 ********* 2020-07-16T20:27:06.660 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-07-16T20:27:06.662 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.731 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.083) 0:01:46.051 ********* 2020-07-16T20:27:06.776 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-07-16T20:27:06.778 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.839 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.108) 0:01:46.160 ********* 2020-07-16T20:27:06.896 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:06.961 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:06 +0000 (0:00:00.117) 0:01:46.278 ********* 2020-07-16T20:27:07.003 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-07-16T20:27:07.006 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.060 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.103) 0:01:46.381 ********* 2020-07-16T20:27:07.078 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-16T20:27:07.080 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005369", "end": "2020-07-16 20:27:06.973223", "rc": 0, "start": "2020-07-16 20:27:06.967854", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-16T20:27:07.131 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.070) 0:01:46.452 ********* 2020-07-16T20:27:07.144 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.191 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.057) 0:01:46.509 ********* 2020-07-16T20:27:07.201 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-16T20:27:07.203 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.270 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.074) 0:01:46.584 ********* 2020-07-16T20:27:07.277 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-07-16T20:27:07.279 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.326 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.062) 0:01:46.646 ********* 2020-07-16T20:27:07.338 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-07-16T20:27:07.340 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.394 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.067) 0:01:46.714 ********* 2020-07-16T20:27:07.403 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-07-16T20:27:07.405 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.466 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.068) 0:01:46.783 ********* 2020-07-16T20:27:07.474 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.521 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.058) 0:01:46.842 ********* 2020-07-16T20:27:07.534 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-07-16T20:27:07.536 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.585 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.063) 0:01:46.905 ********* 2020-07-16T20:27:07.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-16T20:27:07.599 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.648 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.063) 0:01:46.969 ********* 2020-07-16T20:27:07.659 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-07-16T20:27:07.662 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.717 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.067) 0:01:47.036 ********* 2020-07-16T20:27:07.786 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.819 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.104) 0:01:47.140 ********* 2020-07-16T20:27:07.862 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-07-16T20:27:07.864 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.901 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.081) 0:01:47.221 ********* 2020-07-16T20:27:07.942 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-07-16T20:27:07.944 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:07.994 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:07 +0000 (0:00:00.092) 0:01:47.314 ********* 2020-07-16T20:27:08.034 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-07-16T20:27:08.036 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.071 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.077) 0:01:47.392 ********* 2020-07-16T20:27:08.114 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-07-16T20:27:08.115 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.152 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.080) 0:01:47.472 ********* 2020-07-16T20:27:08.205 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-07-16T20:27:08.207 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.250 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.097) 0:01:47.570 ********* 2020-07-16T20:27:08.285 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.334 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.081) 0:01:47.652 ********* 2020-07-16T20:27:08.387 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-07-16T20:27:08.426 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.094) 0:01:47.746 ********* 2020-07-16T20:27:08.495 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-07-16T20:27:08.496 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.508 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-07-16T20:27:08.510 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.520 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.532 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.534 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.546 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:08.602 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.175) 0:01:47.922 ********* 2020-07-16T20:27:08.614 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-16T20:27:08.616 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T20:27:08.663 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.061) 0:01:47.984 ********* 2020-07-16T20:27:08.735 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:08.738 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}} 2020-07-16T20:27:08.780 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.117) 0:01:48.101 ********* 2020-07-16T20:27:08.927 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-07-16T20:27:08.929 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.011166", "end": "2020-07-16 20:27:08.887716", "rc": 0, "start": "2020-07-16 20:27:08.876550", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-07-16T20:27:08.987 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:08 +0000 (0:00:00.206) 0:01:48.308 ********* 2020-07-16T20:27:09.018 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-16T20:27:09.021 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005038", "end": "2020-07-16 20:27:08.972347", "rc": 0, "start": "2020-07-16 20:27:08.967309", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:09.071 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.083) 0:01:48.391 ********* 2020-07-16T20:27:09.083 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-07-16T20:27:09.085 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.140 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.069) 0:01:48.461 ********* 2020-07-16T20:27:09.153 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-16T20:27:09.154 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.222 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.081) 0:01:48.542 ********* 2020-07-16T20:27:09.234 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-07-16T20:27:09.236 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.291 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.069) 0:01:48.611 ********* 2020-07-16T20:27:09.304 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-16T20:27:09.361 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.069) 0:01:48.681 ********* 2020-07-16T20:27:09.375 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-07-16T20:27:09.377 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.424 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.063) 0:01:48.745 ********* 2020-07-16T20:27:09.464 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-07-16T20:27:09.466 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:09.514 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:09 +0000 (0:00:00.089) 0:01:48.834 ********* 2020-07-16T20:27:10.522 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-07-16T20:27:10.524 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-07-16T20:27:10.581 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:10 +0000 (0:00:01.067) 0:01:49.902 ********* 2020-07-16T20:27:10.653 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:10.654 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532052992, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180677, 'block_used': 12914431, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180677, "block_size": 4096, "block_total": 240095108, "block_used": 12914431, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532052992, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}} 2020-07-16T20:27:10.700 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:10 +0000 (0:00:00.119) 0:01:50.021 ********* 2020-07-16T20:27:10.940 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-07-16T20:27:10.942 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005312", "end": "2020-07-16 20:27:10.912006", "rc": 0, "start": "2020-07-16 20:27:10.906694", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:10.979 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:10 +0000 (0:00:00.278) 0:01:50.299 ********* 2020-07-16T20:27:11.031 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-07-16T20:27:11.033 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532052992, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180677, 'block_used': 12914431, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180677, "block_size": 4096, "block_total": 240095108, "block_used": 12914431, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532052992, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:11.035 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSY2djUtmOi0tRgkqcf9S3KwB8HakFp4CA'], 'uuids': ['23ec7bc3-dc32-4a95-bc37-f78fcc33ecd6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.378511", "end": "2020-07-16 20:27:10.984977", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSY2djUtmOi0tRgkqcf9S3KwB8HakFp4CA"], "labels": [], "masters": [], "uuids": ["23ec7bc3-dc32-4a95-bc37-f78fcc33ecd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:09.606466", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-07-16T20:27:11.036 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-07-16T20:27:11.087 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:11 +0000 (0:00:00.108) 0:01:50.407 ********* 2020-07-16T20:27:11.145 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-07-16T20:27:11.192 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:11 +0000 (0:00:00.105) 0:01:50.513 ********* 2020-07-16T20:27:12.342 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-jy0cTQ-NhD7-r3lS-Z4sX-Bj6Y-Ry28-p8fiDL', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN', 'nvme-nvme.8086-50484654363230343030564a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.086155", "end": "2020-07-16 20:27:12.283208", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-jy0cTQ-NhD7-r3lS-Z4sX-Bj6Y-Ry28-p8fiDL", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN", "nvme-nvme.8086-50484654363230343030564a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:11.197053", "stderr": "", "stde 2020-07-16T20:27:12.344 INFO:teuthology.task.ansible.out:rr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:12.855 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bT5TsHPX1vIYIAzdBoXYeG0AA2mewi6U'], 'uuids': ['37b05dbe-673b-402b-bb54-5fc403295eb1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.358372", "end": "2020-07-16 20:27:12.799084", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bT5TsHPX1vIYIAzdBoXYeG0AA2mewi6U"], "labels": [], "masters": [], "uuids": ["37b05dbe-673b-402b-bb54-5fc403295eb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:11.440712", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:13.605 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMS3p3zUZMw4lZ8TOeQPMDHv6oN0zufTZdP'], 'uuids': ['9599452c-151c-4bb8-bf9f-fbf59c17b6ba'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.047432", "end": "2020-07-16 20:27:13.563294", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMS3p3zUZMw4lZ8TOeQPMDHv6oN0zufTZdP"], "labels": [], "masters": [], "uuids": ["9599452c-151c-4bb8-bf9f-fbf59c17b6ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:12.515862", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:14.162 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-zE0aPZ-G2be-PVR7-Piot-0p03-qXSh-P6LhYx', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN', 'nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.067199", "end": "2020-07-16 20:27:14.122967", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-zE0aPZ-G2be-PVR7-Piot-0p03-qXSh-P6LhYx", "nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN", "nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:13.055768", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-07-16T20:27:14.164 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:14.882 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSjfPOrNjbjt4o4QjQAIGkC079mswmdtI3'], 'uuids': ['e7b888ea-6848-4f14-88f5-87ef2fbf1d8a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.055739", "end": "2020-07-16 20:27:14.838612", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSjfPOrNjbjt4o4QjQAIGkC079mswmdtI3"], "labels": [], "masters": [], "uuids": ["e7b888ea-6848-4f14-88f5-87ef2fbf1d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:13.782873", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:15.454 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0NlzU4ISXsr61S2fbncoBrBWDYfYn9Tsy'], 'uuids': ['f4067b2f-7570-46ff-933a-19280239e942'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.074012", "end": "2020-07-16 20:27:15.415586", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0NlzU4ISXsr61S2fbncoBrBWDYfYn9Tsy"], "labels": [], "masters": [], "uuids": ["f4067b2f-7570-46ff-933a-19280239e942"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:14.341574", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:16.201 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSqy36OX9UnJLaLVnKTtlyeCsS8q38do8M'], 'uuids': ['3cb08570-a598-422f-93a2-6e910a0ec566'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.089958", "end": "2020-07-16 20:27:16.158420", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSqy36OX9UnJLaLVnKTtlyeCsS8q38do8M"], "labels": [], "masters": [], "uuids": ["3cb08570-a598-422f-93a2-6e910a0ec566"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:15.068462", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:16.215 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJB5', 'wwn-0x5000c50091e1a66f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QJB5', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1a66f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJB5-part1', 'wwn-0x5000c50091e1a66f-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJB5", "wwn-0x5000c50091e1a66f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJB5-part1", "wwn-0x5000c50091e1a66f-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJB5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a66f"}}, 2020-07-16T20:27:16.217 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:16.745 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bqhVL34E3tylLeZNabguD9mxF8V2kXGa'], 'uuids': ['6e6c6be2-b2ed-4f90-a608-a7314d8a447e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.055127", "end": "2020-07-16 20:27:16.709104", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bqhVL34E3tylLeZNabguD9mxF8V2kXGa"], "labels": [], "masters": [], "uuids": ["6e6c6be2-b2ed-4f90-a608-a7314d8a447e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:15.653977", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:17.481 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSnBKgrSGzjQ22yzFSgxZxJsNpFXnbDDaZ'], 'uuids': ['a6ee511e-2928-41ef-a138-ed71ec277629'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055162", "end": "2020-07-16 20:27:17.431018", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSnBKgrSGzjQ22yzFSgxZxJsNpFXnbDDaZ"], "labels": [], "masters": [], "uuids": ["a6ee511e-2928-41ef-a138-ed71ec277629"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:16.375856", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:17.539 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:17 +0000 (0:00:06.347) 0:01:56.860 ********* 2020-07-16T20:27:17.956 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:17.958 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSY2djUtmOi0tRgkqcf9S3KwB8HakFp4CA'], 'uuids': ['23ec7bc3-dc32-4a95-bc37-f78fcc33ecd6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139671", "end": "2020-07-16 20:27:17.921033", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSY2djUtmOi0tRgkqcf9S3KwB8HakFp4CA"], "labels": [], "masters": [], "uuids": ["23ec7bc3-dc32-4a95-bc37-f78fcc33ecd6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:17.781362", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136998 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136998 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:18.043 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-16T20:27:18.045 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0QvxoI1fnCeehq0CNz2T8Iq5M2DAeOYWu'], 'uuids': ['6c0b8f81-0344-458d-966c-6d3fbe6b2b82'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.072388", "end": "2020-07-16 20:27:18.003078", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0QvxoI1fnCeehq0CNz2T8Iq5M2DAeOYWu"], "labels": [], "masters": [], "uuids": ["6c0b8f81-0344-458d-966c-6d3fbe6b2b82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:16.930690", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:18.047 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQJ7', 'wwn-0x5000c500871a6c97'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQJ7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a6c97', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1', 'wwn-0x5000c500871a6c97-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7", "wwn-0x5000c500871a6c97"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1", "wwn-0x5000c500871a6c97-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQJ7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a6c97"}}, 2020-07-16T20:27:18.048 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:18.191 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:18.193 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-jy0cTQ-NhD7-r3lS-Z4sX-Bj6Y-Ry28-p8fiDL', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN', 'nvme-nvme.8086-50484654363230343030564a34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036262", "end": "2020-07-16 20:27:18.156921", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-jy0cTQ-NhD7-r3lS-Z4sX-Bj6Y-Ry28-p8fiDL", "nvme-INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN", "nvme-nvme.8086-50484654363230343030564a34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:18.120659", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0335812 s, 3.4 GB/s", "std 2020-07-16T20:27:18.202 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0335812 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:18.531 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMS3p3zUZMw4lZ8TOeQPMDHv6oN0zufTZdP'], 'uuids': ['9599452c-151c-4bb8-bf9f-fbf59c17b6ba'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138540", "end": "2020-07-16 20:27:18.503390", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMS3p3zUZMw4lZ8TOeQPMDHv6oN0zufTZdP"], "labels": [], "masters": [], "uuids": ["9599452c-151c-4bb8-bf9f-fbf59c17b6ba"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:18.364850", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136027 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136027 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:18.890 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSjfPOrNjbjt4o4QjQAIGkC079mswmdtI3'], 'uuids': ['e7b888ea-6848-4f14-88f5-87ef2fbf1d8a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139173", "end": "2020-07-16 20:27:18.839637", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSjfPOrNjbjt4o4QjQAIGkC079mswmdtI3"], "labels": [], "masters": [], "uuids": ["e7b888ea-6848-4f14-88f5-87ef2fbf1d8a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:18.700464", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136526 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136526 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:19.227 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSqy36OX9UnJLaLVnKTtlyeCsS8q38do8M'], 'uuids': ['3cb08570-a598-422f-93a2-6e910a0ec566'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139608", "end": "2020-07-16 20:27:19.191595", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSqy36OX9UnJLaLVnKTtlyeCsS8q38do8M"], "labels": [], "masters": [], "uuids": ["3cb08570-a598-422f-93a2-6e910a0ec566"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:19.051987", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137127 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137127 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:19.239 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJB5', 'wwn-0x5000c50091e1a66f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QJB5', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1a66f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QJB5-part1', 'wwn-0x5000c50091e1a66f-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJB5", "wwn-0x5000c50091e1a66f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QJB5-part1", "wwn-0x5000c50091e1a66f-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QJB5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a66f"}}, 2020-07-16T20:27:19.241 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:19.315 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-07-16T20:27:19.317 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0C3c3AcQShcGVyAF9oX2UTQUai3AYGIeo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055612", "end": "2020-07-16 20:27:19.276108", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0C3c3AcQShcGVyAF9oX2UTQUai3AYGIeo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:18.220496", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-07-16T20:27:19.376 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:01.836) 0:01:58.696 ********* 2020-07-16T20:27:19.574 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:19.578 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSnBKgrSGzjQ22yzFSgxZxJsNpFXnbDDaZ'], 'uuids': ['a6ee511e-2928-41ef-a138-ed71ec277629'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139582", "end": "2020-07-16 20:27:19.539136", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-9FIPBHZRwNHzsDN2tw3pndCwyfJliUMSnBKgrSGzjQ22yzFSgxZxJsNpFXnbDDaZ"], "labels": [], "masters": [], "uuids": ["a6ee511e-2928-41ef-a138-ed71ec277629"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:19.399554", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137076 s, 841 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137076 s, 841 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:19.619 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.243) 0:01:58.940 ********* 2020-07-16T20:27:19.827 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bT5TsHPX1vIYIAzdBoXYeG0AA2mewi6U'], 'uuids': ['37b05dbe-673b-402b-bb54-5fc403295eb1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.147134", "end": "2020-07-16 20:27:19.786923", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bT5TsHPX1vIYIAzdBoXYeG0AA2mewi6U"], "labels": [], "masters": [], "uuids": ["37b05dbe-673b-402b-bb54-5fc403295eb1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:19.639789", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.144356 s, 799 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.144356 s, 799 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:19.925 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi116.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.075671", "end": "2020-07-16 20:27:19.888865", "rc": 0, "start": "2020-07-16 20:27:19.813194", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:19.970 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:19 +0000 (0:00:00.350) 0:01:59.290 ********* 2020-07-16T20:27:20.071 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:20.074 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-zE0aPZ-G2be-PVR7-Piot-0p03-qXSh-P6LhYx', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN', 'nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036066", "end": "2020-07-16 20:27:20.040222", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-zE0aPZ-G2be-PVR7-Piot-0p03-qXSh-P6LhYx", "nvme-INTEL_SSDPEDMD400G4_CVFT53300063400BGN", "nvme-nvme.8086-43564654353333303030363334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:20.004156", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0334451 s, 3.4 GB/s", "std 2020-07-16T20:27:20.075 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0334451 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:20.258 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T20:27:20.260 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.059112", "end": "2020-07-16 20:27:20.218808", "rc": 0, "start": "2020-07-16 20:27:20.159696", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:20.323 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.352) 0:01:59.643 ********* 2020-07-16T20:27:20.366 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T20:27:20.406 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.083) 0:01:59.726 ********* 2020-07-16T20:27:20.427 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:20.428 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0NlzU4ISXsr61S2fbncoBrBWDYfYn9Tsy'], 'uuids': ['f4067b2f-7570-46ff-933a-19280239e942'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.135226", "end": "2020-07-16 20:27:20.399383", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0NlzU4ISXsr61S2fbncoBrBWDYfYn9Tsy"], "labels": [], "masters": [], "uuids": ["f4067b2f-7570-46ff-933a-19280239e942"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:20.264157", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.132628 s, 870 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.132628 s, 870 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:20.456 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.514 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.106) 0:01:59.833 ********* 2020-07-16T20:27:20.569 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.603 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.091) 0:01:59.924 ********* 2020-07-16T20:27:20.641 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:20.642 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.697 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.093) 0:02:00.018 ********* 2020-07-16T20:27:20.739 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:20.813 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:20 +0000 (0:00:00.115) 0:02:00.133 ********* 2020-07-16T20:27:20.825 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:20.828 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bqhVL34E3tylLeZNabguD9mxF8V2kXGa'], 'uuids': ['6e6c6be2-b2ed-4f90-a608-a7314d8a447e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.134505", "end": "2020-07-16 20:27:20.753304", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0bqhVL34E3tylLeZNabguD9mxF8V2kXGa"], "labels": [], "masters": [], "uuids": ["6e6c6be2-b2ed-4f90-a608-a7314d8a447e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:20.618799", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.131884 s, 875 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.131884 s, 875 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:21.046 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-07-16T20:27:21.049 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:27:21.108 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.292) 0:02:00.426 ********* 2020-07-16T20:27:21.128 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:21.130 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0QvxoI1fnCeehq0CNz2T8Iq5M2DAeOYWu'], 'uuids': ['6c0b8f81-0344-458d-966c-6d3fbe6b2b82'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.136183", "end": "2020-07-16 20:27:21.100673", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0QvxoI1fnCeehq0CNz2T8Iq5M2DAeOYWu"], "labels": [], "masters": [], "uuids": ["6c0b8f81-0344-458d-966c-6d3fbe6b2b82"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:20.964490", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133607 s, 863 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133607 s, 863 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:21.141 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQJ7', 'wwn-0x5000c500871a6c97'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HQJ7', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871a6c97', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1', 'wwn-0x5000c500871a6c97-part1'], 'uuids': ['7d7ca31c-77d6-4023-896d-a1d87c0f49ac'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7", "wwn-0x5000c500871a6c97"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQJ7-part1", "wwn-0x5000c500871a6c97-part1"], "labels": [], "masters": [], "uuids": ["7d7ca31c-77d6-4023-896d-a1d87c0f49ac"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQJ7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a6c97"}}, 2020-07-16T20:27:21.150 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.163 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-07-16T20:27:21.165 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532126720, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180695, 'block_used': 12914413, 'inode_total': 61054976, 'inode_available': 60990210, 'inode_used': 64766, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180695, "block_size": 4096, "block_total": 240095108, "block_used": 12914413, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990210, "inode_total": 61054976, "inode_used": 64766, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532126720, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.199 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.094) 0:02:00.520 ********* 2020-07-16T20:27:21.240 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-07-16T20:27:21.241 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.285 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.085) 0:02:00.606 ********* 2020-07-16T20:27:21.333 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.391 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.105) 0:02:00.712 ********* 2020-07-16T20:27:21.435 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:21.437 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.495 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.103) 0:02:00.816 ********* 2020-07-16T20:27:21.506 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-07-16T20:27:21.508 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0C3c3AcQShcGVyAF9oX2UTQUai3AYGIeo'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136509", "end": "2020-07-16 20:27:21.457333", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-YKnHlIHa0jBRJ5c9rjuqLauCBiv5ryQ0C3c3AcQShcGVyAF9oX2UTQUai3AYGIeo"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-07-16 20:27:21.320824", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.133837 s, 862 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.133837 s, 862 MB/s"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:21.557 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.062) 0:02:00.878 ********* 2020-07-16T20:27:21.570 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.610 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.052) 0:02:00.931 ********* 2020-07-16T20:27:21.653 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-07-16T20:27:21.655 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.696 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.086) 0:02:01.017 ********* 2020-07-16T20:27:21.742 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-16T20:27:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:21.783 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.087) 0:02:01.104 ********* 2020-07-16T20:27:21.861 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-07-16T20:27:21.863 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.069046", "end": "2020-07-16 20:27:21.830737", "rc": 0, "start": "2020-07-16 20:27:21.761691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:21.918 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:21 +0000 (0:00:00.134) 0:02:01.238 ********* 2020-07-16T20:27:22.177 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-07-16T20:27:22.178 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.044081", "end": "2020-07-16 20:27:22.152458", "rc": 0, "start": "2020-07-16 20:27:22.108377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:22.228 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.306) 0:02:01.545 ********* 2020-07-16T20:27:22.259 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-07-16T20:27:22.297 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.073) 0:02:01.618 ********* 2020-07-16T20:27:22.345 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.384 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.086) 0:02:01.705 ********* 2020-07-16T20:27:22.442 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.475 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.090) 0:02:01.796 ********* 2020-07-16T20:27:22.505 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:22.513 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.553 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.073) 0:02:01.869 ********* 2020-07-16T20:27:22.590 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-07-16T20:27:22.592 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:22.641 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.092) 0:02:01.961 ********* 2020-07-16T20:27:22.653 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-07-16T20:27:22.654 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T20:27:22.713 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.065) 0:02:02.027 ********* 2020-07-16T20:27:22.872 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-07-16T20:27:22.938 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:22 +0000 (0:00:00.231) 0:02:02.258 ********* 2020-07-16T20:27:22.992 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi022.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930532052992, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227180677, 'block_used': 12914431, 'inode_total': 61054976, 'inode_available': 60990206, 'inode_used': 64770, 'uuid': '7d7ca31c-77d6-4023-896d-a1d87c0f49ac'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227180677, "block_size": 4096, "block_total": 240095108, "block_used": 12914431, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990206, "inode_total": 61054976, "inode_used": 64770, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930532052992, "size_total": 983429562368, "uuid": "7d7ca31c-77d6-4023-896d-a1d87c0f49ac"}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.066 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.127) 0:02:02.386 ********* 2020-07-16T20:27:23.110 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.174 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.106) 0:02:02.493 ********* 2020-07-16T20:27:23.219 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:23.221 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.259 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.086) 0:02:02.579 ********* 2020-07-16T20:27:23.319 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.386 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.126) 0:02:02.706 ********* 2020-07-16T20:27:23.429 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-07-16T20:27:23.431 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.477 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.091) 0:02:02.797 ********* 2020-07-16T20:27:23.526 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.579 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.101) 0:02:02.899 ********* 2020-07-16T20:27:23.590 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T20:27:23.592 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:23.624 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-07-16T20:27:23.626 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:23.667 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:23 +0000 (0:00:00.088) 0:02:02.988 ********* 2020-07-16T20:27:23.891 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:24.181 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-07-16T20:27:24.183 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-07-16T20:27:24.219 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:24 +0000 (0:00:00.551) 0:02:03.539 ********* 2020-07-16T20:27:24.251 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T20:27:24.254 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:24.601 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:24.623 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:24.945 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:25.029 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.810) 0:02:04.350 ********* 2020-07-16T20:27:25.039 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:25.244 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-07-16T20:27:25.248 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T20:27:25.293 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:25 +0000 (0:00:00.264) 0:02:04.614 ********* 2020-07-16T20:27:25.370 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T20:27:25.372 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:25.535 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:25.537 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:25.757 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:25.817 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:25.977 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:25.980 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:26.177 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-07-16T20:27:26.179 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-07-16T20:27:26.245 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.951) 0:02:05.565 ********* 2020-07-16T20:27:26.261 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:26.262 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:26.264 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:26.317 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.072) 0:02:05.638 ********* 2020-07-16T20:27:26.509 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-07-16T20:27:26.583 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.265) 0:02:05.903 ********* 2020-07-16T20:27:26.595 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-07-16T20:27:26.597 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:26.643 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.060) 0:02:05.963 ********* 2020-07-16T20:27:26.703 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-07-16T20:27:26.705 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-16T20:27:26.752 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:26 +0000 (0:00:00.109) 0:02:06.072 ********* 2020-07-16T20:27:26.897 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:26.900 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:27.075 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:27.287 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-07-16T20:27:27.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi116.front.sepia.ceph.com] => {"changed": true} 2020-07-16T20:27:27.506 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.754) 0:02:06.827 ********* 2020-07-16T20:27:27.516 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-07-16T20:27:27.518 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi022.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:27.567 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.059) 0:02:06.886 ********* 2020-07-16T20:27:27.850 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-07-16T20:27:27.906 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:27 +0000 (0:00:00.340) 0:02:07.226 ********* 2020-07-16T20:27:27.958 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-07-16T20:27:28.013 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.106) 0:02:07.333 ********* 2020-07-16T20:27:28.270 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T20:27:28.272 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T20:27:28.331 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.318) 0:02:07.652 ********* 2020-07-16T20:27:28.368 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T20:27:28.370 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.437 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.106) 0:02:07.758 ********* 2020-07-16T20:27:28.499 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi022.front.sepia.ceph.com] => {"changed": true} 2020-07-16T20:27:28.594 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.156) 0:02:07.915 ********* 2020-07-16T20:27:28.609 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.674 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.076) 0:02:07.991 ********* 2020-07-16T20:27:28.730 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.780 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.108) 0:02:08.100 ********* 2020-07-16T20:27:28.818 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.868 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.088) 0:02:08.188 ********* 2020-07-16T20:27:28.913 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-16T20:27:28.915 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:28.962 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:28 +0000 (0:00:00.092) 0:02:08.281 ********* 2020-07-16T20:27:28.975 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-07-16T20:27:28.979 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-07-16T20:27:29.034 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.070) 0:02:08.352 ********* 2020-07-16T20:27:29.041 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T20:27:29.044 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.088 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.056) 0:02:08.409 ********* 2020-07-16T20:27:29.098 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-07-16T20:27:29.100 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.156 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.068) 0:02:08.477 ********* 2020-07-16T20:27:29.169 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T20:27:29.171 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.222 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.065) 0:02:08.542 ********* 2020-07-16T20:27:29.232 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-07-16T20:27:29.235 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.290 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.067) 0:02:08.610 ********* 2020-07-16T20:27:29.306 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-16T20:27:29.308 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.362 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.072) 0:02:08.682 ********* 2020-07-16T20:27:29.371 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-07-16T20:27:29.373 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.411 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.049) 0:02:08.732 ********* 2020-07-16T20:27:29.421 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-16T20:27:29.423 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.460 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.049) 0:02:08.781 ********* 2020-07-16T20:27:29.472 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-07-16T20:27:29.474 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.517 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.056) 0:02:08.838 ********* 2020-07-16T20:27:29.527 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-16T20:27:29.529 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.565 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.047) 0:02:08.886 ********* 2020-07-16T20:27:29.575 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-07-16T20:27:29.577 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.628 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.062) 0:02:08.949 ********* 2020-07-16T20:27:29.639 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-07-16T20:27:29.641 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.677 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.048) 0:02:08.998 ********* 2020-07-16T20:27:29.686 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-07-16T20:27:29.689 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.746 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.069) 0:02:09.067 ********* 2020-07-16T20:27:29.788 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-07-16T20:27:29.790 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.841 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.095) 0:02:09.162 ********* 2020-07-16T20:27:29.891 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-07-16T20:27:29.894 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:29.941 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:29 +0000 (0:00:00.099) 0:02:09.262 ********* 2020-07-16T20:27:29.983 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-07-16T20:27:29.986 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.034 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.088) 0:02:09.351 ********* 2020-07-16T20:27:30.072 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-07-16T20:27:30.078 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.111 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.080) 0:02:09.431 ********* 2020-07-16T20:27:30.157 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:30.204 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.093) 0:02:09.525 ********* 2020-07-16T20:27:30.263 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-16T20:27:30.266 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T20:27:30.327 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.121) 0:02:09.647 ********* 2020-07-16T20:27:30.658 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:17 UTC", "ActiveEnterTimestampMonotonic": "15677198", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount system.slice systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target ntpd.service sntp.service basic.target -.mount ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:16 UTC", "AssertTimestampMonotonic": "14524846", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:16 UTC", "ConditionTimestampMonotonic": "14524813", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.servic 2020-07-16T20:27:30.660 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2423", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:17 UTC", "ExecMainStartTimestampMonotonic": "15606137", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:16 UTC] ; stop_time=[Thu 2020-07-16 20:24:17 UTC] ; pid=2410 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:17 UTC] ; stop_time=[Thu 2020-07-16 20:24:17 UTC] ; pid=2492 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:16 UTC", "InactiveExitTimestampMonotonic": "14532645", "InvocationID": "16f1266b03744425b8f35636abe04c1e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitD 2020-07-16T20:27:30.662 INFO:teuthology.task.ansible.out:ATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2423", "MemoryAccounting": "yes", "MemoryCurrent": "2838528", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "Run 2020-07-16T20:27:30.664 INFO:teuthology.task.ansible.out:timeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:17 UTC", "StateChangeTimestampMonotonic": "15677198", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:17 UTC", "WatchdogTimestampMonotonic": "15606151", "WatchdogUSec": "0"}} 2020-07-16T20:27:30.706 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.379) 0:02:10.027 ********* 2020-07-16T20:27:30.747 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:30.749 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T20:27:30.787 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.080) 0:02:10.107 ********* 2020-07-16T20:27:30.800 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-07-16T20:27:30.802 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-07-16T20:27:30.847 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.060) 0:02:10.168 ********* 2020-07-16T20:27:30.860 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:30.862 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T20:27:30.913 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:30 +0000 (0:00:00.065) 0:02:10.234 ********* 2020-07-16T20:27:30.967 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-16T20:27:30.969 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.008 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.095) 0:02:10.329 ********* 2020-07-16T20:27:31.051 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-07-16T20:27:31.053 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.087 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.078) 0:02:10.408 ********* 2020-07-16T20:27:31.129 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T20:27:31.131 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.183 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.095) 0:02:10.504 ********* 2020-07-16T20:27:31.207 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-07-16T20:27:31.208 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2020-07-16 20:24:14 UTC", "ActiveEnterTimestampMonotonic": "19087698", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service systemd-tmpfiles-setup.service sysinit.target sntp.service ntpdate.service systemd-journald.socket system.slice tmp.mount -.mount basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2020-07-16 20:24:13 UTC", "AssertTimestampMonotonic": "17912359", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2020-07-16 20:24:13 UTC", "ConditionTimestampMonotonic": "17912200", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-07-16T20:27:31.210 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2417", "ExecMainStartTimestamp": "Thu 2020-07-16 20:24:14 UTC", "ExecMainStartTimestampMonotonic": "18968299", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:13 UTC] ; stop_time=[Thu 2020-07-16 20:24:14 UTC] ; pid=2405 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Thu 2020-07-16 20:24:14 UTC] ; stop_time=[Thu 2020-07-16 20:24:14 UTC] ; pid=2482 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2020-07-16 20:24:13 UTC", "InactiveExitTimestampMonotonic": "17937841", "InvocationID": "a36120b1957d4d9e99f0c924bc87aac6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZE 2020-07-16T20:27:31.212 INFO:teuthology.task.ansible.out:Soft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127450", "LimitNPROCSoft": "127450", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127450", "LimitSIGPENDINGSoft": "127450", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2417", "MemoryAccounting": "yes", "MemoryCurrent": "2633728", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no" 2020-07-16T20:27:31.213 INFO:teuthology.task.ansible.out:, "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2020-07-16 20:24:14 UTC", "StateChangeTimestampMonotonic": "19087698", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Thu 2020-07-16 20:24:14 UTC", "WatchdogTimestampMonotonic": "18968313", "WatchdogUSec": "0"}} 2020-07-16T20:27:31.249 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.065) 0:02:10.570 ********* 2020-07-16T20:27:31.294 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:31.296 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-07-16T20:27:31.345 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.095) 0:02:10.665 ********* 2020-07-16T20:27:31.390 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:31.392 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-07-16T20:27:31.428 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.083) 0:02:10.748 ********* 2020-07-16T20:27:31.438 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-16T20:27:31.445 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T20:27:31.485 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.056) 0:02:10.805 ********* 2020-07-16T20:27:31.494 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-07-16T20:27:31.496 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.553 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.068) 0:02:10.874 ********* 2020-07-16T20:27:31.604 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.643 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.089) 0:02:10.964 ********* 2020-07-16T20:27:31.676 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-07-16T20:27:31.678 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:31.727 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:31 +0000 (0:00:00.084) 0:02:11.048 ********* 2020-07-16T20:27:31.969 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-07-16T20:27:31.971 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-07-16T20:27:32.021 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:32 +0000 (0:00:00.293) 0:02:11.342 ********* 2020-07-16T20:27:32.040 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-07-16T20:27:32.043 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-07-16T20:27:32.087 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:32 +0000 (0:00:00.065) 0:02:11.408 ********* 2020-07-16T20:27:32.646 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1224, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-07-16T20:27:32.699 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:32 +0000 (0:00:00.612) 0:02:12.020 ********* 2020-07-16T20:27:33.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-07-16T20:27:33.479 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T20:27:33.518 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:33 +0000 (0:00:00.819) 0:02:12.839 ********* 2020-07-16T20:27:33.561 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T20:27:33.562 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:33.611 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:33 +0000 (0:00:00.092) 0:02:12.932 ********* 2020-07-16T20:27:33.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-16T20:27:33.659 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-07-16T20:27:33.696 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:33 +0000 (0:00:00.084) 0:02:13.017 ********* 2020-07-16T20:27:33.836 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-07-16T20:27:33.903 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:33 +0000 (0:00:00.206) 0:02:13.224 ********* 2020-07-16T20:27:33.921 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T20:27:33.923 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-07-16T20:27:33.966 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:33 +0000 (0:00:00.063) 0:02:13.287 ********* 2020-07-16T20:27:33.980 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-07-16T20:27:33.982 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.032 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.065) 0:02:13.353 ********* 2020-07-16T20:27:34.042 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-16T20:27:34.046 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.083 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.051) 0:02:13.404 ********* 2020-07-16T20:27:34.095 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-07-16T20:27:34.097 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-07-16T20:27:34.135 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.051) 0:02:13.456 ********* 2020-07-16T20:27:34.145 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-16T20:27:34.147 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T20:27:34.193 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.049) 0:02:13.505 ********* 2020-07-16T20:27:34.219 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.256 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.071) 0:02:13.577 ********* 2020-07-16T20:27:34.364 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-07-16T20:27:34.366 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-07-16T20:27:34.405 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.148) 0:02:13.725 ********* 2020-07-16T20:27:34.450 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-07-16T20:27:34.452 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.493 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.087) 0:02:13.813 ********* 2020-07-16T20:27:34.502 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-16T20:27:34.504 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T20:27:34.545 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.052) 0:02:13.865 ********* 2020-07-16T20:27:34.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-07-16T20:27:34.556 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-07-16T20:27:34.595 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.049) 0:02:13.915 ********* 2020-07-16T20:27:34.636 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.679 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.084) 0:02:14.000 ********* 2020-07-16T20:27:34.755 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-07-16T20:27:34.756 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T20:27:34.800 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.120) 0:02:14.120 ********* 2020-07-16T20:27:34.842 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-16T20:27:34.844 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.885 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.085) 0:02:14.206 ********* 2020-07-16T20:27:34.906 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-07-16T20:27:34.908 INFO:teuthology.task.ansible.out:changed: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-07-16T20:27:34.957 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:34 +0000 (0:00:00.071) 0:02:14.278 ********* 2020-07-16T20:27:34.973 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T20:27:34.975 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.976 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.976 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:34.979 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.021 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.063) 0:02:14.342 ********* 2020-07-16T20:27:35.081 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T20:27:35.083 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.093 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.105 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.120 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi116.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.176 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.155) 0:02:14.497 ********* 2020-07-16T20:27:35.213 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:35.215 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi022.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-07-16T20:27:35.264 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.087) 0:02:14.585 ********* 2020-07-16T20:27:35.311 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.043) 0:02:14.628 ********* 2020-07-16T20:27:35.317 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-07-16T20:27:35.319 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.355 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.047) 0:02:14.676 ********* 2020-07-16T20:27:35.366 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-07-16T20:27:35.368 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.409 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.053) 0:02:14.730 ********* 2020-07-16T20:27:35.423 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-07-16T20:27:35.426 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.426 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.439 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.441 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.477 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.068) 0:02:14.798 ********* 2020-07-16T20:27:35.487 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-07-16T20:27:35.489 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.534 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.057) 0:02:14.855 ********* 2020-07-16T20:27:35.556 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-07-16T20:27:35.558 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.570 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.572 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.574 INFO:teuthology.task.ansible.out: 2020-07-16T20:27:35.576 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.578 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.614 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.079) 0:02:14.935 ********* 2020-07-16T20:27:35.672 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.057) 0:02:14.992 ********* 2020-07-16T20:27:35.687 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-07-16T20:27:35.689 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.734 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.062) 0:02:15.054 ********* 2020-07-16T20:27:35.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-07-16T20:27:35.751 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.800 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.065) 0:02:15.120 ********* 2020-07-16T20:27:35.812 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.854 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.054) 0:02:15.175 ********* 2020-07-16T20:27:35.869 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:35.870 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.912 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.057) 0:02:15.233 ********* 2020-07-16T20:27:35.930 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:35.977 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:35 +0000 (0:00:00.064) 0:02:15.297 ********* 2020-07-16T20:27:35.989 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-16T20:27:35.991 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.049 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.068) 0:02:15.366 ********* 2020-07-16T20:27:36.058 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-07-16T20:27:36.060 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.099 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.053) 0:02:15.420 ********* 2020-07-16T20:27:36.113 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:36.115 INFO:teuthology.task.ansible.out:skipping: [smithi116.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.171 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.071) 0:02:15.492 ********* 2020-07-16T20:27:36.184 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-07-16T20:27:36.192 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.233 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.062) 0:02:15.554 ********* 2020-07-16T20:27:36.292 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-07-16T20:27:36.294 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.331 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.097) 0:02:15.651 ********* 2020-07-16T20:27:36.371 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-07-16T20:27:36.374 INFO:teuthology.task.ansible.out:skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.432 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.101) 0:02:15.753 ********* 2020-07-16T20:27:36.444 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T20:27:36.446 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004909", "end": "2020-07-16 20:27:36.384705", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 20:27:36.379796", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:36.478 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi022.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-07-16T20:27:36.526 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:36 +0000 (0:00:00.094) 0:02:15.847 ********* 2020-07-16T20:27:36.633 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T20:27:36.638 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002905", "end": "2020-07-16 20:27:36.576900", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 20:27:36.573995", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:36.810 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005347", "end": "2020-07-16 20:27:36.769306", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-07-16 20:27:36.763959", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:37.021 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003263", "end": "2020-07-16 20:27:36.974059", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-07-16 20:27:36.970796", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:37.224 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.003021", "end": "2020-07-16 20:27:37.190486", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:37.187465", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:37.435 INFO:teuthology.task.ansible.out:ok: [smithi022.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.015266", "end": "2020-07-16 20:27:37.407265", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 20:27:37.391999", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:37.488 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:37 +0000 (0:00:00.961) 0:02:16.808 ********* 2020-07-16T20:27:37.541 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-16T20:27:37.591 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:37 +0000 (0:00:00.102) 0:02:16.911 ********* 2020-07-16T20:27:37.822 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi022.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:37.872 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-07-16T20:27:37.874 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:01.003733", "end": "2020-07-16 20:27:37.791479", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-07-16 20:27:36.787746", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:38.055 INFO:teuthology.task.ansible.out:ok: [smithi116.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023804", "end": "2020-07-16 20:27:38.019546", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-07-16 20:27:37.995742", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-07-16T20:27:38.096 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:38 +0000 (0:00:00.504) 0:02:17.416 ********* 2020-07-16T20:27:38.136 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-07-16T20:27:38.178 INFO:teuthology.task.ansible.out:Thursday 16 July 2020 20:27:38 +0000 (0:00:00.081) 0:02:17.498 ********* 2020-07-16T20:27:38.383 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-07-16T20:27:38.385 INFO:teuthology.task.ansible.out:changed: [smithi116.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-07-16T20:27:38.491 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2020-07-16T20:27:38.493 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-07-16T20:27:38.506 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-07-16T20:27:38.517 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-07-16T20:27:38.519 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi022.front.sepia.ceph.com : ok=111 changed=30 unreachable=0 failed=0 skipped=178 rescued=0 ignored=3 smithi116.front.sepia.ceph.com : ok=111 changed=30 unreachable=0 failed=0 skipped=178 rescued=0 ignored=3 Thursday 16 July 2020 20:27:38 +0000 (0:00:00.339) 0:02:17.838 ********* =============================================================================== common : nrpe - Remove SELinux policy package -------------------------- 16.34s common : nrpe - Load SELinux policy package ---------------------------- 15.64s testnode : Zap all non-root disks --------------------------------------- 6.35s common : Install Kerberos Packages (RedHat) ----------------------------- 2.19s testnode : Ensure ceph dependency packages are not present. ------------- 2.07s Gathering Facts --------------------------------------------------------- 1.72s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.57s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.53s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.12s common : Configure local epel mirrorlists ------------------------------- 1.10s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 1.10s testnode : Make sure rpm dependencies are installed --------------------- 1.07s testnode : Install packages --------------------------------------------- 0.97s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.96s users : Create all admin users with sudo access. ------------------------ 0.95s users : Write /keys-repo-sha1 sentinel file ----------------------------- 0.95s Gathering Facts --------------------------------------------------------- 0.88s common : Make sure smartmontools is installed ---------------------- 2020-07-16T20:27:38.521 INFO:teuthology.task.ansible.out:----- 0.86s testnode : Install packages via pip ------------------------------------- 0.82s ansible-managed : Add authorized keys for the ansible user. ------------- 0.82s 2020-07-16T20:27:38.906 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2020-07-16T20:27:38.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:27:38.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:27:39.033 INFO:teuthology.orchestra.run.smithi022:> true 2020-07-16T20:27:39.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-07-16T20:27:39.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-07-16T20:27:39.206 INFO:teuthology.orchestra.run.smithi116:> true 2020-07-16T20:27:39.286 INFO:teuthology.run_tasks:Running task clock... 2020-07-16T20:27:39.301 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-07-16T20:27:39.302 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T20:27:39.303 INFO:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T20:27:39.347 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T20:27:39.370 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T20:27:39.419 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2020-07-16T20:27:39.437 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2020-07-16T20:27:39.458 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T20:27:39.479 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T20:27:39.550 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2020-07-16T20:27:39.553 INFO:teuthology.orchestra.run.smithi022.stdout:210 Number of sources = 4 2020-07-16T20:27:39.554 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T20:27:39.554 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2020-07-16T20:27:39.554 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.555 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.555 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.555 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.556 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-07-16T20:27:39.557 INFO:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-07-16T20:27:39.597 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-07-16T20:27:39.616 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-07-16T20:27:39.660 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2020-07-16T20:27:39.674 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2020-07-16T20:27:39.691 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-07-16T20:27:39.708 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-07-16T20:27:39.772 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2020-07-16T20:27:39.775 INFO:teuthology.orchestra.run.smithi116.stdout:210 Number of sources = 4 2020-07-16T20:27:39.775 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-07-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2020-07-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.776 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-07-16T20:27:39.777 INFO:teuthology.run_tasks:Running task install... 2020-07-16T20:27:39.788 DEBUG:teuthology.task.install:project ceph 2020-07-16T20:27:39.789 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}} 2020-07-16T20:27:39.790 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'} 2020-07-16T20:27:39.790 INFO:teuthology.task.install:Using flavor: basic 2020-07-16T20:27:39.797 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-07-16T20:27:39.798 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-07-16T20:27:39.798 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2020-07-16T20:27:39.840 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2020-07-16T20:27:39.842 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:27:39.842 INFO:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2020-07-16T20:27:39.843 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-07-16T20:27:39.844 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2020-07-16T20:27:39.881 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS 2020-07-16T20:27:39.882 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:27:39.883 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'tag': None, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'debuginfo': None, 'flavor': 'basic', 'downgrade_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'exclude_packages': [], 'extras': None, 'wait_for_package': False, 'project': 'ceph', 'packages': {}, 'install_ceph_packages': True, 'repos_only': False} 2020-07-16T20:27:39.883 INFO:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2020-07-16T20:27:39.923 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2020-07-16T20:27:39.925 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:27:39.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:27:39.958 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS 2020-07-16T20:27:39.959 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:27:39.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:27:40.142 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/ 2020-07-16T20:27:40.143 INFO:teuthology.task.install.rpm:Package version is 16.0.0-3565.g8e60ca350a5 2020-07-16T20:27:40.158 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/ 2020-07-16T20:27:40.159 INFO:teuthology.task.install.rpm:Package version is 16.0.0-3565.g8e60ca350a5 2020-07-16T20:27:40.387 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-07-16T20:27:40.389 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-07-16T20:27:40.392 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200716.140830/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-07-16T20:27:40.393 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-07-16T20:27:40.439 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-07-16T20:27:40.440 INFO:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-07-16T20:27:40.442 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-07-16T20:27:40.443 INFO:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-07-16T20:27:40.521 INFO:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-07-16T20:27:40.523 INFO:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-07-16T20:27:40.603 INFO:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-07-16T20:27:40.616 INFO:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-07-16T20:27:40.669 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2020-07-16T20:27:40.670 INFO:teuthology.orchestra.run.smithi116:> sudo yum clean all 2020-07-16T20:27:40.687 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2020-07-16T20:27:40.688 INFO:teuthology.orchestra.run.smithi022:> sudo yum clean all 2020-07-16T20:27:40.947 INFO:teuthology.orchestra.run.smithi116.stdout:41 files removed 2020-07-16T20:27:40.976 INFO:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-07-16T20:27:40.986 INFO:teuthology.orchestra.run.smithi022.stdout:41 files removed 2020-07-16T20:27:41.015 INFO:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-07-16T20:27:41.829 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 141 kB/s | 71 kB 00:00 2020-07-16T20:27:41.897 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 140 kB/s | 71 kB 00:00 2020-07-16T20:27:42.279 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 35 kB/s | 15 kB 00:00 2020-07-16T20:27:42.348 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 35 kB/s | 15 kB 00:00 2020-07-16T20:27:42.717 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 3.4 kB/s | 1.4 kB 00:00 2020-07-16T20:27:42.747 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 3.8 kB/s | 1.4 kB 00:00 2020-07-16T20:27:42.923 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - AppStream 38 MB/s | 7.0 MB 00:00 2020-07-16T20:27:43.026 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - AppStream 27 MB/s | 7.0 MB 00:00 2020-07-16T20:27:44.147 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:27:44.318 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-07-16T20:27:44.583 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-07-16T20:27:44.793 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Extras 83 kB/s | 5.5 kB 00:00 2020-07-16T20:27:44.944 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T20:27:45.164 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 23 MB/s | 7.4 MB 00:00 2020-07-16T20:27:46.448 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-07-16T20:27:46.771 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 3.9 MB/s | 20 kB 00:00 2020-07-16T20:27:47.325 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:27:47.325 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:27:47.330 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-07-16T20:27:47.330 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-07-16T20:27:47.330 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-07-16T20:27:47.331 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-07-16T20:27:47.331 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-07-16T20:27:47.332 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-07-16T20:27:47.332 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-07-16T20:27:47.458 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2020-07-16T20:27:47.481 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2020-07-16T20:27:47.481 INFO:teuthology.orchestra.run.smithi116.stdout: Package ArchVersion Repository Size 2020-07-16T20:27:47.482 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2020-07-16T20:27:47.482 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2020-07-16T20:27:47.482 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.5 k 2020-07-16T20:27:47.483 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.0 M 2020-07-16T20:27:47.483 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 604 k 2020-07-16T20:27:47.483 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 202 k 2020-07-16T20:27:47.484 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 1.5 M 2020-07-16T20:27:47.484 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 10 M 2020-07-16T20:27:47.484 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 45 M 2020-07-16T20:27:47.485 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 48 k 2020-07-16T20:27:47.485 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 23 k 2020-07-16T20:27:47.485 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 536 k 2020-07-16T20:27:47.486 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 131 k 2020-07-16T20:27:47.486 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 204 k 2020-07-16T20:27:47.486 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 364 k 2020-07-16T20:27:47.487 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 335 k 2020-07-16T20:27:47.487 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 113 k 2020-07-16T20:27:47.487 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 87 k 2020-07-16T20:27:47.488 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.7 M 2020-07-16T20:27:47.488 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 161 k 2020-07-16T20:27:47.489 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 54 k 2020-07-16T20:27:47.489 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 3.5 M 2020-07-16T20:27:47.490 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.6 M 2020-07-16T20:27:47.490 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 27 k 2020-07-16T20:27:47.491 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-07-16T20:27:47.491 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-07-16T20:27:47.491 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-07-16T20:27:47.492 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-07-16T20:27:47.492 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-07-16T20:27:47.492 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-07-16T20:27:47.493 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-07-16T20:27:47.493 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-07-16T20:27:47.493 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2020-07-16T20:27:47.494 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.7 M 2020-07-16T20:27:47.504 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.0 M 2020-07-16T20:27:47.504 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-07-16T20:27:47.504 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-07-16T20:27:47.505 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-07-16T20:27:47.505 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-07-16T20:27:47.505 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2020-07-16T20:27:47.506 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 22 M 2020-07-16T20:27:47.506 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.1 M 2020-07-16T20:27:47.506 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 4.9 M 2020-07-16T20:27:47.507 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 18 M 2020-07-16T20:27:47.507 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 25 k 2020-07-16T20:27:47.507 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 484 k 2020-07-16T20:27:47.508 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.4 M 2020-07-16T20:27:47.508 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 40 k 2020-07-16T20:27:47.508 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 67 k 2020-07-16T20:27:47.509 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 24 k 2020-07-16T20:27:47.509 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 174 k 2020-07-16T20:27:47.509 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.8 k 2020-07-16T20:27:47.510 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-07-16T20:27:47.510 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-07-16T20:27:47.510 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-07-16T20:27:47.511 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-07-16T20:27:47.511 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-07-16T20:27:47.511 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-07-16T20:27:47.512 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-07-16T20:27:47.512 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-07-16T20:27:47.512 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-07-16T20:27:47.513 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-07-16T20:27:47.513 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-07-16T20:27:47.513 INFO:teuthology.orchestra.run.smithi116.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-07-16T20:27:47.514 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-07-16T20:27:47.514 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-07-16T20:27:47.514 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-07-16T20:27:47.515 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-07-16T20:27:47.515 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-07-16T20:27:47.515 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-07-16T20:27:47.516 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-07-16T20:27:47.516 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-07-16T20:27:47.516 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-07-16T20:27:47.517 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-07-16T20:27:47.517 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-07-16T20:27:47.517 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-07-16T20:27:47.518 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-07-16T20:27:47.518 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-07-16T20:27:47.518 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-07-16T20:27:47.519 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-07-16T20:27:47.519 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-07-16T20:27:47.519 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-07-16T20:27:47.520 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-07-16T20:27:47.520 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-07-16T20:27:47.520 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-07-16T20:27:47.521 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-07-16T20:27:47.521 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-07-16T20:27:47.521 INFO:teuthology.orchestra.run.smithi116.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-07-16T20:27:47.522 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-07-16T20:27:47.522 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-07-16T20:27:47.522 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-07-16T20:27:47.523 INFO:teuthology.orchestra.run.smithi116.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-07-16T20:27:47.523 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-07-16T20:27:47.523 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-07-16T20:27:47.524 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-07-16T20:27:47.524 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-07-16T20:27:47.524 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-07-16T20:27:47.525 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-07-16T20:27:47.525 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-07-16T20:27:47.525 INFO:teuthology.orchestra.run.smithi116.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-07-16T20:27:47.526 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-07-16T20:27:47.526 INFO:teuthology.orchestra.run.smithi116.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-07-16T20:27:47.526 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-07-16T20:27:47.527 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-07-16T20:27:47.527 INFO:teuthology.orchestra.run.smithi116.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-07-16T20:27:47.527 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-07-16T20:27:47.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-07-16T20:27:47.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-07-16T20:27:47.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-07-16T20:27:47.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-07-16T20:27:47.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-07-16T20:27:47.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-07-16T20:27:47.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-07-16T20:27:47.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-07-16T20:27:47.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-07-16T20:27:47.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-07-16T20:27:47.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-07-16T20:27:47.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-07-16T20:27:47.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-07-16T20:27:47.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-07-16T20:27:47.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-07-16T20:27:47.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-07-16T20:27:47.533 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-07-16T20:27:47.533 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-07-16T20:27:47.533 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-07-16T20:27:47.534 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-07-16T20:27:47.534 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-07-16T20:27:47.534 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme noarch0.5.2-4.el8 epel 26 k 2020-07-16T20:27:47.535 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-07-16T20:27:47.535 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-07-16T20:27:47.535 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-07-16T20:27:47.536 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-07-16T20:27:47.536 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-07-16T20:27:47.536 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-07-16T20:27:47.537 INFO:teuthology.orchestra.run.smithi116.stdout:Installing weak dependencies: 2020-07-16T20:27:47.537 INFO:teuthology.orchestra.run.smithi116.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-07-16T20:27:47.538 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-07-16T20:27:47.538 INFO:teuthology.orchestra.run.smithi116.stdout:Downgrading: 2020-07-16T20:27:47.538 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-07-16T20:27:47.538 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-07-16T20:27:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-07-16T20:27:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-07-16T20:27:47.539 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-07-16T20:27:47.540 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:27:47.540 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2020-07-16T20:27:47.541 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2020-07-16T20:27:47.541 INFO:teuthology.orchestra.run.smithi116.stdout:Install 126 Packages 2020-07-16T20:27:47.541 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 6 Packages 2020-07-16T20:27:47.542 INFO:teuthology.orchestra.run.smithi116.stdout:Downgrade 5 Packages 2020-07-16T20:27:47.542 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:27:47.543 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 195 M 2020-07-16T20:27:47.543 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2020-07-16T20:27:47.564 INFO:teuthology.orchestra.run.smithi116.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 12 MB/s | 851 kB 00:00 2020-07-16T20:27:47.610 INFO:teuthology.orchestra.run.smithi116.stdout:(2/137): libkadm5-1.17-9.el8.x86_64.rpm 1.6 MB/s | 184 kB 00:00 2020-07-16T20:27:47.651 INFO:teuthology.orchestra.run.smithi116.stdout:(3/137): krb5-workstation-1.17-9.el8.x86_64.rpm 6.0 MB/s | 940 kB 00:00 2020-07-16T20:27:47.670 INFO:teuthology.orchestra.run.smithi116.stdout:(4/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 6.5 MB/s | 686 kB 00:00 2020-07-16T20:27:47.690 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:27:47.690 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-07-16T20:27:47.693 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-07-16T20:27:47.694 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-07-16T20:27:47.695 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-07-16T20:27:47.695 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-07-16T20:27:47.696 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-07-16T20:27:47.696 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-07-16T20:27:47.697 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-07-16T20:27:47.751 INFO:teuthology.orchestra.run.smithi116.stdout:(5/137): ceph-16.0.0-3565.g8e60ca350a5.el8.x86_ 65 kB/s | 6.5 kB 00:00 2020-07-16T20:27:47.836 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2020-07-16T20:27:47.858 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2020-07-16T20:27:47.859 INFO:teuthology.orchestra.run.smithi022.stdout: Package ArchVersion Repository Size 2020-07-16T20:27:47.859 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2020-07-16T20:27:47.859 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2020-07-16T20:27:47.859 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.5 k 2020-07-16T20:27:47.860 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 6.0 M 2020-07-16T20:27:47.860 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 604 k 2020-07-16T20:27:47.860 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 202 k 2020-07-16T20:27:47.861 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 1.5 M 2020-07-16T20:27:47.861 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 10 M 2020-07-16T20:27:47.861 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 45 M 2020-07-16T20:27:47.862 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 48 k 2020-07-16T20:27:47.862 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 23 k 2020-07-16T20:27:47.862 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 536 k 2020-07-16T20:27:47.863 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 131 k 2020-07-16T20:27:47.863 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 204 k 2020-07-16T20:27:47.863 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 364 k 2020-07-16T20:27:47.864 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 335 k 2020-07-16T20:27:47.864 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 113 k 2020-07-16T20:27:47.864 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 87 k 2020-07-16T20:27:47.865 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.7 M 2020-07-16T20:27:47.865 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 161 k 2020-07-16T20:27:47.865 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 54 k 2020-07-16T20:27:47.866 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 3.5 M 2020-07-16T20:27:47.866 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.6 M 2020-07-16T20:27:47.866 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 27 k 2020-07-16T20:27:47.867 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-07-16T20:27:47.867 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-07-16T20:27:47.867 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-07-16T20:27:47.868 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-07-16T20:27:47.868 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-07-16T20:27:47.868 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-07-16T20:27:47.869 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-07-16T20:27:47.869 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-07-16T20:27:47.869 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2020-07-16T20:27:47.870 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.7 M 2020-07-16T20:27:47.870 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.0 M 2020-07-16T20:27:47.870 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-07-16T20:27:47.871 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-07-16T20:27:47.871 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-07-16T20:27:47.871 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-07-16T20:27:47.872 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2020-07-16T20:27:47.872 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 22 M 2020-07-16T20:27:47.872 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 2.1 M 2020-07-16T20:27:47.873 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 4.9 M 2020-07-16T20:27:47.873 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 18 M 2020-07-16T20:27:47.873 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 25 k 2020-07-16T20:27:47.874 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 484 k 2020-07-16T20:27:47.874 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 3.4 M 2020-07-16T20:27:47.874 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 40 k 2020-07-16T20:27:47.875 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_642:16.0.0-3565.g8e60ca350a5.el8 ceph 67 k 2020-07-16T20:27:47.875 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 24 k 2020-07-16T20:27:47.875 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 174 k 2020-07-16T20:27:47.876 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch2:16.0.0-3565.g8e60ca350a5.el8 ceph-noarch 8.8 k 2020-07-16T20:27:47.876 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-07-16T20:27:47.876 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-07-16T20:27:47.877 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-07-16T20:27:47.877 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-07-16T20:27:47.877 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-07-16T20:27:47.878 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-07-16T20:27:47.878 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-07-16T20:27:47.878 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-07-16T20:27:47.879 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-07-16T20:27:47.879 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-07-16T20:27:47.879 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-07-16T20:27:47.880 INFO:teuthology.orchestra.run.smithi022.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-07-16T20:27:47.880 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-07-16T20:27:47.880 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-07-16T20:27:47.881 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-07-16T20:27:47.881 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-07-16T20:27:47.882 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-07-16T20:27:47.882 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-07-16T20:27:47.882 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-07-16T20:27:47.883 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-07-16T20:27:47.883 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-07-16T20:27:47.883 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-07-16T20:27:47.883 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-07-16T20:27:47.884 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-07-16T20:27:47.884 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-07-16T20:27:47.884 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-07-16T20:27:47.884 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-07-16T20:27:47.884 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-07-16T20:27:47.885 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-07-16T20:27:47.885 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-07-16T20:27:47.885 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-07-16T20:27:47.885 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-07-16T20:27:47.885 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-07-16T20:27:47.886 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-07-16T20:27:47.886 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-07-16T20:27:47.886 INFO:teuthology.orchestra.run.smithi022.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-07-16T20:27:47.886 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-07-16T20:27:47.887 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-07-16T20:27:47.888 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-07-16T20:27:47.888 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-07-16T20:27:47.888 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-07-16T20:27:47.888 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-07-16T20:27:47.888 INFO:teuthology.orchestra.run.smithi022.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-07-16T20:27:47.889 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-07-16T20:27:47.889 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-07-16T20:27:47.889 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-07-16T20:27:47.890 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-07-16T20:27:47.890 INFO:teuthology.orchestra.run.smithi022.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-07-16T20:27:47.890 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-07-16T20:27:47.891 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-07-16T20:27:47.891 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-07-16T20:27:47.891 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-07-16T20:27:47.892 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-07-16T20:27:47.892 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-07-16T20:27:47.892 INFO:teuthology.orchestra.run.smithi022.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-07-16T20:27:47.893 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-07-16T20:27:47.893 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-07-16T20:27:47.894 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-07-16T20:27:47.894 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-07-16T20:27:47.894 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-07-16T20:27:47.895 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-07-16T20:27:47.895 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-07-16T20:27:47.896 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-07-16T20:27:47.896 INFO:teuthology.orchestra.run.smithi022.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-07-16T20:27:47.896 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-07-16T20:27:47.897 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-07-16T20:27:47.897 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-07-16T20:27:47.898 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-07-16T20:27:47.898 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-07-16T20:27:47.898 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-07-16T20:27:47.899 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme noarch0.5.2-4.el8 epel 26 k 2020-07-16T20:27:47.899 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-07-16T20:27:47.899 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-07-16T20:27:47.899 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-07-16T20:27:47.900 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-07-16T20:27:47.900 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-07-16T20:27:47.900 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-07-16T20:27:47.900 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2020-07-16T20:27:47.900 INFO:teuthology.orchestra.run.smithi022.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-07-16T20:27:47.901 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-07-16T20:27:47.901 INFO:teuthology.orchestra.run.smithi022.stdout:Downgrading: 2020-07-16T20:27:47.901 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-07-16T20:27:47.901 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-07-16T20:27:47.901 INFO:teuthology.orchestra.run.smithi022.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-07-16T20:27:47.902 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-07-16T20:27:47.902 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-07-16T20:27:47.902 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:27:47.917 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2020-07-16T20:27:47.917 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2020-07-16T20:27:47.918 INFO:teuthology.orchestra.run.smithi022.stdout:Install 126 Packages 2020-07-16T20:27:47.918 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 6 Packages 2020-07-16T20:27:47.918 INFO:teuthology.orchestra.run.smithi022.stdout:Downgrade 5 Packages 2020-07-16T20:27:47.918 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:27:47.919 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 195 M 2020-07-16T20:27:47.919 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2020-07-16T20:27:47.927 INFO:teuthology.orchestra.run.smithi116.stdout:(6/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 4.6 MB/s | 1.5 MB 00:00 2020-07-16T20:27:47.963 INFO:teuthology.orchestra.run.smithi022.stdout:(1/137): libkadm5-1.17-9.el8.x86_64.rpm 2.1 MB/s | 184 kB 00:00 2020-07-16T20:27:47.986 INFO:teuthology.orchestra.run.smithi022.stdout:(2/137): krb5-libs-1.17-9.el8.x86_64.rpm 7.7 MB/s | 851 kB 00:00 2020-07-16T20:27:47.998 INFO:teuthology.orchestra.run.smithi022.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 19 MB/s | 686 kB 00:00 2020-07-16T20:27:48.001 INFO:teuthology.orchestra.run.smithi022.stdout:(4/137): krb5-workstation-1.17-9.el8.x86_64.rpm 7.4 MB/s | 940 kB 00:00 2020-07-16T20:27:48.018 INFO:teuthology.orchestra.run.smithi022.stdout:(5/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 45 MB/s | 1.5 MB 00:00 2020-07-16T20:27:48.166 INFO:teuthology.orchestra.run.smithi022.stdout:(6/137): ceph-16.0.0-3565.g8e60ca350a5.el8.x86_ 38 kB/s | 6.5 kB 00:00 2020-07-16T20:27:48.271 INFO:teuthology.orchestra.run.smithi116.stdout:(7/137): ceph-base-16.0.0-3565.g8e60ca350a5.el8 9.9 MB/s | 6.0 MB 00:00 2020-07-16T20:27:48.326 INFO:teuthology.orchestra.run.smithi116.stdout:(8/137): ceph-immutable-object-cache-16.0.0-356 4.5 MB/s | 202 kB 00:00 2020-07-16T20:27:48.527 INFO:teuthology.orchestra.run.smithi116.stdout:(9/137): ceph-mds-16.0.0-3565.g8e60ca350a5.el8. 11 MB/s | 2.1 MB 00:00 2020-07-16T20:27:48.675 INFO:teuthology.orchestra.run.smithi116.stdout:(10/137): ceph-mgr-16.0.0-3565.g8e60ca350a5.el8 9.7 MB/s | 1.5 MB 00:00 2020-07-16T20:27:48.682 INFO:teuthology.orchestra.run.smithi116.stdout:(11/137): ceph-fuse-16.0.0-3565.g8e60ca350a5.el 800 kB/s | 604 kB 00:00 2020-07-16T20:27:48.683 INFO:teuthology.orchestra.run.smithi022.stdout:(7/137): ceph-fuse-16.0.0-3565.g8e60ca350a5.el8 1.1 MB/s | 604 kB 00:00 2020-07-16T20:27:48.920 INFO:teuthology.orchestra.run.smithi022.stdout:(8/137): ceph-immutable-object-cache-16.0.0-356 855 kB/s | 202 kB 00:00 2020-07-16T20:27:49.167 INFO:teuthology.orchestra.run.smithi116.stdout:(12/137): ceph-mon-16.0.0-3565.g8e60ca350a5.el8 9.9 MB/s | 4.9 MB 00:00 2020-07-16T20:27:49.665 INFO:teuthology.orchestra.run.smithi116.stdout:(13/137): ceph-common-16.0.0-3565.g8e60ca350a5. 12 MB/s | 22 MB 00:01 2020-07-16T20:27:49.709 INFO:teuthology.orchestra.run.smithi116.stdout:(14/137): ceph-selinux-16.0.0-3565.g8e60ca350a5 565 kB/s | 25 kB 00:00 2020-07-16T20:27:50.185 INFO:teuthology.orchestra.run.smithi116.stdout:(15/137): ceph-radosgw-16.0.0-3565.g8e60ca350a5 10 MB/s | 10 MB 00:01 2020-07-16T20:27:50.240 INFO:teuthology.orchestra.run.smithi116.stdout:(16/137): cephadm-16.0.0-3565.g8e60ca350a5.el8. 882 kB/s | 48 kB 00:00 2020-07-16T20:27:50.294 INFO:teuthology.orchestra.run.smithi116.stdout:(17/137): libcephfs-devel-16.0.0-3565.g8e60ca35 437 kB/s | 23 kB 00:00 2020-07-16T20:27:50.369 INFO:teuthology.orchestra.run.smithi116.stdout:(18/137): libcephfs2-16.0.0-3565.g8e60ca350a5.e 7.0 MB/s | 536 kB 00:00 2020-07-16T20:27:50.407 INFO:teuthology.orchestra.run.smithi022.stdout:(9/137): ceph-mds-16.0.0-3565.g8e60ca350a5.el8. 1.4 MB/s | 2.1 MB 00:01 2020-07-16T20:27:50.426 INFO:teuthology.orchestra.run.smithi116.stdout:(19/137): librados-devel-16.0.0-3565.g8e60ca350 2.2 MB/s | 131 kB 00:00 2020-07-16T20:27:50.500 INFO:teuthology.orchestra.run.smithi116.stdout:(20/137): libradosstriper1-16.0.0-3565.g8e60ca3 6.4 MB/s | 484 kB 00:00 2020-07-16T20:27:50.894 INFO:teuthology.orchestra.run.smithi116.stdout:(21/137): librgw2-16.0.0-3565.g8e60ca350a5.el8. 8.5 MB/s | 3.4 MB 00:00 2020-07-16T20:27:50.948 INFO:teuthology.orchestra.run.smithi116.stdout:(22/137): python3-ceph-argparse-16.0.0-3565.g8e 753 kB/s | 40 kB 00:00 2020-07-16T20:27:51.002 INFO:teuthology.orchestra.run.smithi116.stdout:(23/137): python3-ceph-common-16.0.0-3565.g8e60 1.2 MB/s | 67 kB 00:00 2020-07-16T20:27:51.062 INFO:teuthology.orchestra.run.smithi116.stdout:(24/137): python3-cephfs-16.0.0-3565.g8e60ca350 3.3 MB/s | 204 kB 00:00 2020-07-16T20:27:51.129 INFO:teuthology.orchestra.run.smithi116.stdout:(25/137): python3-rados-16.0.0-3565.g8e60ca350a 5.3 MB/s | 364 kB 00:00 2020-07-16T20:27:51.196 INFO:teuthology.orchestra.run.smithi116.stdout:(26/137): python3-rbd-16.0.0-3565.g8e60ca350a5. 4.9 MB/s | 335 kB 00:00 2020-07-16T20:27:51.255 INFO:teuthology.orchestra.run.smithi116.stdout:(27/137): python3-rgw-16.0.0-3565.g8e60ca350a5. 1.9 MB/s | 113 kB 00:00 2020-07-16T20:27:51.315 INFO:teuthology.orchestra.run.smithi116.stdout:(28/137): rbd-fuse-16.0.0-3565.g8e60ca350a5.el8 1.4 MB/s | 87 kB 00:00 2020-07-16T20:27:51.518 INFO:teuthology.orchestra.run.smithi022.stdout:(10/137): ceph-mgr-16.0.0-3565.g8e60ca350a5.el8 1.4 MB/s | 1.5 MB 00:01 2020-07-16T20:27:51.629 INFO:teuthology.orchestra.run.smithi116.stdout:(29/137): rbd-mirror-16.0.0-3565.g8e60ca350a5.e 8.7 MB/s | 2.7 MB 00:00 2020-07-16T20:27:51.684 INFO:teuthology.orchestra.run.smithi116.stdout:(30/137): rbd-nbd-16.0.0-3565.g8e60ca350a5.el8. 2.9 MB/s | 161 kB 00:00 2020-07-16T20:27:51.734 INFO:teuthology.orchestra.run.smithi116.stdout:(31/137): ceph-grafana-dashboards-16.0.0-3565.g 482 kB/s | 24 kB 00:00 2020-07-16T20:27:51.784 INFO:teuthology.orchestra.run.smithi116.stdout:(32/137): ceph-mgr-cephadm-16.0.0-3565.g8e60ca3 1.1 MB/s | 54 kB 00:00 2020-07-16T20:27:52.161 INFO:teuthology.orchestra.run.smithi116.stdout:(33/137): ceph-mgr-dashboard-16.0.0-3565.g8e60c 9.2 MB/s | 3.5 MB 00:00 2020-07-16T20:27:52.818 INFO:teuthology.orchestra.run.smithi116.stdout:(34/137): ceph-osd-16.0.0-3565.g8e60ca350a5.el8 4.3 MB/s | 18 MB 00:04 2020-07-16T20:27:52.891 INFO:teuthology.orchestra.run.smithi116.stdout:(35/137): ceph-mgr-modules-core-16.0.0-3565.g8e 2.3 MB/s | 174 kB 00:00 2020-07-16T20:27:52.959 INFO:teuthology.orchestra.run.smithi116.stdout:(36/137): ceph-mgr-rook-16.0.0-3565.g8e60ca350a 401 kB/s | 27 kB 00:00 2020-07-16T20:27:53.008 INFO:teuthology.orchestra.run.smithi116.stdout:(37/137): ceph-mgr-diskprediction-local-16.0.0- 10 MB/s | 8.6 MB 00:00 2020-07-16T20:27:53.010 INFO:teuthology.orchestra.run.smithi116.stdout:(38/137): ceph-prometheus-alerts-16.0.0-3565.g8 171 kB/s | 8.8 kB 00:00 2020-07-16T20:27:53.048 INFO:teuthology.orchestra.run.smithi116.stdout:(39/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-07-16T20:27:53.054 INFO:teuthology.orchestra.run.smithi116.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 53 MB/s | 320 kB 00:00 2020-07-16T20:27:53.058 INFO:teuthology.orchestra.run.smithi116.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 43 MB/s | 161 kB 00:00 2020-07-16T20:27:53.064 INFO:teuthology.orchestra.run.smithi116.stdout:(42/137): bison-3.0.4-10.el8.x86_64.rpm 14 MB/s | 688 kB 00:00 2020-07-16T20:27:53.066 INFO:teuthology.orchestra.run.smithi116.stdout:(43/137): librdkafka-0.11.4-1.el8.x86_64.rpm 45 MB/s | 353 kB 00:00 2020-07-16T20:27:53.072 INFO:teuthology.orchestra.run.smithi116.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 49 MB/s | 259 kB 00:00 2020-07-16T20:27:53.076 INFO:teuthology.orchestra.run.smithi116.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 40 MB/s | 188 kB 00:00 2020-07-16T20:27:53.083 INFO:teuthology.orchestra.run.smithi116.stdout:(46/137): libtool-2.4.6-25.el8.x86_64.rpm 38 MB/s | 709 kB 00:00 2020-07-16T20:27:53.157 INFO:teuthology.orchestra.run.smithi116.stdout:(47/137): openblas-0.3.3-2.el8.x86_64.rpm 53 MB/s | 4.3 MB 00:00 2020-07-16T20:27:53.220 INFO:teuthology.orchestra.run.smithi116.stdout:(48/137): openblas-threads-0.3.3-2.el8.x86_64.r 32 MB/s | 4.4 MB 00:00 2020-07-16T20:27:53.231 INFO:teuthology.orchestra.run.smithi116.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 21 MB/s | 214 kB 00:00 2020-07-16T20:27:53.247 INFO:teuthology.orchestra.run.smithi116.stdout:(50/137): python3-babel-2.5.1-5.el8.noarch.rpm 54 MB/s | 4.8 MB 00:00 2020-07-16T20:27:53.249 INFO:teuthology.orchestra.run.smithi116.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 8.8 MB/s | 27 kB 00:00 2020-07-16T20:27:53.251 INFO:teuthology.orchestra.run.smithi116.stdout:(52/137): python3-jinja2-2.10.1-2.el8_0.noarch. 26 MB/s | 538 kB 00:00 2020-07-16T20:27:53.262 INFO:teuthology.orchestra.run.smithi116.stdout:(53/137): python3-jsonpointer-1.10-11.el8.noarc 1.5 MB/s | 20 kB 00:00 2020-07-16T20:27:53.271 INFO:teuthology.orchestra.run.smithi116.stdout:(54/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 76 MB/s | 1.5 MB 00:00 2020-07-16T20:27:53.273 INFO:teuthology.orchestra.run.smithi116.stdout:(55/137): python3-mako-1.0.6-13.el8.noarch.rpm 15 MB/s | 157 kB 00:00 2020-07-16T20:27:53.273 INFO:teuthology.orchestra.run.smithi116.stdout:(56/137): python3-markupsafe-0.23-19.el8.x86_64 20 MB/s | 39 kB 00:00 2020-07-16T20:27:53.279 INFO:teuthology.orchestra.run.smithi116.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 38 MB/s | 225 kB 00:00 2020-07-16T20:27:53.285 INFO:teuthology.orchestra.run.smithi116.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 8.3 MB/s | 44 kB 00:00 2020-07-16T20:27:53.293 INFO:teuthology.orchestra.run.smithi116.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 16 MB/s | 126 kB 00:00 2020-07-16T20:27:53.299 INFO:teuthology.orchestra.run.smithi116.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 17 MB/s | 110 kB 00:00 2020-07-16T20:27:53.306 INFO:teuthology.orchestra.run.smithi116.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 8.2 MB/s | 54 kB 00:00 2020-07-16T20:27:53.330 INFO:teuthology.orchestra.run.smithi116.stdout:(62/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 66 MB/s | 3.7 MB 00:00 2020-07-16T20:27:53.333 INFO:teuthology.orchestra.run.smithi116.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 7.3 MB/s | 27 kB 00:00 2020-07-16T20:27:53.344 INFO:teuthology.orchestra.run.smithi116.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 43 MB/s | 457 kB 00:00 2020-07-16T20:27:53.352 INFO:teuthology.orchestra.run.smithi116.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 36 MB/s | 298 kB 00:00 2020-07-16T20:27:53.357 INFO:teuthology.orchestra.run.smithi116.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 12 MB/s | 54 kB 00:00 2020-07-16T20:27:53.363 INFO:teuthology.orchestra.run.smithi116.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 14 MB/s | 82 kB 00:00 2020-07-16T20:27:53.368 INFO:teuthology.orchestra.run.smithi116.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 4.5 MB/s | 21 kB 00:00 2020-07-16T20:27:53.372 INFO:teuthology.orchestra.run.smithi116.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 11 MB/s | 48 kB 00:00 2020-07-16T20:27:53.387 INFO:teuthology.orchestra.run.smithi116.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 37 MB/s | 548 kB 00:00 2020-07-16T20:27:53.392 INFO:teuthology.orchestra.run.smithi116.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 3.8 MB/s | 19 kB 00:00 2020-07-16T20:27:53.397 INFO:teuthology.orchestra.run.smithi116.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 7.2 MB/s | 38 kB 00:00 2020-07-16T20:27:53.415 INFO:teuthology.orchestra.run.smithi116.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 35 MB/s | 638 kB 00:00 2020-07-16T20:27:53.424 INFO:teuthology.orchestra.run.smithi116.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 20 MB/s | 169 kB 00:00 2020-07-16T20:27:53.430 INFO:teuthology.orchestra.run.smithi116.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 7.4 MB/s | 47 kB 00:00 2020-07-16T20:27:53.444 INFO:teuthology.orchestra.run.smithi116.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 22 MB/s | 199 kB 00:00 2020-07-16T20:27:53.450 INFO:teuthology.orchestra.run.smithi116.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 11 MB/s | 86 kB 00:00 2020-07-16T20:27:53.455 INFO:teuthology.orchestra.run.smithi116.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 12 MB/s | 95 kB 00:00 2020-07-16T20:27:53.462 INFO:teuthology.orchestra.run.smithi116.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 2.4 MB/s | 18 kB 00:00 2020-07-16T20:27:53.473 INFO:teuthology.orchestra.run.smithi116.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 23 MB/s | 249 kB 00:00 2020-07-16T20:27:53.561 INFO:teuthology.orchestra.run.smithi022.stdout:(11/137): ceph-common-16.0.0-3565.g8e60ca350a5. 4.0 MB/s | 22 MB 00:05 2020-07-16T20:27:53.571 INFO:teuthology.orchestra.run.smithi116.stdout:(81/137): python3-scipy-1.0.0-20.module_el8.1.0 55 MB/s | 15 MB 00:00 2020-07-16T20:27:53.648 INFO:teuthology.orchestra.run.smithi116.stdout:(82/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 13 MB/s | 2.3 MB 00:00 2020-07-16T20:27:53.649 INFO:teuthology.orchestra.run.smithi116.stdout:(83/137): pcre2-devel-10.32-1.el8.x86_64.rpm 7.6 MB/s | 605 kB 00:00 2020-07-16T20:27:53.674 INFO:teuthology.orchestra.run.smithi022.stdout:(12/137): ceph-base-16.0.0-3565.g8e60ca350a5.el 1.1 MB/s | 6.0 MB 00:05 2020-07-16T20:27:53.987 INFO:teuthology.orchestra.run.smithi116.stdout:(84/137): ceph-test-16.0.0-3565.g8e60ca350a5.el 10 MB/s | 45 MB 00:04 2020-07-16T20:27:53.989 INFO:teuthology.orchestra.run.smithi116.stdout:(85/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 667 kB/s | 228 kB 00:00 2020-07-16T20:27:53.994 INFO:teuthology.orchestra.run.smithi116.stdout:(86/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 637 kB/s | 220 kB 00:00 2020-07-16T20:27:53.995 INFO:teuthology.orchestra.run.smithi116.stdout:(87/137): python3-jwt-1.6.1-2.el8.noarch.rpm 22 MB/s | 43 kB 00:00 2020-07-16T20:27:53.997 INFO:teuthology.orchestra.run.smithi116.stdout:(88/137): python3-oauthlib-2.1.0-1.el8.noarch.r 56 MB/s | 155 kB 00:00 2020-07-16T20:27:53.998 INFO:teuthology.orchestra.run.smithi116.stdout:(89/137): python3-pysocks-1.6.8-3.el8.noarch.rp 12 MB/s | 34 kB 00:00 2020-07-16T20:27:54.001 INFO:teuthology.orchestra.run.smithi116.stdout:(90/137): python3-requests-2.20.0-2.1.el8_1.noa 54 MB/s | 123 kB 00:00 2020-07-16T20:27:54.001 INFO:teuthology.orchestra.run.smithi116.stdout:(91/137): python3-requests-oauthlib-1.0.0-1.el8 18 MB/s | 43 kB 00:00 2020-07-16T20:27:54.004 INFO:teuthology.orchestra.run.smithi116.stdout:(92/137): python3-urllib3-1.24.2-2.el8.noarch.r 58 MB/s | 176 kB 00:00 2020-07-16T20:27:54.005 INFO:teuthology.orchestra.run.smithi116.stdout:(93/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 21 MB/s | 69 kB 00:00 2020-07-16T20:27:54.005 INFO:teuthology.orchestra.run.smithi116.stdout:(94/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 37 MB/s | 56 kB 00:00 2020-07-16T20:27:54.035 INFO:teuthology.orchestra.run.smithi116.stdout:(95/137): python3-chardet-3.0.4-7.el8.noarch.rp 5.5 MB/s | 195 kB 00:00 2020-07-16T20:27:54.051 INFO:teuthology.orchestra.run.smithi022.stdout:(13/137): ceph-mon-16.0.0-3565.g8e60ca350a5.el8 1.9 MB/s | 4.9 MB 00:02 2020-07-16T20:27:54.077 INFO:teuthology.orchestra.run.smithi022.stdout:(14/137): ceph-selinux-16.0.0-3565.g8e60ca350a5 980 kB/s | 25 kB 00:00 2020-07-16T20:27:54.099 INFO:teuthology.orchestra.run.smithi116.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 2.3 MB/s | 181 kB 00:00 2020-07-16T20:27:54.100 INFO:teuthology.orchestra.run.smithi116.stdout:(97/137): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-07-16T20:27:54.116 INFO:teuthology.orchestra.run.smithi116.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 4.6 MB/s | 75 kB 00:00 2020-07-16T20:27:54.117 INFO:teuthology.orchestra.run.smithi116.stdout:(99/137): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-07-16T20:27:54.118 INFO:teuthology.orchestra.run.smithi116.stdout:(100/137): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-07-16T20:27:54.132 INFO:teuthology.orchestra.run.smithi116.stdout:(101/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-07-16T20:27:54.136 INFO:teuthology.orchestra.run.smithi116.stdout:(102/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-07-16T20:27:54.150 INFO:teuthology.orchestra.run.smithi116.stdout:(103/137): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-07-16T20:27:54.156 INFO:teuthology.orchestra.run.smithi116.stdout:(104/137): python3-certifi-2018.10.15-7.el8.noa 860 kB/s | 16 kB 00:00 2020-07-16T20:27:54.157 INFO:teuthology.orchestra.run.smithi116.stdout:(105/137): python3-beautifulsoup4-4.6.3-2.el8.1 4.8 MB/s | 185 kB 00:00 2020-07-16T20:27:54.165 INFO:teuthology.orchestra.run.smithi116.stdout:(106/137): python3-cheroot-8.2.1-1.el8.noarch.r 8.4 MB/s | 145 kB 00:00 2020-07-16T20:27:54.176 INFO:teuthology.orchestra.run.smithi116.stdout:(107/137): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-07-16T20:27:54.195 INFO:teuthology.orchestra.run.smithi116.stdout:(108/137): python3-cherrypy-18.4.0-1.el8.noarch 9.8 MB/s | 384 kB 00:00 2020-07-16T20:27:54.197 INFO:teuthology.orchestra.run.smithi116.stdout:(109/137): python3-execnet-1.7.1-1.el8.noarch.r 11 MB/s | 355 kB 00:00 2020-07-16T20:27:54.198 INFO:teuthology.orchestra.run.smithi116.stdout:(110/137): python3-google-auth-1.1.1-10.el8.noa 3.9 MB/s | 81 kB 00:00 2020-07-16T20:27:54.214 INFO:teuthology.orchestra.run.smithi116.stdout:(111/137): python3-jaraco-6.2-6.el8.noarch.rpm 585 kB/s | 11 kB 00:00 2020-07-16T20:27:54.216 INFO:teuthology.orchestra.run.smithi116.stdout:(112/137): python3-jaraco-functools-2.0-4.el8.n 929 kB/s | 18 kB 00:00 2020-07-16T20:27:54.233 INFO:teuthology.orchestra.run.smithi116.stdout:(113/137): python3-logutils-0.3.5-11.el8.noarch 2.4 MB/s | 49 kB 00:00 2020-07-16T20:27:54.236 INFO:teuthology.orchestra.run.smithi116.stdout:(114/137): python3-more-itertools-7.2.0-3.el8.n 3.0 MB/s | 59 kB 00:00 2020-07-16T20:27:54.248 INFO:teuthology.orchestra.run.smithi116.stdout:(115/137): python3-kubernetes-11.0.0-2.el8.noar 23 MB/s | 1.2 MB 00:00 2020-07-16T20:27:54.259 INFO:teuthology.orchestra.run.smithi116.stdout:(116/137): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-07-16T20:27:54.259 INFO:teuthology.orchestra.run.smithi116.stdout:(117/137): python3-portend-2.6-1.el8.noarch.rpm 816 kB/s | 16 kB 00:00 2020-07-16T20:27:54.264 INFO:teuthology.orchestra.run.smithi116.stdout:(118/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.9 MB/s | 48 kB 00:00 2020-07-16T20:27:54.274 INFO:teuthology.orchestra.run.smithi116.stdout:(119/137): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2020-07-16T20:27:54.276 INFO:teuthology.orchestra.run.smithi116.stdout:(120/137): python3-routes-2.4.1-12.el8.noarch.r 9.3 MB/s | 196 kB 00:00 2020-07-16T20:27:54.281 INFO:teuthology.orchestra.run.smithi116.stdout:(121/137): python3-rsa-3.4.2-12.el8.noarch.rpm 4.4 MB/s | 73 kB 00:00 2020-07-16T20:27:54.293 INFO:teuthology.orchestra.run.smithi116.stdout:(122/137): python3-simplegeneric-0.8.1-17.el8.n 976 kB/s | 19 kB 00:00 2020-07-16T20:27:54.297 INFO:teuthology.orchestra.run.smithi116.stdout:(123/137): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2020-07-16T20:27:54.297 INFO:teuthology.orchestra.run.smithi116.stdout:(124/137): python3-tempora-1.14.1-5.el8.noarch. 1.8 MB/s | 29 kB 00:00 2020-07-16T20:27:54.316 INFO:teuthology.orchestra.run.smithi116.stdout:(125/137): python3-trustme-0.5.2-4.el8.noarch.r 1.3 MB/s | 26 kB 00:00 2020-07-16T20:27:54.316 INFO:teuthology.orchestra.run.smithi116.stdout:(126/137): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-07-16T20:27:54.317 INFO:teuthology.orchestra.run.smithi116.stdout:(127/137): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-07-16T20:27:54.331 INFO:teuthology.orchestra.run.smithi116.stdout:(128/137): python3-webtest-2.0.33-1.el8.noarch. 5.1 MB/s | 85 kB 00:00 2020-07-16T20:27:54.332 INFO:teuthology.orchestra.run.smithi116.stdout:(129/137): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-07-16T20:27:54.335 INFO:teuthology.orchestra.run.smithi116.stdout:(130/137): python3-zc-lockfile-2.0-2.el8.noarch 1.2 MB/s | 23 kB 00:00 2020-07-16T20:27:54.348 INFO:teuthology.orchestra.run.smithi116.stdout:(131/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.2 MB/s | 69 kB 00:00 2020-07-16T20:27:54.376 INFO:teuthology.orchestra.run.smithi116.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 75 MB/s | 2.1 MB 00:00 2020-07-16T20:27:54.398 INFO:teuthology.orchestra.run.smithi116.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 79 MB/s | 1.7 MB 00:00 2020-07-16T20:27:54.400 INFO:teuthology.orchestra.run.smithi116.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 52 MB/s | 133 kB 00:00 2020-07-16T20:27:54.405 INFO:teuthology.orchestra.run.smithi116.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 64 MB/s | 308 kB 00:00 2020-07-16T20:27:54.671 INFO:teuthology.orchestra.run.smithi116.stdout:(136/137): librados2-16.0.0-3565.g8e60ca350a5.e 11 MB/s | 3.7 MB 00:00 2020-07-16T20:27:54.678 INFO:teuthology.orchestra.run.smithi116.stdout:(137/137): librbd1-16.0.0-3565.g8e60ca350a5.el8 5.9 MB/s | 2.0 MB 00:00 2020-07-16T20:27:54.681 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2020-07-16T20:27:54.682 INFO:teuthology.orchestra.run.smithi116.stdout:Total 27 MB/s | 195 MB 00:07 2020-07-16T20:27:54.744 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2020-07-16T20:27:54.920 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2020-07-16T20:27:54.920 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2020-07-16T20:27:55.967 INFO:teuthology.orchestra.run.smithi022.stdout:(15/137): ceph-osd-16.0.0-3565.g8e60ca350a5.el8 7.4 MB/s | 18 MB 00:02 2020-07-16T20:27:56.030 INFO:teuthology.orchestra.run.smithi022.stdout:(16/137): cephadm-16.0.0-3565.g8e60ca350a5.el8. 777 kB/s | 48 kB 00:00 2020-07-16T20:27:56.093 INFO:teuthology.orchestra.run.smithi022.stdout:(17/137): libcephfs-devel-16.0.0-3565.g8e60ca35 373 kB/s | 23 kB 00:00 2020-07-16T20:27:56.223 INFO:teuthology.orchestra.run.smithi022.stdout:(18/137): libcephfs2-16.0.0-3565.g8e60ca350a5.e 4.0 MB/s | 536 kB 00:00 2020-07-16T20:27:56.288 INFO:teuthology.orchestra.run.smithi022.stdout:(19/137): librados-devel-16.0.0-3565.g8e60ca350 2.0 MB/s | 131 kB 00:00 2020-07-16T20:27:56.430 INFO:teuthology.orchestra.run.smithi022.stdout:(20/137): libradosstriper1-16.0.0-3565.g8e60ca3 3.3 MB/s | 484 kB 00:00 2020-07-16T20:27:56.589 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2020-07-16T20:27:56.590 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2020-07-16T20:27:57.242 INFO:teuthology.orchestra.run.smithi022.stdout:(21/137): librgw2-16.0.0-3565.g8e60ca350a5.el8. 4.1 MB/s | 3.4 MB 00:00 2020-07-16T20:27:57.311 INFO:teuthology.orchestra.run.smithi022.stdout:(22/137): python3-ceph-argparse-16.0.0-3565.g8e 572 kB/s | 40 kB 00:00 2020-07-16T20:27:57.384 INFO:teuthology.orchestra.run.smithi022.stdout:(23/137): python3-ceph-common-16.0.0-3565.g8e60 933 kB/s | 67 kB 00:00 2020-07-16T20:27:57.459 INFO:teuthology.orchestra.run.smithi022.stdout:(24/137): python3-cephfs-16.0.0-3565.g8e60ca350 2.7 MB/s | 204 kB 00:00 2020-07-16T20:27:57.601 INFO:teuthology.orchestra.run.smithi022.stdout:(25/137): python3-rados-16.0.0-3565.g8e60ca350a 2.5 MB/s | 364 kB 00:00 2020-07-16T20:27:57.728 INFO:teuthology.orchestra.run.smithi022.stdout:(26/137): python3-rbd-16.0.0-3565.g8e60ca350a5. 2.6 MB/s | 335 kB 00:00 2020-07-16T20:27:57.804 INFO:teuthology.orchestra.run.smithi022.stdout:(27/137): python3-rgw-16.0.0-3565.g8e60ca350a5. 1.5 MB/s | 113 kB 00:00 2020-07-16T20:27:57.875 INFO:teuthology.orchestra.run.smithi022.stdout:(28/137): rbd-fuse-16.0.0-3565.g8e60ca350a5.el8 1.2 MB/s | 87 kB 00:00 2020-07-16T20:27:58.586 INFO:teuthology.orchestra.run.smithi022.stdout:(29/137): rbd-mirror-16.0.0-3565.g8e60ca350a5.e 3.8 MB/s | 2.7 MB 00:00 2020-07-16T20:27:58.667 INFO:teuthology.orchestra.run.smithi022.stdout:(30/137): rbd-nbd-16.0.0-3565.g8e60ca350a5.el8. 2.0 MB/s | 161 kB 00:00 2020-07-16T20:27:58.742 INFO:teuthology.orchestra.run.smithi022.stdout:(31/137): ceph-grafana-dashboards-16.0.0-3565.g 321 kB/s | 24 kB 00:00 2020-07-16T20:27:58.817 INFO:teuthology.orchestra.run.smithi022.stdout:(32/137): ceph-mgr-cephadm-16.0.0-3565.g8e60ca3 726 kB/s | 54 kB 00:00 2020-07-16T20:27:59.370 INFO:teuthology.orchestra.run.smithi022.stdout:(33/137): ceph-radosgw-16.0.0-3565.g8e60ca350a5 1.8 MB/s | 10 MB 00:05 2020-07-16T20:27:59.759 INFO:teuthology.orchestra.run.smithi022.stdout:(34/137): ceph-mgr-dashboard-16.0.0-3565.g8e60c 3.7 MB/s | 3.5 MB 00:00 2020-07-16T20:27:59.841 INFO:teuthology.orchestra.run.smithi022.stdout:(35/137): ceph-mgr-modules-core-16.0.0-3565.g8e 2.1 MB/s | 174 kB 00:00 2020-07-16T20:27:59.919 INFO:teuthology.orchestra.run.smithi022.stdout:(36/137): ceph-mgr-rook-16.0.0-3565.g8e60ca350a 345 kB/s | 27 kB 00:00 2020-07-16T20:28:00.006 INFO:teuthology.orchestra.run.smithi022.stdout:(37/137): ceph-prometheus-alerts-16.0.0-3565.g8 108 kB/s | 8.8 kB 00:00 2020-07-16T20:28:00.040 INFO:teuthology.orchestra.run.smithi022.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-07-16T20:28:00.049 INFO:teuthology.orchestra.run.smithi022.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 73 MB/s | 688 kB 00:00 2020-07-16T20:28:00.054 INFO:teuthology.orchestra.run.smithi022.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 67 MB/s | 320 kB 00:00 2020-07-16T20:28:00.057 INFO:teuthology.orchestra.run.smithi022.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 56 MB/s | 161 kB 00:00 2020-07-16T20:28:00.062 INFO:teuthology.orchestra.run.smithi022.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 70 MB/s | 353 kB 00:00 2020-07-16T20:28:00.072 INFO:teuthology.orchestra.run.smithi022.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 75 MB/s | 709 kB 00:00 2020-07-16T20:28:00.076 INFO:teuthology.orchestra.run.smithi022.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 61 MB/s | 259 kB 00:00 2020-07-16T20:28:00.079 INFO:teuthology.orchestra.run.smithi022.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 58 MB/s | 188 kB 00:00 2020-07-16T20:28:00.136 INFO:teuthology.orchestra.run.smithi022.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 83 MB/s | 4.3 MB 00:00 2020-07-16T20:28:00.185 INFO:teuthology.orchestra.run.smithi022.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 82 MB/s | 4.4 MB 00:00 2020-07-16T20:28:00.247 INFO:teuthology.orchestra.run.smithi022.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 82 MB/s | 4.8 MB 00:00 2020-07-16T20:28:00.248 INFO:teuthology.orchestra.run.smithi022.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 60 MB/s | 214 kB 00:00 2020-07-16T20:28:00.254 INFO:teuthology.orchestra.run.smithi022.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 76 MB/s | 538 kB 00:00 2020-07-16T20:28:00.256 INFO:teuthology.orchestra.run.smithi022.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 14 MB/s | 27 kB 00:00 2020-07-16T20:28:00.258 INFO:teuthology.orchestra.run.smithi022.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 18 MB/s | 20 kB 00:00 2020-07-16T20:28:00.276 INFO:teuthology.orchestra.run.smithi022.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 81 MB/s | 1.5 MB 00:00 2020-07-16T20:28:00.280 INFO:teuthology.orchestra.run.smithi022.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 56 MB/s | 157 kB 00:00 2020-07-16T20:28:00.281 INFO:teuthology.orchestra.run.smithi022.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 29 MB/s | 39 kB 00:00 2020-07-16T20:28:00.327 INFO:teuthology.orchestra.run.smithi022.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 82 MB/s | 3.7 MB 00:00 2020-07-16T20:28:00.330 INFO:teuthology.orchestra.run.smithi022.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 59 MB/s | 225 kB 00:00 2020-07-16T20:28:00.332 INFO:teuthology.orchestra.run.smithi022.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 34 MB/s | 44 kB 00:00 2020-07-16T20:28:00.334 INFO:teuthology.orchestra.run.smithi022.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 55 MB/s | 126 kB 00:00 2020-07-16T20:28:00.336 INFO:teuthology.orchestra.run.smithi022.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 52 MB/s | 110 kB 00:00 2020-07-16T20:28:00.338 INFO:teuthology.orchestra.run.smithi022.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 34 MB/s | 54 kB 00:00 2020-07-16T20:28:00.606 INFO:teuthology.orchestra.run.smithi022.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 54 MB/s | 15 MB 00:00 2020-07-16T20:28:00.607 INFO:teuthology.orchestra.run.smithi022.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 20 MB/s | 27 kB 00:00 2020-07-16T20:28:00.613 INFO:teuthology.orchestra.run.smithi022.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 73 MB/s | 457 kB 00:00 2020-07-16T20:28:00.618 INFO:teuthology.orchestra.run.smithi022.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 71 MB/s | 298 kB 00:00 2020-07-16T20:28:00.619 INFO:teuthology.orchestra.run.smithi022.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 38 MB/s | 54 kB 00:00 2020-07-16T20:28:00.621 INFO:teuthology.orchestra.run.smithi022.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 47 MB/s | 82 kB 00:00 2020-07-16T20:28:00.622 INFO:teuthology.orchestra.run.smithi022.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2020-07-16T20:28:00.624 INFO:teuthology.orchestra.run.smithi022.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 34 MB/s | 48 kB 00:00 2020-07-16T20:28:00.631 INFO:teuthology.orchestra.run.smithi022.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 72 MB/s | 548 kB 00:00 2020-07-16T20:28:00.633 INFO:teuthology.orchestra.run.smithi022.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 14 MB/s | 19 kB 00:00 2020-07-16T20:28:00.634 INFO:teuthology.orchestra.run.smithi022.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 36 MB/s | 38 kB 00:00 2020-07-16T20:28:00.642 INFO:teuthology.orchestra.run.smithi022.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 77 MB/s | 638 kB 00:00 2020-07-16T20:28:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 61 MB/s | 169 kB 00:00 2020-07-16T20:28:00.646 INFO:teuthology.orchestra.run.smithi022.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 39 MB/s | 47 kB 00:00 2020-07-16T20:28:00.649 INFO:teuthology.orchestra.run.smithi022.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 67 MB/s | 199 kB 00:00 2020-07-16T20:28:00.651 INFO:teuthology.orchestra.run.smithi022.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 52 MB/s | 86 kB 00:00 2020-07-16T20:28:00.653 INFO:teuthology.orchestra.run.smithi022.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 52 MB/s | 95 kB 00:00 2020-07-16T20:28:00.654 INFO:teuthology.orchestra.run.smithi022.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 15 MB/s | 18 kB 00:00 2020-07-16T20:28:00.658 INFO:teuthology.orchestra.run.smithi022.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 69 MB/s | 249 kB 00:00 2020-07-16T20:28:00.686 INFO:teuthology.orchestra.run.smithi022.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 83 MB/s | 2.3 MB 00:00 2020-07-16T20:28:00.694 INFO:teuthology.orchestra.run.smithi022.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 75 MB/s | 605 kB 00:00 2020-07-16T20:28:00.697 INFO:teuthology.orchestra.run.smithi022.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 67 MB/s | 228 kB 00:00 2020-07-16T20:28:00.701 INFO:teuthology.orchestra.run.smithi022.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 65 MB/s | 220 kB 00:00 2020-07-16T20:28:00.704 INFO:teuthology.orchestra.run.smithi022.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 65 MB/s | 195 kB 00:00 2020-07-16T20:28:00.705 INFO:teuthology.orchestra.run.smithi022.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 36 MB/s | 43 kB 00:00 2020-07-16T20:28:00.708 INFO:teuthology.orchestra.run.smithi022.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 53 MB/s | 155 kB 00:00 2020-07-16T20:28:00.709 INFO:teuthology.orchestra.run.smithi022.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 31 MB/s | 34 kB 00:00 2020-07-16T20:28:00.712 INFO:teuthology.orchestra.run.smithi022.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 56 MB/s | 123 kB 00:00 2020-07-16T20:28:00.713 INFO:teuthology.orchestra.run.smithi022.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 32 MB/s | 43 kB 00:00 2020-07-16T20:28:00.716 INFO:teuthology.orchestra.run.smithi022.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 63 MB/s | 176 kB 00:00 2020-07-16T20:28:00.718 INFO:teuthology.orchestra.run.smithi022.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 45 MB/s | 69 kB 00:00 2020-07-16T20:28:00.720 INFO:teuthology.orchestra.run.smithi022.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 42 MB/s | 56 kB 00:00 2020-07-16T20:28:00.814 INFO:teuthology.orchestra.run.smithi022.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-07-16T20:28:00.853 INFO:teuthology.orchestra.run.smithi022.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 7.9 MB/s | 315 kB 00:00 2020-07-16T20:28:00.874 INFO:teuthology.orchestra.run.smithi022.stdout:(96/137): leveldb-1.22-1.el8.x86_64.rpm 8.8 MB/s | 181 kB 00:00 2020-07-16T20:28:00.893 INFO:teuthology.orchestra.run.smithi022.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 3.0 MB/s | 59 kB 00:00 2020-07-16T20:28:00.912 INFO:teuthology.orchestra.run.smithi022.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 3.8 MB/s | 75 kB 00:00 2020-07-16T20:28:00.931 INFO:teuthology.orchestra.run.smithi022.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-07-16T20:28:00.951 INFO:teuthology.orchestra.run.smithi022.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.2 MB/s | 44 kB 00:00 2020-07-16T20:28:00.971 INFO:teuthology.orchestra.run.smithi022.stdout:(101/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.9 MB/s | 185 kB 00:00 2020-07-16T20:28:00.990 INFO:teuthology.orchestra.run.smithi022.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-07-16T20:28:01.011 INFO:teuthology.orchestra.run.smithi022.stdout:(103/137): python3-certifi-2018.10.15-7.el8.noa 859 kB/s | 16 kB 00:00 2020-07-16T20:28:01.030 INFO:teuthology.orchestra.run.smithi022.stdout:(104/137): python3-cheroot-8.2.1-1.el8.noarch.r 7.1 MB/s | 145 kB 00:00 2020-07-16T20:28:01.068 INFO:teuthology.orchestra.run.smithi022.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 9.8 MB/s | 384 kB 00:00 2020-07-16T20:28:01.087 INFO:teuthology.orchestra.run.smithi022.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.1 MB/s | 40 kB 00:00 2020-07-16T20:28:01.109 INFO:teuthology.orchestra.run.smithi022.stdout:(107/137): python3-execnet-1.7.1-1.el8.noarch.r 16 MB/s | 355 kB 00:00 2020-07-16T20:28:01.128 INFO:teuthology.orchestra.run.smithi022.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 4.1 MB/s | 81 kB 00:00 2020-07-16T20:28:01.148 INFO:teuthology.orchestra.run.smithi022.stdout:(109/137): python3-jaraco-6.2-6.el8.noarch.rpm 591 kB/s | 11 kB 00:00 2020-07-16T20:28:01.167 INFO:teuthology.orchestra.run.smithi022.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 920 kB/s | 18 kB 00:00 2020-07-16T20:28:01.230 INFO:teuthology.orchestra.run.smithi022.stdout:(111/137): python3-kubernetes-11.0.0-2.el8.noar 19 MB/s | 1.2 MB 00:00 2020-07-16T20:28:01.250 INFO:teuthology.orchestra.run.smithi022.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.5 MB/s | 49 kB 00:00 2020-07-16T20:28:01.268 INFO:teuthology.orchestra.run.smithi022.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 3.0 MB/s | 59 kB 00:00 2020-07-16T20:28:01.288 INFO:teuthology.orchestra.run.smithi022.stdout:(114/137): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2020-07-16T20:28:01.310 INFO:teuthology.orchestra.run.smithi022.stdout:(115/137): python3-portend-2.6-1.el8.noarch.rpm 816 kB/s | 16 kB 00:00 2020-07-16T20:28:01.329 INFO:teuthology.orchestra.run.smithi022.stdout:(116/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.4 MB/s | 48 kB 00:00 2020-07-16T20:28:01.346 INFO:teuthology.orchestra.run.smithi022.stdout:(117/137): python3-repoze-lru-0.7-6.el8.noarch. 1.7 MB/s | 34 kB 00:00 2020-07-16T20:28:01.367 INFO:teuthology.orchestra.run.smithi022.stdout:(118/137): python3-routes-2.4.1-12.el8.noarch.r 9.4 MB/s | 196 kB 00:00 2020-07-16T20:28:01.386 INFO:teuthology.orchestra.run.smithi022.stdout:(119/137): python3-rsa-3.4.2-12.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-07-16T20:28:01.406 INFO:teuthology.orchestra.run.smithi022.stdout:(120/137): python3-simplegeneric-0.8.1-17.el8.n 989 kB/s | 19 kB 00:00 2020-07-16T20:28:01.425 INFO:teuthology.orchestra.run.smithi022.stdout:(121/137): python3-singledispatch-3.4.0.3-18.el 1.2 MB/s | 24 kB 00:00 2020-07-16T20:28:01.444 INFO:teuthology.orchestra.run.smithi022.stdout:(122/137): python3-tempora-1.14.1-5.el8.noarch. 1.5 MB/s | 29 kB 00:00 2020-07-16T20:28:01.463 INFO:teuthology.orchestra.run.smithi022.stdout:(123/137): python3-trustme-0.5.2-4.el8.noarch.r 1.4 MB/s | 26 kB 00:00 2020-07-16T20:28:01.484 INFO:teuthology.orchestra.run.smithi022.stdout:(124/137): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-07-16T20:28:01.505 INFO:teuthology.orchestra.run.smithi022.stdout:(125/137): python3-webob-1.8.5-1.el8.1.noarch.r 12 MB/s | 251 kB 00:00 2020-07-16T20:28:01.525 INFO:teuthology.orchestra.run.smithi022.stdout:(126/137): python3-websocket-client-0.56.0-5.el 3.1 MB/s | 61 kB 00:00 2020-07-16T20:28:01.546 INFO:teuthology.orchestra.run.smithi022.stdout:(127/137): python3-webtest-2.0.33-1.el8.noarch. 4.2 MB/s | 85 kB 00:00 2020-07-16T20:28:01.564 INFO:teuthology.orchestra.run.smithi022.stdout:(128/137): python3-zc-lockfile-2.0-2.el8.noarch 1.2 MB/s | 23 kB 00:00 2020-07-16T20:28:01.581 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2020-07-16T20:28:01.583 INFO:teuthology.orchestra.run.smithi022.stdout:(129/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-07-16T20:28:01.784 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-07-16T20:28:01.984 INFO:teuthology.orchestra.run.smithi116.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:02.064 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:02.246 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-07-16T20:28:02.398 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-07-16T20:28:02.566 INFO:teuthology.orchestra.run.smithi022.stdout:(130/137): librados2-16.0.0-3565.g8e60ca350a5.e 3.8 MB/s | 3.7 MB 00:00 2020-07-16T20:28:02.631 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-07-16T20:28:02.773 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:02.849 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:03.014 INFO:teuthology.orchestra.run.smithi022.stdout:(131/137): librbd1-16.0.0-3565.g8e60ca350a5.el8 4.5 MB/s | 2.0 MB 00:00 2020-07-16T20:28:03.042 INFO:teuthology.orchestra.run.smithi022.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 80 MB/s | 2.1 MB 00:00 2020-07-16T20:28:03.054 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-07-16T20:28:03.066 INFO:teuthology.orchestra.run.smithi022.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 78 MB/s | 1.7 MB 00:00 2020-07-16T20:28:03.067 INFO:teuthology.orchestra.run.smithi022.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 57 MB/s | 133 kB 00:00 2020-07-16T20:28:03.072 INFO:teuthology.orchestra.run.smithi022.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 68 MB/s | 308 kB 00:00 2020-07-16T20:28:03.223 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:03.242 INFO:teuthology.orchestra.run.smithi022.stdout:(136/137): ceph-mgr-diskprediction-local-16.0.0 2.2 MB/s | 8.6 MB 00:03 2020-07-16T20:28:03.625 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:03.781 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:04.017 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:04.223 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:04.311 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:04.558 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:05.021 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 11/148 2020-07-16T20:28:05.181 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:05.366 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:05.610 INFO:teuthology.orchestra.run.smithi116.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-07-16T20:28:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:(137/137): ceph-test-16.0.0-3565.g8e60ca350a5.e 3.8 MB/s | 45 MB 00:11 2020-07-16T20:28:05.692 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2020-07-16T20:28:05.692 INFO:teuthology.orchestra.run.smithi022.stdout:Total 11 MB/s | 195 MB 00:17 2020-07-16T20:28:05.772 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2020-07-16T20:28:05.793 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-07-16T20:28:05.970 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2020-07-16T20:28:05.971 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2020-07-16T20:28:06.007 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-07-16T20:28:06.200 INFO:teuthology.orchestra.run.smithi116.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-07-16T20:28:06.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:06.734 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:07.031 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:07.095 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:07.394 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:07.546 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2020-07-16T20:28:07.546 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2020-07-16T20:28:07.631 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:07.732 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:07.954 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-07-16T20:28:08.124 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-07-16T20:28:08.305 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-07-16T20:28:08.514 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-07-16T20:28:08.698 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:08.835 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:09.039 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:09.575 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:09.714 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:10.277 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:10.413 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:11.106 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:11.440 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-07-16T20:28:11.644 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-07-16T20:28:11.817 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-07-16T20:28:11.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-07-16T20:28:12.100 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 32/148 2020-07-16T20:28:12.349 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 33/148 2020-07-16T20:28:12.717 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2020-07-16T20:28:12.930 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-07-16T20:28:13.116 INFO:teuthology.orchestra.run.smithi022.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:13.192 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-07-16T20:28:13.261 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/148 2020-07-16T20:28:13.506 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-07-16T20:28:13.660 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-07-16T20:28:13.827 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-07-16T20:28:13.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:13.998 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 35/148 2020-07-16T20:28:14.052 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-07-16T20:28:14.302 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 36/148 2020-07-16T20:28:14.318 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-07-16T20:28:14.505 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:14.540 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:14.948 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-07-16T20:28:15.134 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:15.375 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 8/148 2020-07-16T20:28:15.642 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:15.752 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 9/148 2020-07-16T20:28:15.890 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:15.991 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 10/148 2020-07-16T20:28:16.458 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:16.484 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 11/148 2020-07-16T20:28:16.657 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:16.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 38/148 2020-07-16T20:28:16.841 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:28:16.992 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 39/148 2020-07-16T20:28:17.080 INFO:teuthology.orchestra.run.smithi022.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-07-16T20:28:17.215 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 40/148 2020-07-16T20:28:17.272 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-07-16T20:28:17.476 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/148 2020-07-16T20:28:17.483 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-07-16T20:28:17.666 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 42/148 2020-07-16T20:28:17.748 INFO:teuthology.orchestra.run.smithi022.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-07-16T20:28:17.873 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 43/148 2020-07-16T20:28:17.898 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:18.059 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 44/148 2020-07-16T20:28:18.250 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 17/148 2020-07-16T20:28:18.281 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 45/148 2020-07-16T20:28:18.470 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 46/148 2020-07-16T20:28:18.573 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:18.660 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-07-16T20:28:18.675 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-07-16T20:28:18.976 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:19.216 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:19.271 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/148 2020-07-16T20:28:19.330 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-07-16T20:28:19.538 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-07-16T20:28:19.554 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 49/148 2020-07-16T20:28:19.694 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 50/148 2020-07-16T20:28:19.717 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-07-16T20:28:19.866 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-07-16T20:28:19.875 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/148 2020-07-16T20:28:20.021 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-07-16T20:28:20.040 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/148 2020-07-16T20:28:20.173 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:20.265 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/148 2020-07-16T20:28:20.459 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-07-16T20:28:20.490 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/148 2020-07-16T20:28:20.657 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/148 2020-07-16T20:28:20.826 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/148 2020-07-16T20:28:20.931 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:21.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/148 2020-07-16T20:28:21.216 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 58/148 2020-07-16T20:28:21.401 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/148 2020-07-16T20:28:21.508 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-07-16T20:28:21.623 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/148 2020-07-16T20:28:21.648 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:21.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 61/148 2020-07-16T20:28:22.036 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/148 2020-07-16T20:28:22.211 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/148 2020-07-16T20:28:22.241 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-07-16T20:28:22.397 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:22.403 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/148 2020-07-16T20:28:22.597 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/148 2020-07-16T20:28:22.794 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/148 2020-07-16T20:28:23.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/148 2020-07-16T20:28:23.150 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-07-16T20:28:23.268 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/148 2020-07-16T20:28:23.479 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 69/148 2020-07-16T20:28:23.596 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-07-16T20:28:23.694 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/148 2020-07-16T20:28:23.812 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-07-16T20:28:23.877 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 71/148 2020-07-16T20:28:23.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-07-16T20:28:24.082 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 72/148 2020-07-16T20:28:24.154 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-07-16T20:28:24.326 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 32/148 2020-07-16T20:28:24.367 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 73/148 2020-07-16T20:28:24.549 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 33/148 2020-07-16T20:28:24.562 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 74/148 2020-07-16T20:28:24.759 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 75/148 2020-07-16T20:28:25.511 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/148 2020-07-16T20:28:25.789 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/148 2020-07-16T20:28:25.812 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 35/148 2020-07-16T20:28:26.056 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 77/148 2020-07-16T20:28:26.098 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 36/148 2020-07-16T20:28:26.263 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 78/148 2020-07-16T20:28:26.288 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:26.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 79/148 2020-07-16T20:28:26.705 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 80/148 2020-07-16T20:28:26.843 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/148 2020-07-16T20:28:27.035 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 82/148 2020-07-16T20:28:27.318 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 83/148 2020-07-16T20:28:27.570 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 84/148 2020-07-16T20:28:27.740 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 85/148 2020-07-16T20:28:27.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 86/148 2020-07-16T20:28:28.217 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 87/148 2020-07-16T20:28:28.217 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 88/148 2020-07-16T20:28:28.217 INFO:teuthology.orchestra.run.smithi116.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-07-16T20:28:28.218 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:28:28.354 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 37/148 2020-07-16T20:28:28.614 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.7-12.el8.x86_64 89/148 2020-07-16T20:28:28.651 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 38/148 2020-07-16T20:28:28.884 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 90/148 2020-07-16T20:28:28.915 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 39/148 2020-07-16T20:28:29.100 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 91/148 2020-07-16T20:28:29.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 40/148 2020-07-16T20:28:29.398 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/148 2020-07-16T20:28:29.487 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 92/148 2020-07-16T20:28:29.584 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 42/148 2020-07-16T20:28:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 93/148 2020-07-16T20:28:29.772 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 43/148 2020-07-16T20:28:29.964 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 44/148 2020-07-16T20:28:30.059 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 94/148 2020-07-16T20:28:30.160 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 45/148 2020-07-16T20:28:30.314 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 46/148 2020-07-16T20:28:30.338 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 95/148 2020-07-16T20:28:30.525 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/148 2020-07-16T20:28:30.545 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/148 2020-07-16T20:28:30.743 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/148 2020-07-16T20:28:30.795 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 48/148 2020-07-16T20:28:30.936 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/148 2020-07-16T20:28:31.047 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 49/148 2020-07-16T20:28:31.071 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:31.150 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:31.196 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 50/148 2020-07-16T20:28:31.368 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/148 2020-07-16T20:28:31.440 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.5-12.el8.x86_64 100/148 2020-07-16T20:28:31.684 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/148 2020-07-16T20:28:31.712 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.1-6.el8.noarch 101/148 2020-07-16T20:28:31.825 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 102/148 2020-07-16T20:28:31.900 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/148 2020-07-16T20:28:32.030 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 103/148 2020-07-16T20:28:32.143 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/148 2020-07-16T20:28:32.292 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 55/148 2020-07-16T20:28:32.311 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 104/148 2020-07-16T20:28:32.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 56/148 2020-07-16T20:28:32.647 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 57/148 2020-07-16T20:28:32.826 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 58/148 2020-07-16T20:28:32.977 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/148 2020-07-16T20:28:33.250 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/148 2020-07-16T20:28:33.491 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 61/148 2020-07-16T20:28:33.679 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 62/148 2020-07-16T20:28:33.838 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 63/148 2020-07-16T20:28:34.040 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 64/148 2020-07-16T20:28:34.241 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 65/148 2020-07-16T20:28:34.412 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 66/148 2020-07-16T20:28:34.642 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 67/148 2020-07-16T20:28:34.879 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 68/148 2020-07-16T20:28:35.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 69/148 2020-07-16T20:28:35.297 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 70/148 2020-07-16T20:28:35.471 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 71/148 2020-07-16T20:28:35.679 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 72/148 2020-07-16T20:28:35.887 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:35.944 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 73/148 2020-07-16T20:28:36.127 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:36.296 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 74/148 2020-07-16T20:28:36.470 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 75/148 2020-07-16T20:28:36.850 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:37.162 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:28:37.260 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:28:37.435 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:28:37.595 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/148 2020-07-16T20:28:37.877 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 77/148 2020-07-16T20:28:38.100 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 78/148 2020-07-16T20:28:38.429 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 79/148 2020-07-16T20:28:38.606 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 80/148 2020-07-16T20:28:38.736 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 81/148 2020-07-16T20:28:39.043 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 82/148 2020-07-16T20:28:39.317 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 83/148 2020-07-16T20:28:39.524 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 84/148 2020-07-16T20:28:39.708 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 85/148 2020-07-16T20:28:39.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 86/148 2020-07-16T20:28:40.173 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 87/148 2020-07-16T20:28:40.173 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 88/148 2020-07-16T20:28:40.174 INFO:teuthology.orchestra.run.smithi022.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-07-16T20:28:40.174 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:28:40.590 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.7-12.el8.x86_64 89/148 2020-07-16T20:28:40.842 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 90/148 2020-07-16T20:28:41.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 91/148 2020-07-16T20:28:41.457 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 92/148 2020-07-16T20:28:41.705 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 93/148 2020-07-16T20:28:42.054 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 94/148 2020-07-16T20:28:42.429 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 95/148 2020-07-16T20:28:42.593 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/148 2020-07-16T20:28:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/148 2020-07-16T20:28:42.999 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/148 2020-07-16T20:28:43.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:43.242 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 99/148 2020-07-16T20:28:43.548 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.5-12.el8.x86_64 100/148 2020-07-16T20:28:43.812 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.1-6.el8.noarch 101/148 2020-07-16T20:28:43.961 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 102/148 2020-07-16T20:28:44.171 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 103/148 2020-07-16T20:28:44.412 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 104/148 2020-07-16T20:28:48.330 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:48.552 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:49.315 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 105/148 2020-07-16T20:28:49.603 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:28:49.701 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 106/148 2020-07-16T20:28:49.818 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:28:54.267 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:28:54.267 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2020-07-16T20:28:54.268 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2020-07-16T20:28:54.268 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2020-07-16T20:28:54.268 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /run 2020-07-16T20:28:54.269 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2020-07-16T20:28:54.269 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2020-07-16T20:28:54.269 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2020-07-16T20:28:54.270 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2020-07-16T20:28:54.270 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2020-07-16T20:28:54.271 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:28:54.624 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:28:55.045 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:28:55.249 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:28:56.759 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:28:56.974 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:28:56.997 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:28:58.804 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:28:58.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:28:59.156 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:00.017 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:00.291 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:01.335 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:01.523 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:01.594 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:01.976 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 115/148 2020-07-16T20:29:02.184 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:02.212 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:02.364 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:02.378 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:03.405 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 118/148 2020-07-16T20:29:03.615 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:03.934 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:04.189 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:07.216 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 107/148 2020-07-16T20:29:07.217 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2020-07-16T20:29:07.217 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2020-07-16T20:29:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2020-07-16T20:29:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /run 2020-07-16T20:29:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2020-07-16T20:29:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2020-07-16T20:29:07.218 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2020-07-16T20:29:07.219 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2020-07-16T20:29:07.219 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2020-07-16T20:29:07.219 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:07.612 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:08.058 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 108/148 2020-07-16T20:29:08.266 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:08.593 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:09.529 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 121/148 2020-07-16T20:29:09.663 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:09.728 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:09.875 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 109/148 2020-07-16T20:29:10.048 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:10.074 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 110/148 2020-07-16T20:29:10.595 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 123/148 2020-07-16T20:29:10.869 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-07-16T20:29:11.050 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-07-16T20:29:11.232 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 126/148 2020-07-16T20:29:11.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-07-16T20:29:11.496 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:11.562 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-07-16T20:29:11.674 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 111/148 2020-07-16T20:29:11.906 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:12.023 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-07-16T20:29:12.379 INFO:teuthology.orchestra.run.smithi116.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-07-16T20:29:12.578 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 131/148 2020-07-16T20:29:12.814 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 132/148 2020-07-16T20:29:12.835 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 112/148 2020-07-16T20:29:12.999 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:13.113 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:13.115 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:13.364 INFO:teuthology.orchestra.run.smithi116.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-07-16T20:29:13.538 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-07-16T20:29:13.721 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:13.804 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:13.987 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:14.006 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:14.205 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-07-16T20:29:14.223 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 113/148 2020-07-16T20:29:14.322 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-07-16T20:29:14.450 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-07-16T20:29:14.489 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:14.564 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 114/148 2020-07-16T20:29:14.649 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-07-16T20:29:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-07-16T20:29:14.872 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:15.057 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 115/148 2020-07-16T20:29:15.114 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:15.231 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:15.240 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:15.243 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:15.243 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:15.269 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 116/148 2020-07-16T20:29:15.447 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:15.462 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 117/148 2020-07-16T20:29:15.474 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:15.475 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:15.707 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:15.707 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:15.923 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:15.924 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:16.545 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 118/148 2020-07-16T20:29:16.739 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:16.819 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:16.819 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-07-16T20:29:16.820 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-07-16T20:29:16.820 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-07-16T20:29:16.820 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-07-16T20:29:16.821 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-07-16T20:29:16.821 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-07-16T20:29:16.821 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-07-16T20:29:16.822 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-07-16T20:29:16.822 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-07-16T20:29:16.822 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-07-16T20:29:16.823 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 11/148 2020-07-16T20:29:16.823 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:29:16.824 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 13/148 2020-07-16T20:29:16.824 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 14/148 2020-07-16T20:29:16.824 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 15/148 2020-07-16T20:29:16.825 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 16/148 2020-07-16T20:29:16.825 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 17/148 2020-07-16T20:29:16.825 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 18/148 2020-07-16T20:29:16.826 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 19/148 2020-07-16T20:29:16.826 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 20/148 2020-07-16T20:29:16.826 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 21/148 2020-07-16T20:29:16.827 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 22/148 2020-07-16T20:29:16.827 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 23/148 2020-07-16T20:29:16.827 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 24/148 2020-07-16T20:29:16.828 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 25/148 2020-07-16T20:29:16.828 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 26/148 2020-07-16T20:29:16.828 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 27/148 2020-07-16T20:29:16.829 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 28/148 2020-07-16T20:29:16.829 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 29/148 2020-07-16T20:29:16.829 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 30/148 2020-07-16T20:29:16.830 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 31/148 2020-07-16T20:29:16.830 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 32/148 2020-07-16T20:29:16.830 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 33/148 2020-07-16T20:29:16.831 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 34/148 2020-07-16T20:29:16.831 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 35/148 2020-07-16T20:29:16.832 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 36/148 2020-07-16T20:29:16.832 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 37/148 2020-07-16T20:29:16.832 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 38/148 2020-07-16T20:29:16.833 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 39/148 2020-07-16T20:29:16.833 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 40/148 2020-07-16T20:29:16.833 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 41/148 2020-07-16T20:29:16.834 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 42/148 2020-07-16T20:29:16.834 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 43/148 2020-07-16T20:29:16.834 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 44/148 2020-07-16T20:29:16.835 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-07-16T20:29:16.835 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-07-16T20:29:16.835 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-07-16T20:29:16.836 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-07-16T20:29:16.836 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-07-16T20:29:16.836 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-07-16T20:29:16.837 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-07-16T20:29:16.837 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-07-16T20:29:16.837 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-07-16T20:29:16.838 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-07-16T20:29:16.838 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-07-16T20:29:16.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-07-16T20:29:16.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-07-16T20:29:16.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-07-16T20:29:16.840 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-07-16T20:29:16.840 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-07-16T20:29:16.840 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-07-16T20:29:16.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-07-16T20:29:16.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-07-16T20:29:16.841 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-07-16T20:29:16.842 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-07-16T20:29:16.842 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-07-16T20:29:16.842 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-07-16T20:29:16.843 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-07-16T20:29:16.843 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-07-16T20:29:16.843 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-07-16T20:29:16.844 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-07-16T20:29:16.844 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-07-16T20:29:16.844 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-07-16T20:29:16.845 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-07-16T20:29:16.845 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-07-16T20:29:16.845 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-07-16T20:29:16.846 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-07-16T20:29:16.846 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-07-16T20:29:16.846 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-07-16T20:29:16.847 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-07-16T20:29:16.847 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-07-16T20:29:16.847 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-07-16T20:29:16.848 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-07-16T20:29:16.848 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-07-16T20:29:16.848 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-07-16T20:29:16.849 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-07-16T20:29:16.849 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-07-16T20:29:16.849 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-07-16T20:29:16.850 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-07-16T20:29:16.850 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-07-16T20:29:16.850 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-07-16T20:29:16.851 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-07-16T20:29:16.851 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-07-16T20:29:16.851 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-07-16T20:29:16.852 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-07-16T20:29:16.852 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-07-16T20:29:16.852 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-07-16T20:29:16.853 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-07-16T20:29:16.854 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-07-16T20:29:16.854 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-07-16T20:29:16.854 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-07-16T20:29:16.855 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-07-16T20:29:16.855 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-07-16T20:29:16.855 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-07-16T20:29:16.856 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-07-16T20:29:16.856 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-07-16T20:29:16.856 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-07-16T20:29:16.857 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-07-16T20:29:16.857 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-07-16T20:29:16.857 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-07-16T20:29:16.858 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-07-16T20:29:16.858 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-07-16T20:29:16.858 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-07-16T20:29:16.859 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-07-16T20:29:16.859 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-07-16T20:29:16.859 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-07-16T20:29:16.860 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-07-16T20:29:16.860 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-07-16T20:29:16.860 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-07-16T20:29:16.861 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-07-16T20:29:16.861 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-07-16T20:29:16.861 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-07-16T20:29:16.862 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-07-16T20:29:16.862 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-07-16T20:29:16.862 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-07-16T20:29:16.863 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 126/148 2020-07-16T20:29:16.863 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-07-16T20:29:16.863 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-07-16T20:29:16.864 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-07-16T20:29:16.864 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 130/148 2020-07-16T20:29:16.864 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-07-16T20:29:16.865 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-07-16T20:29:16.865 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-07-16T20:29:16.865 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-07-16T20:29:16.866 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-07-16T20:29:16.866 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-07-16T20:29:16.867 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 137/148 2020-07-16T20:29:16.867 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-07-16T20:29:16.867 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 139/148 2020-07-16T20:29:16.868 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-07-16T20:29:16.868 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-07-16T20:29:16.868 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-07-16T20:29:16.869 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-07-16T20:29:16.869 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:16.869 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-07-16T20:29:16.870 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:16.870 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-07-16T20:29:17.092 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 119/148 2020-07-16T20:29:17.314 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:18.646 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-07-16T20:29:18.646 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:18.647 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2020-07-16T20:29:18.647 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.647 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.648 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:18.648 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:18.648 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:18.648 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:18.649 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:18.649 INFO:teuthology.orchestra.run.smithi116.stdout:Downgraded: 2020-07-16T20:29:18.649 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-07-16T20:29:18.650 INFO:teuthology.orchestra.run.smithi116.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:18.650 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:18.650 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:18.651 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2020-07-16T20:29:18.651 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.651 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.652 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.652 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.652 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.653 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.653 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.653 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.654 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.654 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.654 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.656 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.656 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.656 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.657 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.657 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.658 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.659 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.0.4-10.el8.x86_64 2020-07-16T20:29:18.659 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.1-9.el8.x86_64 2020-07-16T20:29:18.659 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-25.el8.x86_64 2020-07-16T20:29:18.660 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-07-16T20:29:18.661 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-07-16T20:29:18.661 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-07-16T20:29:18.661 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:18.662 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-07-16T20:29:18.662 INFO:teuthology.orchestra.run.smithi116.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-07-16T20:29:18.662 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-07-16T20:29:18.663 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.663 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.663 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.664 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.664 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.664 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.665 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.665 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.665 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:18.666 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.666 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.666 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:18.667 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.1-6.el8.noarch 2020-07-16T20:29:18.667 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.5-12.el8.x86_64 2020-07-16T20:29:18.667 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-07-16T20:29:18.668 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-07-16T20:29:18.669 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-07-16T20:29:18.669 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.3-2.el8.x86_64 2020-07-16T20:29:18.669 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-07-16T20:29:18.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.5.1-5.el8.noarch 2020-07-16T20:29:18.670 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-07-16T20:29:18.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-07-16T20:29:18.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-16T20:29:18.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-07-16T20:29:18.671 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.0.6-13.el8.noarch 2020-07-16T20:29:18.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-07-16T20:29:18.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:18.672 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:18.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-07-16T20:29:18.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-07-16T20:29:18.673 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-07-16T20:29:18.674 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2017.2-9.el8.noarch 2020-07-16T20:29:18.675 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-07-16T20:29:18.675 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-07-16T20:29:18.675 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-07-16T20:29:18.676 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.3.2-6.el8.x86_64 2020-07-16T20:29:18.676 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.7-12.el8.x86_64 2020-07-16T20:29:18.676 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-07-16T20:29:18.677 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-07-16T20:29:18.678 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel-1.17-9.el8.x86_64 2020-07-16T20:29:18.678 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-07-16T20:29:18.679 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:18.679 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:18.679 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-07-16T20:29:18.680 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-07-16T20:29:18.680 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-07-16T20:29:18.680 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-07-16T20:29:18.681 INFO:teuthology.orchestra.run.smithi116.stdout: libxslt-1.1.32-3.el8.x86_64 2020-07-16T20:29:18.681 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-07-16T20:29:18.681 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-07-16T20:29:18.682 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-07-16T20:29:18.682 INFO:teuthology.orchestra.run.smithi116.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-07-16T20:29:18.682 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-07-16T20:29:18.683 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-07-16T20:29:18.683 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-07-16T20:29:18.683 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-07-16T20:29:18.684 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-07-16T20:29:18.684 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-07-16T20:29:18.685 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-07-16T20:29:18.685 INFO:teuthology.orchestra.run.smithi116.stdout: fmt-6.2.1-1.el8.x86_64 2020-07-16T20:29:18.685 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-07-16T20:29:18.686 INFO:teuthology.orchestra.run.smithi116.stdout: leveldb-1.22-1.el8.x86_64 2020-07-16T20:29:18.686 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.2-3.el8.x86_64 2020-07-16T20:29:18.686 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.3.1-3.el8.x86_64 2020-07-16T20:29:18.687 INFO:teuthology.orchestra.run.smithi116.stdout: python3-apipkg-1.5-6.el8.noarch 2020-07-16T20:29:18.687 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-07-16T20:29:18.687 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-07-16T20:29:18.688 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-07-16T20:29:18.688 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-07-16T20:29:18.688 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-07-16T20:29:18.689 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-07-16T20:29:18.689 INFO:teuthology.orchestra.run.smithi116.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-07-16T20:29:18.689 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-07-16T20:29:18.690 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-6.2-6.el8.noarch 2020-07-16T20:29:18.690 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-07-16T20:29:18.690 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-07-16T20:29:18.691 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-16T20:29:18.691 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-07-16T20:29:18.691 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-07-16T20:29:18.692 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-2.6-1.el8.noarch 2020-07-16T20:29:18.692 INFO:teuthology.orchestra.run.smithi116.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-07-16T20:29:18.692 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-07-16T20:29:18.693 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.4.1-12.el8.noarch 2020-07-16T20:29:18.693 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-07-16T20:29:18.693 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-07-16T20:29:18.694 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-07-16T20:29:18.694 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-07-16T20:29:18.694 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-07-16T20:29:18.695 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-07-16T20:29:18.695 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-07-16T20:29:18.696 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-07-16T20:29:18.696 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-07-16T20:29:18.697 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-07-16T20:29:18.697 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-07-16T20:29:18.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:18.698 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2020-07-16T20:29:18.801 DEBUG:teuthology.parallel:result is None 2020-07-16T20:29:21.696 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 120/148 2020-07-16T20:29:22.036 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 121/148 2020-07-16T20:29:22.179 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:22.243 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/148 2020-07-16T20:29:23.146 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 123/148 2020-07-16T20:29:23.392 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-07-16T20:29:23.583 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-07-16T20:29:23.782 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 126/148 2020-07-16T20:29:23.950 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-07-16T20:29:24.181 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-07-16T20:29:24.620 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-07-16T20:29:24.946 INFO:teuthology.orchestra.run.smithi022.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-07-16T20:29:25.179 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 131/148 2020-07-16T20:29:25.416 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 132/148 2020-07-16T20:29:25.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:25.880 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 133/148 2020-07-16T20:29:26.355 INFO:teuthology.orchestra.run.smithi022.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-07-16T20:29:26.557 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-07-16T20:29:26.754 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:26.840 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-07-16T20:29:27.029 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:27.051 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-07-16T20:29:27.247 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-07-16T20:29:27.382 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-07-16T20:29:27.526 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-07-16T20:29:27.708 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-07-16T20:29:27.922 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-07-16T20:29:27.922 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:28.139 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-07-16T20:29:28.289 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:28.309 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:28.310 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:28.549 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-07-16T20:29:28.550 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:28.799 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:28.800 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:29.023 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-07-16T20:29:29.024 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:29.889 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-07-16T20:29:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-07-16T20:29:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-07-16T20:29:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-07-16T20:29:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-07-16T20:29:29.890 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-07-16T20:29:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-07-16T20:29:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-07-16T20:29:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-07-16T20:29:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-07-16T20:29:29.891 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-07-16T20:29:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 11/148 2020-07-16T20:29:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 12/148 2020-07-16T20:29:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 13/148 2020-07-16T20:29:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 14/148 2020-07-16T20:29:29.892 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-3565.g8e60c 15/148 2020-07-16T20:29:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 16/148 2020-07-16T20:29:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 17/148 2020-07-16T20:29:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 18/148 2020-07-16T20:29:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 19/148 2020-07-16T20:29:29.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 20/148 2020-07-16T20:29:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_ 21/148 2020-07-16T20:29:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 22/148 2020-07-16T20:29:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 23/148 2020-07-16T20:29:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x 24/148 2020-07-16T20:29:29.894 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 25/148 2020-07-16T20:29:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x8 26/148 2020-07-16T20:29:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8. 27/148 2020-07-16T20:29:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 28/148 2020-07-16T20:29:29.895 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5 29/148 2020-07-16T20:29:29.904 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.e 30/148 2020-07-16T20:29:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x8 31/148 2020-07-16T20:29:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86 32/148 2020-07-16T20:29:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 33/148 2020-07-16T20:29:29.905 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_6 34/148 2020-07-16T20:29:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 35/148 2020-07-16T20:29:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 36/148 2020-07-16T20:29:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 37/148 2020-07-16T20:29:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350 38/148 2020-07-16T20:29:29.906 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8. 39/148 2020-07-16T20:29:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el 40/148 2020-07-16T20:29:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e6 41/148 2020-07-16T20:29:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5 42/148 2020-07-16T20:29:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noa 43/148 2020-07-16T20:29:29.907 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a 44/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-07-16T20:29:29.908 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-07-16T20:29:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-07-16T20:29:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-07-16T20:29:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-07-16T20:29:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-07-16T20:29:29.909 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-07-16T20:29:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-07-16T20:29:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-07-16T20:29:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-07-16T20:29:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-07-16T20:29:29.910 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-07-16T20:29:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-07-16T20:29:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-07-16T20:29:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-07-16T20:29:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-07-16T20:29:29.911 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-07-16T20:29:29.912 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-07-16T20:29:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-07-16T20:29:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-07-16T20:29:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-07-16T20:29:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-07-16T20:29:29.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-07-16T20:29:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-07-16T20:29:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-07-16T20:29:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-07-16T20:29:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-07-16T20:29:29.914 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-07-16T20:29:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-07-16T20:29:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-07-16T20:29:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-07-16T20:29:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-07-16T20:29:29.915 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-07-16T20:29:29.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-07-16T20:29:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-07-16T20:29:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-07-16T20:29:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-07-16T20:29:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-07-16T20:29:29.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-07-16T20:29:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-07-16T20:29:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-07-16T20:29:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-07-16T20:29:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-07-16T20:29:29.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-07-16T20:29:29.919 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-07-16T20:29:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-07-16T20:29:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-07-16T20:29:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-07-16T20:29:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-07-16T20:29:29.920 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-07-16T20:29:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-07-16T20:29:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-07-16T20:29:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-07-16T20:29:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-07-16T20:29:29.921 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-07-16T20:29:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-07-16T20:29:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-07-16T20:29:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-07-16T20:29:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-07-16T20:29:29.922 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-07-16T20:29:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-07-16T20:29:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-07-16T20:29:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 126/148 2020-07-16T20:29:29.923 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-07-16T20:29:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-07-16T20:29:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-07-16T20:29:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 130/148 2020-07-16T20:29:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-07-16T20:29:29.924 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-07-16T20:29:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-07-16T20:29:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-07-16T20:29:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-07-16T20:29:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-07-16T20:29:29.925 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 137/148 2020-07-16T20:29:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-07-16T20:29:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 139/148 2020-07-16T20:29:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-07-16T20:29:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-07-16T20:29:29.926 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-07-16T20:29:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-07-16T20:29:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-07-16T20:29:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-07-16T20:29:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-07-16T20:29:29.927 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-07-16T20:29:31.664 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-07-16T20:29:31.664 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:31.665 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2020-07-16T20:29:31.665 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.665 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.666 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:31.666 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:31.667 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:31.667 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-07-16T20:29:31.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:31.668 INFO:teuthology.orchestra.run.smithi022.stdout:Downgraded: 2020-07-16T20:29:31.668 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-07-16T20:29:31.668 INFO:teuthology.orchestra.run.smithi022.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:31.668 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:31.668 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:31.669 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2020-07-16T20:29:31.669 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.669 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.669 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.669 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.670 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.670 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.670 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.670 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.671 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.671 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.671 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.671 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.671 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.672 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.673 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.673 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.0.4-10.el8.x86_64 2020-07-16T20:29:31.674 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.1-9.el8.x86_64 2020-07-16T20:29:31.674 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-25.el8.x86_64 2020-07-16T20:29:31.674 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-07-16T20:29:31.674 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-07-16T20:29:31.674 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-07-16T20:29:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-07-16T20:29:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-07-16T20:29:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-07-16T20:29:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-07-16T20:29:31.675 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.676 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.676 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:16.0.0-3565.g8e60ca350a5.el8.x86_64 2020-07-16T20:29:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.689 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:16.0.0-3565.g8e60ca350a5.el8.noarch 2020-07-16T20:29:31.689 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.1-6.el8.noarch 2020-07-16T20:29:31.689 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.5-12.el8.x86_64 2020-07-16T20:29:31.689 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-07-16T20:29:31.690 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-07-16T20:29:31.690 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-07-16T20:29:31.690 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.3-2.el8.x86_64 2020-07-16T20:29:31.690 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-07-16T20:29:31.691 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.5.1-5.el8.noarch 2020-07-16T20:29:31.691 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-07-16T20:29:31.691 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-07-16T20:29:31.691 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-07-16T20:29:31.691 INFO:teuthology.orchestra.run.smithi022.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-07-16T20:29:31.692 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.0.6-13.el8.noarch 2020-07-16T20:29:31.692 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-07-16T20:29:31.692 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:31.692 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-07-16T20:29:31.692 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-07-16T20:29:31.693 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-07-16T20:29:31.693 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-07-16T20:29:31.693 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2017.2-9.el8.noarch 2020-07-16T20:29:31.693 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-07-16T20:29:31.693 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-07-16T20:29:31.694 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-07-16T20:29:31.694 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.3.2-6.el8.x86_64 2020-07-16T20:29:31.694 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.7-12.el8.x86_64 2020-07-16T20:29:31.694 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-07-16T20:29:31.694 INFO:teuthology.orchestra.run.smithi022.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-07-16T20:29:31.695 INFO:teuthology.orchestra.run.smithi022.stdout: krb5-devel-1.17-9.el8.x86_64 2020-07-16T20:29:31.695 INFO:teuthology.orchestra.run.smithi022.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-07-16T20:29:31.695 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:31.695 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-07-16T20:29:31.695 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-07-16T20:29:31.696 INFO:teuthology.orchestra.run.smithi022.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-07-16T20:29:31.696 INFO:teuthology.orchestra.run.smithi022.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-07-16T20:29:31.696 INFO:teuthology.orchestra.run.smithi022.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-07-16T20:29:31.696 INFO:teuthology.orchestra.run.smithi022.stdout: libxslt-1.1.32-3.el8.x86_64 2020-07-16T20:29:31.696 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-07-16T20:29:31.697 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-07-16T20:29:31.697 INFO:teuthology.orchestra.run.smithi022.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-07-16T20:29:31.697 INFO:teuthology.orchestra.run.smithi022.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-07-16T20:29:31.697 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-07-16T20:29:31.697 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-07-16T20:29:31.699 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-07-16T20:29:31.699 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-07-16T20:29:31.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-07-16T20:29:31.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-07-16T20:29:31.700 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-07-16T20:29:31.701 INFO:teuthology.orchestra.run.smithi022.stdout: fmt-6.2.1-1.el8.x86_64 2020-07-16T20:29:31.701 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-07-16T20:29:31.701 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb-1.22-1.el8.x86_64 2020-07-16T20:29:31.701 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.2-3.el8.x86_64 2020-07-16T20:29:31.702 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.3.1-3.el8.x86_64 2020-07-16T20:29:31.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-apipkg-1.5-6.el8.noarch 2020-07-16T20:29:31.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-07-16T20:29:31.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-07-16T20:29:31.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-07-16T20:29:31.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-07-16T20:29:31.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-07-16T20:29:31.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-07-16T20:29:31.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-07-16T20:29:31.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-07-16T20:29:31.705 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-6.2-6.el8.noarch 2020-07-16T20:29:31.705 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-07-16T20:29:31.705 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-07-16T20:29:31.705 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-07-16T20:29:31.706 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-07-16T20:29:31.706 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-07-16T20:29:31.706 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-2.6-1.el8.noarch 2020-07-16T20:29:31.706 INFO:teuthology.orchestra.run.smithi022.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-07-16T20:29:31.707 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-07-16T20:29:31.707 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.4.1-12.el8.noarch 2020-07-16T20:29:31.707 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-07-16T20:29:31.708 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-07-16T20:29:31.709 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-07-16T20:29:31.709 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-07-16T20:29:31.709 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-07-16T20:29:31.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-07-16T20:29:31.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-07-16T20:29:31.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-07-16T20:29:31.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-07-16T20:29:31.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-07-16T20:29:31.711 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-07-16T20:29:31.711 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:31.712 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2020-07-16T20:29:31.845 DEBUG:teuthology.parallel:result is None 2020-07-16T20:29:31.847 INFO:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2020-07-16T20:29:31.902 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS 2020-07-16T20:29:31.904 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:29:31.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:29:32.099 INFO:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-07-16T20:29:32.124 INFO:teuthology.orchestra.run.smithi022.stdout:16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:32.125 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:32.126 INFO:teuthology.task.install:The correct ceph version 16.0.0-3565.g8e60ca350a5 is installed. 2020-07-16T20:29:32.127 INFO:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2020-07-16T20:29:32.183 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS 2020-07-16T20:29:32.184 DEBUG:teuthology.misc:System to be installed: CentOS 2020-07-16T20:29:32.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a 2020-07-16T20:29:32.377 INFO:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-07-16T20:29:32.400 INFO:teuthology.orchestra.run.smithi116.stdout:16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:32.401 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-3565.g8e60ca350a5.el8 2020-07-16T20:29:32.401 INFO:teuthology.task.install:The correct ceph version 16.0.0-3565.g8e60ca350a5 is installed. 2020-07-16T20:29:32.402 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-07-16T20:29:32.403 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-16T20:29:32.464 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-07-16T20:29:32.497 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-07-16T20:29:32.498 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-16T20:29:32.542 INFO:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-16T20:29:32.614 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-07-16T20:29:32.648 INFO:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-07-16T20:29:32.719 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-07-16T20:29:32.720 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-16T20:29:32.766 INFO:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-16T20:29:32.839 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-07-16T20:29:32.886 INFO:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-07-16T20:29:32.956 INFO:teuthology.run_tasks:Running task ceph... 2020-07-16T20:29:33.066 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-07-16T20:29:33.068 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2020-07-16T20:29:33.072 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2020-07-16T20:29:33.108 INFO:tasks.ceph:Disabling ceph logrotate... 2020-07-16T20:29:33.109 INFO:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-16T20:29:33.158 INFO:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2020-07-16T20:29:33.194 INFO:tasks.ceph:Creating extra log directories... 2020-07-16T20:29:33.195 INFO:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-16T20:29:33.231 INFO:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-07-16T20:29:33.275 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-07-16T20:29:33.276 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-07-16T20:29:33.277 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-07-16T20:29:33.277 INFO:teuthology.orchestra.run.smithi022:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-07-16T20:29:33.386 INFO:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:33.556 INFO:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:33.595 INFO:teuthology.orchestra.run.smithi116:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-07-16T20:29:33.646 INFO:teuthology.orchestra.run.smithi116:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:33.769 INFO:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-07-16T20:29:33.803 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-07-16T20:29:33.804 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-07-16T20:29:33.805 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi/5231370', 'branch': 'wip-pdonnell-testing-20200716.140830', 'description': 'fs/basic_functional/{begin clusters/1-mds-4-client-coloc conf/{client mds mon osd} mount/fuse objectstore/bluestore-ec-root overrides/{frag_enable no_client_pidfile whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{centos_8} tasks/cfuse_workunit_quota}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5231370', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-07-16_18:53:18-fs-wip-pdonnell-testing-20200716.140830-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20200716.140830'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': ''}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20200716.140830', 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.1'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.2', 'client.3']], 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20200716.140830', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '8e60ca350a5f59d9e2aaa09a4408f1f6e5177a1a'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology_branch': 'master', 'tube': 'smithi', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.20769', 'targets': {'smithi022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmxN04BxgFeYgOJwQ0OYfbOOmqYjfAxfew/Vig6hQIIL/Nbi2lfhBkIBorbvRoP9uLACkE59F28CI6wnjFgJz+bbpN+k/XmW8wPvD1pJq5UnOkV3wYHtBQcS+JolTZKERO2O8Uap6YUw6u6Rm3zsP5Kq1nFhFyLF8EujS3QAdvRXpW4BjyCy+4T1Z3QltnEEJKlor86fXf6ES3bRAMccRSkc6CXAmF+Qe1wyMkFKdURZexZfbPRtfNLfzx5r2vv/AjEvqH1U1NS53ZfBB+r+PhuZZmbR/of1RtRBRNbuJahNnfBZnR3FSIyz+y67sHHO8Zh5VEJ3BZMO4IG4UF9KDZmOGQspjhk4f4+h/kxL/nU4qG/X83xqP4hlTmPaIyyG+BPSL3y61w3Poc63yjZf/vz4x3kOKZC5ZgpCaoJayjWBPxSgMjDASSjOS5Zxehdf5E0xViaESg1MO0ceouAgO6CyiHECnY6hKU0sFj/Bj2HS7+WpnHKb+VyAo6mNLB8ZE=', 'smithi116.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3dED3ClCadtbbAg6Aph0wHVKavzBwCQcgrO93bnqBUNG+tsMWeHyvdDcfYZGz0P8x/xCcg5H3bxHQdCPtc6OQyRwX//P3WPv6+k5+X2mQWl5E9la5ZSBN24eLCNE4w4VPv6779GY/b3fB5dDiXFU9KFNdi5vCfnKpqB3BK0PpS6V+7oA0B5mUoiMuXuZN379SQIaK2S+tHoJB4uQzcddUeZn30TK1Oifpq6Zd40wfWExWTS43yL6n0g2F/bFNs9BCfTsvXcT2fgex/E1qcaEaPXK4orU6uCDq2svs4WDQEqerGLitMxKtrxX/HwsOc5omjPVwMgn8guAhzpfAHxnE8z6fGptSg7EI7l5K9+uZxy34QNGeJYBDwMC1dPB26I+2Eozy2nZyHvi9cIItuGfMOJhXvyqQm4ECWGUTONBJ/779IBT73XjxpdOlocGpOvAh8ehC7ccvQcmZUz+ykkBKQMverS+VU9HUJ3mXjvsbimWhPI5pb9yHuNUgdaGpKmk='}} 2020-07-16T20:29:33.809 INFO:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-16T20:29:33.813 INFO:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-07-16T20:29:33.859 INFO:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2020-07-16T20:29:33.868 INFO:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2020-07-16T20:29:33.957 DEBUG:teuthology.orchestra.remote:smithi022:/scratch_devs is 72B 2020-07-16T20:29:34.008 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T20:29:34.009 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T20:29:34.024 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T20:29:34.024 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.024 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 58841 Links: 1 2020-07-16T20:29:34.025 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.025 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.025 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2020-07-16 20:29:29.533586827 +0000 2020-07-16T20:29:34.025 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2020-07-16 20:27:24.594766845 +0000 2020-07-16T20:29:34.026 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2020-07-16 20:27:24.594766845 +0000 2020-07-16T20:29:34.026 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2020-07-16T20:29:34.041 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2020-07-16T20:29:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2020-07-16T20:29:34.042 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000227193 s, 2.3 MB/s 2020-07-16T20:29:34.044 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T20:29:34.099 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T20:29:34.100 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.100 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 57086 Links: 1 2020-07-16T20:29:34.100 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.101 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.101 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2020-07-16 20:29:29.533586827 +0000 2020-07-16T20:29:34.101 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2020-07-16 20:27:24.947764190 +0000 2020-07-16T20:29:34.102 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2020-07-16 20:27:24.947764190 +0000 2020-07-16T20:29:34.102 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2020-07-16T20:29:34.115 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2020-07-16T20:29:34.116 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2020-07-16T20:29:34.116 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000208946 s, 2.5 MB/s 2020-07-16T20:29:34.118 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T20:29:34.174 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T20:29:34.174 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.175 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 59638 Links: 1 2020-07-16T20:29:34.175 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.175 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.175 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2020-07-16 20:29:29.533586827 +0000 2020-07-16T20:29:34.176 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2020-07-16 20:27:25.329761317 +0000 2020-07-16T20:29:34.176 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2020-07-16 20:27:25.329761317 +0000 2020-07-16T20:29:34.176 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2020-07-16T20:29:34.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2020-07-16T20:29:34.191 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2020-07-16T20:29:34.191 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000223343 s, 2.3 MB/s 2020-07-16T20:29:34.193 INFO:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T20:29:34.249 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T20:29:34.250 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.250 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 56189 Links: 1 2020-07-16T20:29:34.250 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.251 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.251 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2020-07-16 20:29:29.533586827 +0000 2020-07-16T20:29:34.251 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2020-07-16 20:27:25.767758022 +0000 2020-07-16T20:29:34.251 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2020-07-16 20:27:25.767758022 +0000 2020-07-16T20:29:34.252 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2020-07-16T20:29:34.265 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2020-07-16T20:29:34.277 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2020-07-16T20:29:34.277 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000177744 s, 2.9 MB/s 2020-07-16T20:29:34.280 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:34.301 DEBUG:teuthology.orchestra.remote:smithi116:/scratch_devs is 72B 2020-07-16T20:29:34.323 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-07-16T20:29:34.324 INFO:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-07-16T20:29:34.347 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-07-16T20:29:34.347 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.348 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 59661 Links: 1 2020-07-16T20:29:34.348 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.348 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.349 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2020-07-16 20:29:16.429927091 +0000 2020-07-16T20:29:34.349 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2020-07-16 20:27:23.492431479 +0000 2020-07-16T20:29:34.349 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2020-07-16 20:27:23.492431479 +0000 2020-07-16T20:29:34.350 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2020-07-16T20:29:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2020-07-16T20:29:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2020-07-16T20:29:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000266812 s, 1.9 MB/s 2020-07-16T20:29:34.357 INFO:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-07-16T20:29:34.414 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-07-16T20:29:34.415 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.415 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 59727 Links: 1 2020-07-16T20:29:34.415 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.415 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.416 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2020-07-16 20:29:16.429927091 +0000 2020-07-16T20:29:34.416 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2020-07-16 20:27:23.859426422 +0000 2020-07-16T20:29:34.416 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2020-07-16 20:27:23.859426422 +0000 2020-07-16T20:29:34.416 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2020-07-16T20:29:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2020-07-16T20:29:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2020-07-16T20:29:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00022444 s, 2.3 MB/s 2020-07-16T20:29:34.431 INFO:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-07-16T20:29:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-07-16T20:29:34.487 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.488 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 60560 Links: 1 2020-07-16T20:29:34.488 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.488 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.489 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2020-07-16 20:29:16.429927091 +0000 2020-07-16T20:29:34.489 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2020-07-16 20:27:24.217421489 +0000 2020-07-16T20:29:34.490 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2020-07-16 20:27:24.217421489 +0000 2020-07-16T20:29:34.490 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2020-07-16T20:29:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2020-07-16T20:29:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2020-07-16T20:29:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000199618 s, 2.6 MB/s 2020-07-16T20:29:34.503 INFO:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-07-16T20:29:34.568 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-07-16T20:29:34.569 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-07-16T20:29:34.569 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 57214 Links: 1 2020-07-16T20:29:34.569 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-07-16T20:29:34.570 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2020-07-16T20:29:34.570 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2020-07-16 20:29:16.429927091 +0000 2020-07-16T20:29:34.570 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2020-07-16 20:27:24.577416528 +0000 2020-07-16T20:29:34.571 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2020-07-16 20:27:24.577416528 +0000 2020-07-16T20:29:34.571 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2020-07-16T20:29:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2020-07-16T20:29:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2020-07-16T20:29:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000166904 s, 3.1 MB/s 2020-07-16T20:29:34.587 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:34.588 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-07-16T20:29:34.589 INFO:tasks.ceph:Generating config... 2020-07-16T20:29:34.591 INFO:tasks.ceph:[client] client mount timeout = 600 2020-07-16T20:29:34.592 INFO:tasks.ceph:[client] debug client = 20 2020-07-16T20:29:34.592 INFO:tasks.ceph:[client] debug ms = 1 2020-07-16T20:29:34.593 INFO:tasks.ceph:[client] pid file = 2020-07-16T20:29:34.593 INFO:tasks.ceph:[mds] debug mds = 20 2020-07-16T20:29:34.595 INFO:tasks.ceph:[mds] debug ms = 1 2020-07-16T20:29:34.596 INFO:tasks.ceph:[mds] mds bal frag = True 2020-07-16T20:29:34.596 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-07-16T20:29:34.597 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-07-16T20:29:34.597 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-07-16T20:29:34.598 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-07-16T20:29:34.599 INFO:tasks.ceph:[mds] mds debug frag = True 2020-07-16T20:29:34.599 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-07-16T20:29:34.600 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-07-16T20:29:34.600 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-07-16T20:29:34.601 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-07-16T20:29:34.601 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-07-16T20:29:34.602 INFO:tasks.ceph:[mgr] debug ms = 1 2020-07-16T20:29:34.602 INFO:tasks.ceph:[mon] debug mon = 20 2020-07-16T20:29:34.603 INFO:tasks.ceph:[mon] debug ms = 1 2020-07-16T20:29:34.604 INFO:tasks.ceph:[mon] debug paxos = 20 2020-07-16T20:29:34.604 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-07-16T20:29:34.605 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-07-16T20:29:34.605 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-07-16T20:29:34.607 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-07-16T20:29:34.608 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-07-16T20:29:34.609 INFO:tasks.ceph:[osd] debug filestore = 20 2020-07-16T20:29:34.610 INFO:tasks.ceph:[osd] debug journal = 20 2020-07-16T20:29:34.610 INFO:tasks.ceph:[osd] debug ms = 20 2020-07-16T20:29:34.611 INFO:tasks.ceph:[osd] debug osd = 25 2020-07-16T20:29:34.611 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-07-16T20:29:34.612 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:34.612 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-07-16T20:29:34.613 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-07-16T20:29:34.614 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-07-16T20:29:34.614 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-07-16T20:29:34.615 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-07-16T20:29:34.616 INFO:tasks.ceph:Setting up mon.a... 2020-07-16T20:29:34.617 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-07-16T20:29:34.683 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2020-07-16T20:29:34.686 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-07-16T20:29:34.735 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:34.768 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]')] 2020-07-16T20:29:34.769 INFO:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:34.847 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:34.848 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid 70778c64-6d4b-4710-8151-64d2394b5553 2020-07-16T20:29:34.848 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2020-07-16T20:29:34.849 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 70778c64-6d4b-4710-8151-64d2394b5553 2020-07-16T20:29:34.849 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2020-07-16T20:29:34.847236+0000 2020-07-16T20:29:34.849 INFO:teuthology.orchestra.run.smithi022.stdout:created 2020-07-16T20:29:34.847236+0000 2020-07-16T20:29:34.850 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 0 (unknown) 2020-07-16T20:29:34.850 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2020-07-16T20:29:34.851 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.b 2020-07-16T20:29:34.851 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2020-07-16T20:29:34.851 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-07-16T20:29:34.853 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 70778c64-6d4b-4710-8151-64d2394b5553... 2020-07-16T20:29:34.855 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-16T20:29:34.896 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-07-16T20:29:34.962 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2020-07-16T20:29:34.962 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2020-07-16T20:29:34.963 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-16T20:29:34.963 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2020-07-16T20:29:34.964 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.964 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2020-07-16T20:29:34.964 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.965 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2020-07-16T20:29:34.965 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.965 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2020-07-16T20:29:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2020-07-16T20:29:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.966 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2020-07-16T20:29:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2020-07-16T20:29:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.967 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-16T20:29:34.968 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2020-07-16T20:29:34.968 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.968 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2020-07-16T20:29:34.969 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-16T20:29:34.969 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.969 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2020-07-16T20:29:34.970 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.970 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2020-07-16T20:29:34.970 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2020-07-16T20:29:34.971 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2020-07-16T20:29:34.971 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2020-07-16T20:29:34.971 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2020-07-16T20:29:34.972 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2020-07-16T20:29:34.972 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2020-07-16T20:29:34.972 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-16T20:29:34.973 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-16T20:29:34.973 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2020-07-16T20:29:34.973 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.974 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-16T20:29:34.974 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.974 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2020-07-16T20:29:34.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.975 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2020-07-16T20:29:34.975 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.976 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2020-07-16T20:29:34.976 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2020-07-16T20:29:34.976 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.22,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2020-07-16T20:29:34.977 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 70778c64-6d4b-4710-8151-64d2394b5553 2020-07-16T20:29:34.977 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.977 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2020-07-16T20:29:34.978 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2020-07-16T20:29:34.978 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.978 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2020-07-16T20:29:34.979 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2020-07-16T20:29:34.979 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.979 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2020-07-16T20:29:34.980 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2020-07-16T20:29:34.980 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.980 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2020-07-16T20:29:34.980 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2020-07-16T20:29:34.981 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2020-07-16T20:29:34.981 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.981 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2020-07-16T20:29:34.982 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2020-07-16T20:29:34.982 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.982 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2020-07-16T20:29:34.983 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.983 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2020-07-16T20:29:34.983 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.984 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2020-07-16T20:29:34.984 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.984 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2020-07-16T20:29:34.985 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2020-07-16T20:29:34.985 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.985 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2020-07-16T20:29:34.986 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2020-07-16T20:29:34.986 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2020-07-16T20:29:34.986 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2020-07-16T20:29:34.987 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 20 2020-07-16T20:29:34.987 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 20 2020-07-16T20:29:34.987 INFO:teuthology.orchestra.run.smithi116.stdout: debug filestore = 20 2020-07-16T20:29:34.988 INFO:teuthology.orchestra.run.smithi116.stdout: debug journal = 20 2020-07-16T20:29:34.988 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 20 2020-07-16T20:29:34.988 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 25 2020-07-16T20:29:34.989 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2020-07-16T20:29:34.989 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:34.989 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2020-07-16T20:29:34.990 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2020-07-16T20:29:34.990 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2020-07-16T20:29:34.990 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2020-07-16T20:29:34.991 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2020-07-16T20:29:34.991 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.991 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2020-07-16T20:29:34.992 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2020-07-16T20:29:34.992 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2020-07-16T20:29:34.992 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2020-07-16T20:29:34.993 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2020-07-16T20:29:34.993 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:34.994 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:34.994 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2020-07-16T20:29:34.994 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:34.995 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2020-07-16T20:29:34.995 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2020-07-16T20:29:34.996 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2020-07-16T20:29:34.996 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2020-07-16T20:29:34.996 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2020-07-16T20:29:34.997 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2020-07-16T20:29:34.997 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2020-07-16T20:29:34.998 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:34.998 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2020-07-16T20:29:34.999 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2020-07-16T20:29:34.999 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:34.999 INFO:teuthology.orchestra.run.smithi116.stdout: mon op complaint time = 120 2020-07-16T20:29:35.000 INFO:teuthology.orchestra.run.smithi116.stdout: 2020-07-16T20:29:35.000 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2020-07-16T20:29:35.000 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2020-07-16T20:29:35.001 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2020-07-16T20:29:35.001 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2020-07-16T20:29:35.002 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-16T20:29:35.002 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-16T20:29:35.003 INFO:teuthology.orchestra.run.smithi116.stdout: client mount timeout = 600 2020-07-16T20:29:35.003 INFO:teuthology.orchestra.run.smithi116.stdout: debug client = 20 2020-07-16T20:29:35.004 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2020-07-16T20:29:35.004 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = "" 2020-07-16T20:29:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2020-07-16T20:29:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2020-07-16T20:29:35.005 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2020-07-16T20:29:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2020-07-16T20:29:35.006 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2020-07-16T20:29:35.007 INFO:teuthology.orchestra.run.smithi116.stdout:[mds] 2020-07-16T20:29:35.007 INFO:teuthology.orchestra.run.smithi116.stdout: debug mds = 20 2020-07-16T20:29:35.008 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2020-07-16T20:29:35.008 INFO:teuthology.orchestra.run.smithi116.stdout: mds bal frag = True 2020-07-16T20:29:35.009 INFO:teuthology.orchestra.run.smithi116.stdout: mds bal fragment size max = 10000 2020-07-16T20:29:35.009 INFO:teuthology.orchestra.run.smithi116.stdout: mds bal merge size = 5 2020-07-16T20:29:35.010 INFO:teuthology.orchestra.run.smithi116.stdout: mds bal split bits = 3 2020-07-16T20:29:35.010 INFO:teuthology.orchestra.run.smithi116.stdout: mds bal split size = 100 2020-07-16T20:29:35.011 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug frag = True 2020-07-16T20:29:35.012 INFO:teuthology.orchestra.run.smithi116.stdout: mds debug scatterstat = True 2020-07-16T20:29:35.012 INFO:teuthology.orchestra.run.smithi116.stdout: mds op complaint time = 180 2020-07-16T20:29:35.013 INFO:teuthology.orchestra.run.smithi116.stdout: mds verify scatter = True 2020-07-16T20:29:35.013 INFO:teuthology.orchestra.run.smithi116.stdout: osd op complaint time = 180 2020-07-16T20:29:35.015 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2020-07-16T20:29:35.015 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2020-07-16T20:29:35.015 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-07-16T20:29:35.016 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2020-07-16T20:29:35.016 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.016 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2020-07-16T20:29:35.016 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.017 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2020-07-16T20:29:35.017 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.017 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2020-07-16T20:29:35.017 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2020-07-16T20:29:35.018 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.018 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2020-07-16T20:29:35.018 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2020-07-16T20:29:35.018 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.018 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2020-07-16T20:29:35.019 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2020-07-16T20:29:35.019 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.019 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2020-07-16T20:29:35.019 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2020-07-16T20:29:35.020 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.020 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2020-07-16T20:29:35.020 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.020 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2020-07-16T20:29:35.020 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2020-07-16T20:29:35.021 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2020-07-16T20:29:35.021 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2020-07-16T20:29:35.021 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2020-07-16T20:29:35.021 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2020-07-16T20:29:35.021 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2020-07-16T20:29:35.022 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-07-16T20:29:35.022 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2020-07-16T20:29:35.022 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2020-07-16T20:29:35.022 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.022 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.023 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2020-07-16T20:29:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2020-07-16T20:29:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790]" 2020-07-16T20:29:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 70778c64-6d4b-4710-8151-64d2394b5553 2020-07-16T20:29:35.024 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.024 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2020-07-16T20:29:35.025 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2020-07-16T20:29:35.025 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.025 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2020-07-16T20:29:35.025 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2020-07-16T20:29:35.025 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.026 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2020-07-16T20:29:35.026 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2020-07-16T20:29:35.026 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.026 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2020-07-16T20:29:35.026 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2020-07-16T20:29:35.027 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2020-07-16T20:29:35.027 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.027 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2020-07-16T20:29:35.027 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2020-07-16T20:29:35.027 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2020-07-16T20:29:35.028 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.029 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2020-07-16T20:29:35.029 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2020-07-16T20:29:35.029 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.029 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2020-07-16T20:29:35.029 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2020-07-16T20:29:35.030 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2020-07-16T20:29:35.030 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2020-07-16T20:29:35.030 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 20 2020-07-16T20:29:35.030 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 20 2020-07-16T20:29:35.030 INFO:teuthology.orchestra.run.smithi022.stdout: debug filestore = 20 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: debug journal = 20 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 20 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 25 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 10 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2020-07-16T20:29:35.031 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2020-07-16T20:29:35.032 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2020-07-16T20:29:35.032 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2020-07-16T20:29:35.032 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2020-07-16T20:29:35.032 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2020-07-16T20:29:35.032 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2020-07-16T20:29:35.033 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:35.034 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:35.034 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2020-07-16T20:29:35.034 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.034 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2020-07-16T20:29:35.035 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2020-07-16T20:29:35.035 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2020-07-16T20:29:35.035 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2020-07-16T20:29:35.035 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2020-07-16T20:29:35.035 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2020-07-16T20:29:35.036 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2020-07-16T20:29:35.036 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2020-07-16T20:29:35.036 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2020-07-16T20:29:35.036 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2020-07-16T20:29:35.036 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2020-07-16T20:29:35.037 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2020-07-16T20:29:35.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:29:35.037 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2020-07-16T20:29:35.037 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2020-07-16T20:29:35.037 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2020-07-16T20:29:35.038 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2020-07-16T20:29:35.038 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-07-16T20:29:35.038 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-07-16T20:29:35.038 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2020-07-16T20:29:35.038 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2020-07-16T20:29:35.039 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2020-07-16T20:29:35.039 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = "" 2020-07-16T20:29:35.039 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2020-07-16T20:29:35.039 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2020-07-16T20:29:35.039 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2020-07-16T20:29:35.040 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2020-07-16T20:29:35.040 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2020-07-16T20:29:35.040 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2020-07-16T20:29:35.040 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2020-07-16T20:29:35.040 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2020-07-16T20:29:35.041 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal frag = True 2020-07-16T20:29:35.041 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal fragment size max = 10000 2020-07-16T20:29:35.041 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal merge size = 5 2020-07-16T20:29:35.041 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal split bits = 3 2020-07-16T20:29:35.041 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal split size = 100 2020-07-16T20:29:35.042 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2020-07-16T20:29:35.042 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2020-07-16T20:29:35.042 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2020-07-16T20:29:35.042 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2020-07-16T20:29:35.042 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2020-07-16T20:29:35.043 INFO:tasks.ceph:Creating admin key on mon.a... 2020-07-16T20:29:35.043 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-07-16T20:29:35.102 INFO:tasks.ceph:Copying monmap to all nodes... 2020-07-16T20:29:35.123 DEBUG:teuthology.orchestra.remote:smithi022:/etc/ceph/ceph.keyring is 206B 2020-07-16T20:29:35.207 DEBUG:teuthology.orchestra.remote:smithi022:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-07-16T20:29:35.260 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:29:35.261 INFO:teuthology.orchestra.run.smithi022:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:35.324 INFO:teuthology.orchestra.run.smithi022:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:35.429 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:29:35.429 INFO:teuthology.orchestra.run.smithi116:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-07-16T20:29:35.490 INFO:teuthology.orchestra.run.smithi116:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:35.577 INFO:tasks.ceph:Setting up mon nodes... 2020-07-16T20:29:35.578 INFO:tasks.ceph:Setting up mgr nodes... 2020-07-16T20:29:35.578 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-07-16T20:29:35.641 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-07-16T20:29:35.643 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-07-16T20:29:35.732 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-07-16T20:29:35.735 INFO:tasks.ceph:Setting up mds nodes... 2020-07-16T20:29:35.736 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-07-16T20:29:35.798 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-07-16T20:29:35.801 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-07-16T20:29:35.833 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-07-16T20:29:35.890 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-07-16T20:29:35.891 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-07-16T20:29:35.920 INFO:tasks.ceph_client:Setting up client nodes... 2020-07-16T20:29:35.922 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-07-16T20:29:35.972 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-07-16T20:29:35.992 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-07-16T20:29:36.038 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-07-16T20:29:36.056 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2020-07-16T20:29:36.111 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.2.keyring 2020-07-16T20:29:36.121 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2020-07-16T20:29:36.202 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.3.keyring 2020-07-16T20:29:36.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-07-16T20:29:36.219 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-07-16T20:29:36.219 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:36.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:36.252 INFO:tasks.ceph:role: osd.0 2020-07-16T20:29:36.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:29:36.254 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-07-16T20:29:36.791 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:36.792 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:36.792 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:36.792 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2020-07-16T20:29:36.792 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:36.793 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:36.793 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:36.793 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:36.793 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:36.793 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:36.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2020-07-16T20:29:36.795 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:36.913 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:36.952 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:37.024 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:37.025 INFO:tasks.ceph:role: osd.1 2020-07-16T20:29:37.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:29:37.025 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-07-16T20:29:37.539 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:37.539 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:37.539 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:37.540 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2020-07-16T20:29:37.540 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:37.540 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:37.540 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:37.540 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:37.541 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:37.541 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:37.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2020-07-16T20:29:37.542 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:37.593 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:37.630 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:37.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:37.704 INFO:tasks.ceph:role: osd.2 2020-07-16T20:29:37.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:29:37.705 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-07-16T20:29:38.247 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2020-07-16T20:29:38.249 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:38.249 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:38.249 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:38.250 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:38.250 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:38.250 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:38.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2020-07-16T20:29:38.252 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:38.326 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:38.362 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:38.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:38.448 INFO:tasks.ceph:role: osd.3 2020-07-16T20:29:38.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2020-07-16T20:29:38.450 INFO:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-07-16T20:29:38.982 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:38.982 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:38.983 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:38.983 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 2020-07-16T20:29:38.983 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:38.983 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:38.984 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:38.984 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:38.984 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:38.984 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:38.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2020-07-16T20:29:38.994 INFO:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:39.096 INFO:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:39.132 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:39.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.220+0000 7f2061333ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-07-16T20:29:39.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.221+0000 7f2061333ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-07-16T20:29:39.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.221+0000 7f2061333ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:39.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.221+0000 7f2061333ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:39.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.221+0000 7f2061333ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-07-16T20:29:39.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:39.228+0000 7f2061333ec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-07-16T20:29:41.588 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-07-16T20:29:41.625 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.719+0000 7f2b25017ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-07-16T20:29:41.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.719+0000 7f2b25017ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-07-16T20:29:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.719+0000 7f2b25017ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.719+0000 7f2b25017ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:41.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.719+0000 7f2b25017ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-07-16T20:29:41.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:41.720+0000 7f2b25017ec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-07-16T20:29:44.065 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-07-16T20:29:44.107 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:44.197 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.195+0000 7f6801e87ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-07-16T20:29:44.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.195+0000 7f6801e87ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-07-16T20:29:44.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.195+0000 7f6801e87ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:29:44.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.195+0000 7f6801e87ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:29:44.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.195+0000 7f6801e87ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-07-16T20:29:44.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:44.196+0000 7f6801e87ec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-07-16T20:29:46.537 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-07-16T20:29:46.579 INFO:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.679+0000 7f8e1f140ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-07-16T20:29:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.679+0000 7f8e1f140ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-07-16T20:29:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.679+0000 7f8e1f140ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:29:46.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.679+0000 7f8e1f140ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:29:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.679+0000 7f8e1f140ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-07-16T20:29:46.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:29:46.680+0000 7f8e1f140ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-07-16T20:29:49.025 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-07-16T20:29:49.078 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-07-16T20:29:49.119 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:49.120 INFO:tasks.ceph:role: osd.4 2020-07-16T20:29:49.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:29:49.121 INFO:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-07-16T20:29:49.650 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:49.650 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 2020-07-16T20:29:49.651 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:49.651 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:49.651 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:49.652 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:49.652 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:49.652 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:49.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2020-07-16T20:29:49.653 INFO:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-07-16T20:29:49.764 INFO:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-07-16T20:29:49.801 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-07-16T20:29:49.874 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:49.875 INFO:tasks.ceph:role: osd.5 2020-07-16T20:29:49.875 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:29:49.876 INFO:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-07-16T20:29:50.388 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:50.388 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:50.389 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 2020-07-16T20:29:50.389 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:50.390 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:50.390 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:50.390 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:50.391 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:50.391 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:50.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2020-07-16T20:29:50.393 INFO:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-07-16T20:29:50.446 INFO:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-07-16T20:29:50.480 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-07-16T20:29:50.550 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:50.551 INFO:tasks.ceph:role: osd.6 2020-07-16T20:29:50.551 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:29:50.553 INFO:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-07-16T20:29:51.078 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:51.079 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 2020-07-16T20:29:51.079 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:51.080 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:51.080 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:51.080 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:51.081 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:51.081 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:51.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2020-07-16T20:29:51.083 INFO:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-07-16T20:29:51.158 INFO:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-07-16T20:29:51.194 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-07-16T20:29:51.270 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-07-16T20:29:51.271 INFO:tasks.ceph:role: osd.7 2020-07-16T20:29:51.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2020-07-16T20:29:51.272 INFO:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-07-16T20:29:51.810 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-07-16T20:29:51.811 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2020-07-16T20:29:51.811 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-07-16T20:29:51.811 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 2020-07-16T20:29:51.811 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-07-16T20:29:51.812 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2020-07-16T20:29:51.812 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-07-16T20:29:51.812 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-07-16T20:29:51.812 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-07-16T20:29:51.812 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-07-16T20:29:51.813 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2020-07-16T20:29:51.813 INFO:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-07-16T20:29:51.914 INFO:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-07-16T20:29:51.949 INFO:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:52.035 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.035+0000 7f4036f44ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-07-16T20:29:52.037 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.036+0000 7f4036f44ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-07-16T20:29:52.037 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.036+0000 7f4036f44ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:29:52.037 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.036+0000 7f4036f44ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:29:52.038 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.036+0000 7f4036f44ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-07-16T20:29:52.044 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:52.043+0000 7f4036f44ec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-07-16T20:29:54.391 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-07-16T20:29:54.424 INFO:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:54.514 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.513+0000 7f545c317ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-07-16T20:29:54.515 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.514+0000 7f545c317ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-07-16T20:29:54.515 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.514+0000 7f545c317ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:29:54.515 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.514+0000 7f545c317ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:29:54.516 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.514+0000 7f545c317ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-07-16T20:29:54.516 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:54.514+0000 7f545c317ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-07-16T20:29:56.867 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-07-16T20:29:56.901 INFO:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:56.992 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.990+0000 7f32fc9b7ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-07-16T20:29:56.993 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.990+0000 7f32fc9b7ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-07-16T20:29:56.993 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.990+0000 7f32fc9b7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:29:56.993 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.990+0000 7f32fc9b7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:29:56.993 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.990+0000 7f32fc9b7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-07-16T20:29:56.995 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:56.991+0000 7f32fc9b7ec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-07-16T20:29:59.340 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-07-16T20:29:59.372 INFO:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:29:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.461+0000 7f874f452ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-07-16T20:29:59.463 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.462+0000 7f874f452ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-07-16T20:29:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.462+0000 7f874f452ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:29:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.462+0000 7f874f452ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:29:59.464 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.462+0000 7f874f452ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-07-16T20:29:59.465 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:29:59.462+0000 7f874f452ec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-07-16T20:30:01.809 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-07-16T20:30:01.843 INFO:tasks.ceph:Reading keys from all nodes... 2020-07-16T20:30:01.843 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:01.862 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.PBhDobP9ty 2020-07-16T20:30:01.863 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.PBhDobP9ty 2020-07-16T20:30:01.947 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.PBhDobP9ty 2020-07-16T20:30:02.083 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.PBhDobP9ty is 56B 2020-07-16T20:30:02.131 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.PBhDobP9ty 2020-07-16T20:30:02.150 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:02.204 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.6jSAnQlTby 2020-07-16T20:30:02.205 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.6jSAnQlTby 2020-07-16T20:30:02.278 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.6jSAnQlTby 2020-07-16T20:30:02.421 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.6jSAnQlTby is 56B 2020-07-16T20:30:02.477 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.6jSAnQlTby 2020-07-16T20:30:02.493 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:02.547 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.3GdNXsyTaH 2020-07-16T20:30:02.548 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.3GdNXsyTaH 2020-07-16T20:30:02.619 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.3GdNXsyTaH 2020-07-16T20:30:02.751 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.3GdNXsyTaH is 56B 2020-07-16T20:30:02.804 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.3GdNXsyTaH 2020-07-16T20:30:02.819 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:02.873 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.J6pyTM2jmM 2020-07-16T20:30:02.874 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.J6pyTM2jmM 2020-07-16T20:30:02.961 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.J6pyTM2jmM 2020-07-16T20:30:03.091 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.J6pyTM2jmM is 56B 2020-07-16T20:30:03.142 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.J6pyTM2jmM 2020-07-16T20:30:03.156 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:03.211 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.Wxllj417aD 2020-07-16T20:30:03.211 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.Wxllj417aD 2020-07-16T20:30:03.281 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.Wxllj417aD 2020-07-16T20:30:03.409 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.Wxllj417aD is 56B 2020-07-16T20:30:03.460 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.Wxllj417aD 2020-07-16T20:30:03.475 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:03.529 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.IgxYhpUldL 2020-07-16T20:30:03.530 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.IgxYhpUldL 2020-07-16T20:30:03.601 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.IgxYhpUldL 2020-07-16T20:30:03.730 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.IgxYhpUldL is 56B 2020-07-16T20:30:03.749 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.IgxYhpUldL 2020-07-16T20:30:03.764 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:03.781 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.h0xudkN0GP 2020-07-16T20:30:03.782 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.h0xudkN0GP 2020-07-16T20:30:03.811 INFO:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:03.814 INFO:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:03.856 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.h0xudkN0GP 2020-07-16T20:30:03.985 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.h0xudkN0GP is 56B 2020-07-16T20:30:04.044 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.h0xudkN0GP 2020-07-16T20:30:04.060 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:04.114 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.ftIZfAPhZW 2020-07-16T20:30:04.115 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.ftIZfAPhZW 2020-07-16T20:30:04.183 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.ftIZfAPhZW 2020-07-16T20:30:04.311 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.ftIZfAPhZW is 56B 2020-07-16T20:30:04.361 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.ftIZfAPhZW 2020-07-16T20:30:04.376 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:04.428 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.Np8FFMvGow 2020-07-16T20:30:04.429 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.Np8FFMvGow 2020-07-16T20:30:04.496 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.Np8FFMvGow 2020-07-16T20:30:04.631 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.Np8FFMvGow is 56B 2020-07-16T20:30:04.688 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.Np8FFMvGow 2020-07-16T20:30:04.703 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:04.759 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.FH1X4dxljO 2020-07-16T20:30:04.759 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.FH1X4dxljO 2020-07-16T20:30:04.827 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.FH1X4dxljO 2020-07-16T20:30:04.962 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.FH1X4dxljO is 56B 2020-07-16T20:30:05.016 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.FH1X4dxljO 2020-07-16T20:30:05.031 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:05.084 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.yJ1RihW5ip 2020-07-16T20:30:05.085 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.yJ1RihW5ip 2020-07-16T20:30:05.151 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.yJ1RihW5ip 2020-07-16T20:30:05.276 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.yJ1RihW5ip is 56B 2020-07-16T20:30:05.328 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.yJ1RihW5ip 2020-07-16T20:30:05.342 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:05.396 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.eSQA9cqGK3 2020-07-16T20:30:05.397 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.eSQA9cqGK3 2020-07-16T20:30:05.463 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.eSQA9cqGK3 2020-07-16T20:30:05.591 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.eSQA9cqGK3 is 56B 2020-07-16T20:30:05.648 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.eSQA9cqGK3 2020-07-16T20:30:05.690 DEBUG:teuthology.orchestra.remote:smithi022:/etc/ceph/ceph.client.0.keyring is 59B 2020-07-16T20:30:05.781 DEBUG:teuthology.orchestra.remote:smithi022:/etc/ceph/ceph.client.1.keyring is 59B 2020-07-16T20:30:05.899 DEBUG:teuthology.orchestra.remote:smithi116:/etc/ceph/ceph.client.2.keyring is 59B 2020-07-16T20:30:05.977 DEBUG:teuthology.orchestra.remote:smithi116:/etc/ceph/ceph.client.3.keyring is 59B 2020-07-16T20:30:06.048 INFO:tasks.ceph:Adding keys to all mons... 2020-07-16T20:30:06.049 INFO:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2020-07-16T20:30:06.055 INFO:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2020-07-16T20:30:06.098 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2020-07-16T20:30:06.100 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCvuBBfpxE4JhAAOnWCDF+IWFMa94Kewe7Tjg== 2020-07-16T20:30:06.100 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2020-07-16T20:30:06.101 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCvuBBf1SGULxAAZuoWBYd0gaovV3rOORZfaA== 2020-07-16T20:30:06.101 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2020-07-16T20:30:06.101 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCzuBBfwF4uDRAA0EDP76jtm/cdJbWqy1wU0Q== 2020-07-16T20:30:06.101 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2020-07-16T20:30:06.102 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC1uBBfNqbvKhAAKl6ebezun9pFB/YG+wD0/w== 2020-07-16T20:30:06.102 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2020-07-16T20:30:06.102 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC4uBBfdVC5CxAASWg2IO8LpqdkDmoGdgYspw== 2020-07-16T20:30:06.103 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2020-07-16T20:30:06.103 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQC6uBBfWvGOKBAAaXChs4JPZ1KnOK2n5IShtA== 2020-07-16T20:30:06.103 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2020-07-16T20:30:06.103 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCvuBBfNZWrKxAAs5G3W9J/FPkb3P/BjkAl/Q== 2020-07-16T20:30:06.104 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2020-07-16T20:30:06.104 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCvuBBflZECNRAAi1kveFSAvIbnhYP1lqN3VA== 2020-07-16T20:30:06.112 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2020-07-16T20:30:06.113 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDAuBBfWGEcAhAAQwIrhoKPMRCu6NnUM4e2Kw== 2020-07-16T20:30:06.113 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2020-07-16T20:30:06.113 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDCuBBfV4amHhAAFCB8dxJ5ZjgJuFT6dOOapg== 2020-07-16T20:30:06.114 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2020-07-16T20:30:06.114 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDEuBBfMgUSOxAAlCcrrsIm3+d4qDKSsMpn3w== 2020-07-16T20:30:06.114 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2020-07-16T20:30:06.114 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDHuBBf2tiNGxAA5fiQiBqyvvvlI2nR5um5Rg== 2020-07-16T20:30:06.115 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2020-07-16T20:30:06.115 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCvuBBfrlr5ORAAXIJD8nw8yCdySJLlhJ56CA== 2020-07-16T20:30:06.115 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2020-07-16T20:30:06.116 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCwuBBfGmA6AhAAoPG0+9cK//Rgsoh0gRWCoQ== 2020-07-16T20:30:06.116 INFO:teuthology.orchestra.run.smithi022.stdout:[client.2] 2020-07-16T20:30:06.116 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCwuBBfGsBIBhAAYoYr+FRVWMLBElkOG5SIgA== 2020-07-16T20:30:06.116 INFO:teuthology.orchestra.run.smithi022.stdout:[client.3] 2020-07-16T20:30:06.117 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQCwuBBf6WAPDBAAgiDxwSZtPzCyiTRbbQ7New== 2020-07-16T20:30:06.122 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2020-07-16T20:30:06.124 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCvuBBfpxE4JhAAOnWCDF+IWFMa94Kewe7Tjg== 2020-07-16T20:30:06.124 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.a] 2020-07-16T20:30:06.125 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCvuBBf1SGULxAAZuoWBYd0gaovV3rOORZfaA== 2020-07-16T20:30:06.125 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2020-07-16T20:30:06.125 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCzuBBfwF4uDRAA0EDP76jtm/cdJbWqy1wU0Q== 2020-07-16T20:30:06.125 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2020-07-16T20:30:06.126 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQC1uBBfNqbvKhAAKl6ebezun9pFB/YG+wD0/w== 2020-07-16T20:30:06.126 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2020-07-16T20:30:06.126 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQC4uBBfdVC5CxAASWg2IO8LpqdkDmoGdgYspw== 2020-07-16T20:30:06.126 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2020-07-16T20:30:06.127 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQC6uBBfWvGOKBAAaXChs4JPZ1KnOK2n5IShtA== 2020-07-16T20:30:06.127 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2020-07-16T20:30:06.127 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCvuBBfNZWrKxAAs5G3W9J/FPkb3P/BjkAl/Q== 2020-07-16T20:30:06.127 INFO:teuthology.orchestra.run.smithi116.stdout:[mds.b] 2020-07-16T20:30:06.127 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCvuBBflZECNRAAi1kveFSAvIbnhYP1lqN3VA== 2020-07-16T20:30:06.128 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2020-07-16T20:30:06.128 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQDAuBBfWGEcAhAAQwIrhoKPMRCu6NnUM4e2Kw== 2020-07-16T20:30:06.128 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2020-07-16T20:30:06.128 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQDCuBBfV4amHhAAFCB8dxJ5ZjgJuFT6dOOapg== 2020-07-16T20:30:06.129 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2020-07-16T20:30:06.129 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQDEuBBfMgUSOxAAlCcrrsIm3+d4qDKSsMpn3w== 2020-07-16T20:30:06.129 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2020-07-16T20:30:06.129 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQDHuBBf2tiNGxAA5fiQiBqyvvvlI2nR5um5Rg== 2020-07-16T20:30:06.130 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2020-07-16T20:30:06.130 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCvuBBfrlr5ORAAXIJD8nw8yCdySJLlhJ56CA== 2020-07-16T20:30:06.130 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2020-07-16T20:30:06.130 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCwuBBfGmA6AhAAoPG0+9cK//Rgsoh0gRWCoQ== 2020-07-16T20:30:06.131 INFO:teuthology.orchestra.run.smithi116.stdout:[client.2] 2020-07-16T20:30:06.131 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCwuBBfGsBIBhAAYoYr+FRVWMLBElkOG5SIgA== 2020-07-16T20:30:06.131 INFO:teuthology.orchestra.run.smithi116.stdout:[client.3] 2020-07-16T20:30:06.131 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQCwuBBf6WAPDBAAgiDxwSZtPzCyiTRbbQ7New== 2020-07-16T20:30:06.132 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:06.142 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:06.210 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:06.212 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:06.267 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.271 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.322 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.326 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.413 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.417 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.468 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.488 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.538 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:06.574 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-07-16T20:30:06.627 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:06.637 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-07-16T20:30:06.709 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.733 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.783 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.793 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.854 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.863 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.917 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.921 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-07-16T20:30:06.971 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:06.975 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.030 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.032 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.087 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.100 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.153 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.158 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-07-16T20:30:07.210 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-07-16T20:30:07.211 INFO:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-07-16T20:30:07.244 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:07.348 INFO:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-07-16T20:30:07.392 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-07-16T20:30:07.429 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:07.542 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-07-16T20:30:07.574 INFO:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-07-16T20:30:07.643 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-07-16T20:30:07.744 INFO:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-07-16T20:30:07.776 INFO:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:07.795 INFO:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-07-16T20:30:07.830 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-07-16T20:30:07.831 INFO:tasks.ceph.mon.a:Restarting daemon 2020-07-16T20:30:07.832 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-07-16T20:30:07.846 INFO:tasks.ceph.mon.a:Started 2020-07-16T20:30:07.852 INFO:tasks.ceph.mon.b:Restarting daemon 2020-07-16T20:30:07.852 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-07-16T20:30:07.875 INFO:tasks.ceph.mon.b:Started 2020-07-16T20:30:07.876 INFO:tasks.ceph.mon.c:Restarting daemon 2020-07-16T20:30:07.877 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-07-16T20:30:07.881 INFO:tasks.ceph.mon.c:Started 2020-07-16T20:30:07.882 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-07-16T20:30:07.883 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-07-16T20:30:07.884 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-07-16T20:30:07.889 INFO:tasks.ceph.mgr.y:Started 2020-07-16T20:30:07.890 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-07-16T20:30:07.890 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-07-16T20:30:07.894 INFO:tasks.ceph.mgr.x:Started 2020-07-16T20:30:07.894 INFO:tasks.ceph:Setting crush tunables to default 2020-07-16T20:30:07.895 INFO:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2020-07-16T20:30:08.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.021+0000 7fb3ea2fe700 1 Processor -- start 2020-07-16T20:30:08.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.021+0000 7fb3ea2fe700 1 -- start start 2020-07-16T20:30:08.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3ea2fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 0x7fb3e409e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:08.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3ea2fe700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e4064620 con 0x7fb3e40b5930 2020-07-16T20:30:08.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3ea2fe700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e4064890 con 0x7fb3e40802d0 2020-07-16T20:30:08.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3ea2fe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e4064b30 con 0x7fb3e409e170 2020-07-16T20:30:08.199 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 0x7fb3e409e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:08.200 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e889b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb3e40b5930 0x7fb3e405f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38848/0 (socket says 172.21.15.22:38848) 2020-07-16T20:30:08.200 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e889b700 1 -- 172.21.15.22:0/1368651581 learned_addr learned my addr 172.21.15.22:0/1368651581 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:08.200 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e3fff700 1 -- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 msgr2=0x7fb3e409e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-07-16T20:30:08.200 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e3fff700 1 -- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 msgr2=0x7fb3e409e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-07-16T20:30:08.200 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 0x7fb3e409e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-07-16T20:30:08.201 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.022+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 0x7fb3e409e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-07-16T20:30:08.201 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.190+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671240230 0 0) 0x7fb3e4064620 con 0x7fb3e40b5930 2020-07-16T20:30:08.201 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.190+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3cc003240 con 0x7fb3e40b5930 2020-07-16T20:30:08.202 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 413897446 0 0) 0x7fb3cc003240 con 0x7fb3e40b5930 2020-07-16T20:30:08.202 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 msgr2=0x7fb3e409e600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-07-16T20:30:08.202 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 --2- 172.21.15.22:0/1368651581 >> v2:172.21.15.22:3300/0 conn(0x7fb3e409e170 0x7fb3e409e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:08.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 >> v1:172.21.15.116:6789/0 conn(0x7fb3e40802d0 legacy=0x7fb3e4080740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40627d0 con 0x7fb3e40b5930 2020-07-16T20:30:08.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fb3d40016d0 con 0x7fb3e40b5930 2020-07-16T20:30:08.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 >> v1:172.21.15.22:6789/0 conn(0x7fb3e40b5930 legacy=0x7fb3e405f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3cc003780 0x7fb3cc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:08.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 0x7fb3cc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:08.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3cc004e50 0x7fb3cc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e4064b30 con 0x7fb3cc0044e0 2020-07-16T20:30:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc005390 con 0x7fb3cc003780 2020-07-16T20:30:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc04fcb0 con 0x7fb3cc004e50 2020-07-16T20:30:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 0x7fb3cc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e889b700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3cc003780 0x7fb3cc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e909c700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3cc004e50 0x7fb3cc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:08.206 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 -- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3cc004e50 msgr2=0x7fb3cc00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3cc004e50 0x7fb3cc00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 -- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3cc003780 msgr2=0x7fb3cc003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:08.207 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb3cc003780 0x7fb3cc003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 -- 172.21.15.22:0/1368651581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc003240 con 0x7fb3cc0044e0 2020-07-16T20:30:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e909c700 1 -- 172.21.15.22:0/1368651581 reap_dead start 2020-07-16T20:30:08.208 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e3fff700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 0x7fb3cc004960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d8000e50 tx=0x7fb3d8008040).ready entity=mon.0 client_cookie=4abba42c1f414bf9 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:08.209 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d800d850 con 0x7fb3cc0044e0 2020-07-16T20:30:08.209 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800d9b0 con 0x7fb3cc0044e0 2020-07-16T20:30:08.209 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3e37fe700 1 -- 172.21.15.22:0/1368651581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d800dd10 con 0x7fb3cc0044e0 2020-07-16T20:30:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 msgr2=0x7fb3cc004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 0x7fb3cc004960 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d8000e50 tx=0x7fb3d8008040).stop 2020-07-16T20:30:08.211 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/1368651581 shutdown_connections 2020-07-16T20:30:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 --2- 172.21.15.22:0/1368651581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3cc0044e0 0x7fb3cc004960 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:08.212 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/1368651581 >> 172.21.15.22:0/1368651581 conn(0x7fb3e40b93a0 msgr2=0x7fb3e40b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.191+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/1368651581 shutdown_connections 2020-07-16T20:30:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.192+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/1368651581 wait complete. 2020-07-16T20:30:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.194+0000 7fb3ea2fe700 1 Processor -- start 2020-07-16T20:30:08.213 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.194+0000 7fb3ea2fe700 1 -- start start 2020-07-16T20:30:08.214 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3ea2fe700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 0x7fb3e4135e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:08.214 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3ea2fe700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e4135740 con 0x7fb3e40b1130 2020-07-16T20:30:08.215 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3ea2fe700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e41359e0 con 0x7fb3e40b1590 2020-07-16T20:30:08.215 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3ea2fe700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40af1f0 con 0x7fb3e40b0d50 2020-07-16T20:30:08.215 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e3fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb3e40b1130 0x7fb3e40aeae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38876/0 (socket says 172.21.15.22:38876) 2020-07-16T20:30:08.216 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e889b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 0x7fb3e4135e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:08.216 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e3fff700 1 -- 172.21.15.22:0/3420005857 learned_addr learned my addr 172.21.15.22:0/3420005857 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:08.216 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826076140 0 0) 0x7fb3e4135740 con 0x7fb3e40b1130 2020-07-16T20:30:08.217 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3bc003240 con 0x7fb3e40b1130 2020-07-16T20:30:08.217 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e889b700 1 -- 172.21.15.22:0/3420005857 >> v1:172.21.15.116:6789/0 conn(0x7fb3e40b1590 legacy=0x7fb3e41419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.217 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e889b700 1 -- 172.21.15.22:0/3420005857 >> v1:172.21.15.22:6789/0 conn(0x7fb3e40b1130 legacy=0x7fb3e40aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e889b700 1 -- 172.21.15.22:0/3420005857 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4134fa0 con 0x7fb3e40b0d50 2020-07-16T20:30:08.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.195+0000 7fb3e889b700 1 --2- 172.21.15.22:0/3420005857 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 0x7fb3e4135e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d400d000 tx=0x7fb3d40076a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d4018070 con 0x7fb3e40b0d50 2020-07-16T20:30:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4010a90 con 0x7fb3e40b0d50 2020-07-16T20:30:08.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e4136370 con 0x7fb3e40b0d50 2020-07-16T20:30:08.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d4010df0 con 0x7fb3e40b0d50 2020-07-16T20:30:08.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e4142290 con 0x7fb3e40b0d50 2020-07-16T20:30:08.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fb3d4013460 con 0x7fb3e40b0d50 2020-07-16T20:30:08.221 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.196+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb3d401d780 con 0x7fb3e40b0d50 2020-07-16T20:30:08.221 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.197+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e4135130 con 0x7fb3e40b0d50 2020-07-16T20:30:08.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.199+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fb3d40011d0 con 0x7fb3e40b0d50 2020-07-16T20:30:08.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.279+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb3e4057490 con 0x7fb3e40b0d50 2020-07-16T20:30:08.301 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.288+0000 7fb3c3fff700 1 -- 172.21.15.22:0/3420005857 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb3d4013880 con 0x7fb3e40b0d50 2020-07-16T20:30:08.302 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 msgr2=0x7fb3e4135e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:08.302 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 --2- 172.21.15.22:0/3420005857 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 0x7fb3e4135e80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d400d000 tx=0x7fb3d40076a0).stop 2020-07-16T20:30:08.302 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 shutdown_connections 2020-07-16T20:30:08.303 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 --2- 172.21.15.22:0/3420005857 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb3e40b0d50 0x7fb3e4135e80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:08.303 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 >> 172.21.15.22:0/3420005857 conn(0x7fb3e40b93a0 msgr2=0x7fb3e40b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:08.303 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 shutdown_connections 2020-07-16T20:30:08.304 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:08.289+0000 7fb3ea2fe700 1 -- 172.21.15.22:0/3420005857 wait complete. 2020-07-16T20:30:08.304 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2020-07-16T20:30:08.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-07-16T20:30:08.305 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:08.321 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.O4078aRz6j 2020-07-16T20:30:08.322 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.O4078aRz6j 2020-07-16T20:30:08.394 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.O4078aRz6j 2020-07-16T20:30:08.552 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.O4078aRz6j is 37B 2020-07-16T20:30:08.605 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.O4078aRz6j 2020-07-16T20:30:08.621 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:08.675 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.ZlYv8pBSKM 2020-07-16T20:30:08.675 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.ZlYv8pBSKM 2020-07-16T20:30:08.751 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.ZlYv8pBSKM 2020-07-16T20:30:08.891 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.ZlYv8pBSKM is 37B 2020-07-16T20:30:08.944 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.ZlYv8pBSKM 2020-07-16T20:30:08.966 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:09.019 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.r1JlPnb4LF 2020-07-16T20:30:09.020 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.r1JlPnb4LF 2020-07-16T20:30:09.099 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.r1JlPnb4LF 2020-07-16T20:30:09.245 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.r1JlPnb4LF is 37B 2020-07-16T20:30:09.315 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.r1JlPnb4LF 2020-07-16T20:30:09.335 INFO:teuthology.orchestra.run.smithi022:> mktemp 2020-07-16T20:30:09.386 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.wjPa3iQ2pp 2020-07-16T20:30:09.387 INFO:teuthology.orchestra.run.smithi022:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.wjPa3iQ2pp 2020-07-16T20:30:09.458 INFO:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.wjPa3iQ2pp 2020-07-16T20:30:09.597 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.wjPa3iQ2pp is 37B 2020-07-16T20:30:09.650 INFO:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.wjPa3iQ2pp 2020-07-16T20:30:09.669 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:09.686 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.aJWKgFaZzO 2020-07-16T20:30:09.686 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.aJWKgFaZzO 2020-07-16T20:30:09.757 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.aJWKgFaZzO 2020-07-16T20:30:09.902 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.aJWKgFaZzO is 37B 2020-07-16T20:30:09.990 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.aJWKgFaZzO 2020-07-16T20:30:10.011 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:10.071 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.lr8M7No4NW 2020-07-16T20:30:10.072 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.lr8M7No4NW 2020-07-16T20:30:10.143 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.lr8M7No4NW 2020-07-16T20:30:10.275 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.lr8M7No4NW is 37B 2020-07-16T20:30:10.343 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.lr8M7No4NW 2020-07-16T20:30:10.358 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:10.415 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.JHMjitvrzH 2020-07-16T20:30:10.416 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.JHMjitvrzH 2020-07-16T20:30:10.483 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.JHMjitvrzH 2020-07-16T20:30:10.623 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.JHMjitvrzH is 37B 2020-07-16T20:30:10.688 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.JHMjitvrzH 2020-07-16T20:30:10.705 INFO:teuthology.orchestra.run.smithi116:> mktemp 2020-07-16T20:30:10.758 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.QXl2WfNlMz 2020-07-16T20:30:10.759 INFO:teuthology.orchestra.run.smithi116:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.QXl2WfNlMz 2020-07-16T20:30:10.827 INFO:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.QXl2WfNlMz 2020-07-16T20:30:10.959 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.QXl2WfNlMz is 37B 2020-07-16T20:30:11.016 INFO:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.QXl2WfNlMz 2020-07-16T20:30:11.032 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 589d421d-97ff-46e8-8d23-96744c404e3f 0 2020-07-16T20:30:11.183 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.177+0000 7fae86a25700 1 Processor -- start 2020-07-16T20:30:11.183 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 -- start start 2020-07-16T20:30:11.184 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae8009e170 0x7fae8009e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.184 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 0x7fae80080740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.184 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae80064620 con 0x7fae800b5930 2020-07-16T20:30:11.185 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae80064890 con 0x7fae8009e170 2020-07-16T20:30:11.185 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae86a25700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae80064b30 con 0x7fae800802d0 2020-07-16T20:30:11.194 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae857c3700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 0x7fae80080740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.195 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae84fc2700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fae800b5930 0x7fae8005f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36946/0 (socket says 172.21.15.116:36946) 2020-07-16T20:30:11.195 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae84fc2700 1 -- 172.21.15.116:0/474907279 learned_addr learned my addr 172.21.15.116:0/474907279 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:11.195 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.178+0000 7fae7ffff700 1 --2- 172.21.15.116:0/474907279 >> v2:172.21.15.22:3300/0 conn(0x7fae8009e170 0x7fae8009e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.196 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae857c3700 1 -- 172.21.15.116:0/474907279 >> v2:172.21.15.22:3300/0 conn(0x7fae8009e170 msgr2=0x7fae8009e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:11.196 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae857c3700 1 --2- 172.21.15.116:0/474907279 >> v2:172.21.15.22:3300/0 conn(0x7fae8009e170 0x7fae8009e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.197 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae857c3700 1 -- 172.21.15.116:0/474907279 >> v1:172.21.15.116:6789/0 conn(0x7fae800b5930 legacy=0x7fae8005f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.197 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae7f7fe700 1 -- 172.21.15.116:0/474907279 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310533706 0 0) 0x7fae80064620 con 0x7fae800b5930 2020-07-16T20:30:11.197 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae857c3700 1 -- 172.21.15.116:0/474907279 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae800627d0 con 0x7fae800802d0 2020-07-16T20:30:11.198 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae857c3700 1 --2- 172.21.15.116:0/474907279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 0x7fae80080740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fae78002f30 tx=0x7fae78006dd0).ready entity=mon.2 client_cookie=fc1fd4802af50366 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.198 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae7f7fe700 1 -- 172.21.15.116:0/474907279 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78009760 con 0x7fae800802d0 2020-07-16T20:30:11.198 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae7f7fe700 1 -- 172.21.15.116:0/474907279 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae780098c0 con 0x7fae800802d0 2020-07-16T20:30:11.199 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae7f7fe700 1 -- 172.21.15.116:0/474907279 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae78009c20 con 0x7fae800802d0 2020-07-16T20:30:11.199 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 -- 172.21.15.116:0/474907279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 msgr2=0x7fae80080740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.200 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 --2- 172.21.15.116:0/474907279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 0x7fae80080740 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fae78002f30 tx=0x7fae78006dd0).stop 2020-07-16T20:30:11.200 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 -- 172.21.15.116:0/474907279 shutdown_connections 2020-07-16T20:30:11.200 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 --2- 172.21.15.116:0/474907279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fae800802d0 0x7fae80080740 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.201 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 --2- 172.21.15.116:0/474907279 >> v2:172.21.15.22:3300/0 conn(0x7fae8009e170 0x7fae8009e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.201 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 -- 172.21.15.116:0/474907279 >> 172.21.15.116:0/474907279 conn(0x7fae800b93a0 msgr2=0x7fae800b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.201 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 -- 172.21.15.116:0/474907279 shutdown_connections 2020-07-16T20:30:11.201 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.179+0000 7fae86a25700 1 -- 172.21.15.116:0/474907279 wait complete. 2020-07-16T20:30:11.202 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.181+0000 7fae86a25700 1 Processor -- start 2020-07-16T20:30:11.202 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.181+0000 7fae86a25700 1 -- start start 2020-07-16T20:30:11.205 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.181+0000 7fae86a25700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae800b5930 0x7fae800b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.205 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.181+0000 7fae86a25700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8013b350 con 0x7fae8009e170 2020-07-16T20:30:11.205 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae86a25700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8007fff0 con 0x7fae8012a1b0 2020-07-16T20:30:11.206 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae86a25700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8013ad60 con 0x7fae800b5930 2020-07-16T20:30:11.206 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae857c3700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fae8012a1b0 0x7fae8013a650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:36954/0 (socket says 172.21.15.116:36954) 2020-07-16T20:30:11.206 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae857c3700 1 -- 172.21.15.116:0/1634479096 learned_addr learned my addr 172.21.15.116:0/1634479096 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:11.206 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1634479096 >> v2:172.21.15.22:3300/0 conn(0x7fae800b5930 0x7fae800b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.207 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252759801 0 0) 0x7fae8007fff0 con 0x7fae8012a1b0 2020-07-16T20:30:11.207 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae5c003240 con 0x7fae8012a1b0 2020-07-16T20:30:11.207 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae7ffff700 1 -- 172.21.15.116:0/1634479096 >> v1:172.21.15.116:6789/0 conn(0x7fae8012a1b0 legacy=0x7fae8013a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.207 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae7ffff700 1 -- 172.21.15.116:0/1634479096 >> v1:172.21.15.22:6789/0 conn(0x7fae8009e170 legacy=0x7fae800ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.208 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462374601 0 0) 0x7fae8013b350 con 0x7fae8009e170 2020-07-16T20:30:11.208 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae7ffff700 1 -- 172.21.15.116:0/1634479096 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8007f1d0 con 0x7fae800b5930 2020-07-16T20:30:11.208 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae7ffff700 1 --2- 172.21.15.116:0/1634479096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800b5930 0x7fae800b0c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fae6800c000 tx=0x7fae68006dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.208 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6800ca10 con 0x7fae800b5930 2020-07-16T20:30:11.209 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800cb70 con 0x7fae800b5930 2020-07-16T20:30:11.209 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8007f420 con 0x7fae800b5930 2020-07-16T20:30:11.209 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae68011450 con 0x7fae800b5930 2020-07-16T20:30:11.231 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8007f970 con 0x7fae800b5930 2020-07-16T20:30:11.231 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 514+0+0 (secure 0 0 0) 0x7fae68021070 con 0x7fae800b5930 2020-07-16T20:30:11.232 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.182+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fae6801a790 con 0x7fae800b5930 2020-07-16T20:30:11.232 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.183+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae800b69c0 con 0x7fae800b5930 2020-07-16T20:30:11.233 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.185+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fae68038a00 con 0x7fae800b5930 2020-07-16T20:30:11.273 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.271+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "589d421d-97ff-46e8-8d23-96744c404e3f", "id": 0} v 0) v1 -- 0x7fae8013aea0 con 0x7fae800b5930 2020-07-16T20:30:11.278 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.276+0000 7fae77fff700 1 -- 172.21.15.116:0/1634479096 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "589d421d-97ff-46e8-8d23-96744c404e3f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae68028030 con 0x7fae800b5930 2020-07-16T20:30:11.278 INFO:teuthology.orchestra.run.smithi116.stdout:0 2020-07-16T20:30:11.280 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800b5930 msgr2=0x7fae800b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.280 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 --2- 172.21.15.116:0/1634479096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800b5930 0x7fae800b0c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fae6800c000 tx=0x7fae68006dd0).stop 2020-07-16T20:30:11.281 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 shutdown_connections 2020-07-16T20:30:11.281 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 --2- 172.21.15.116:0/1634479096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800b5930 0x7fae800b0c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.281 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 >> 172.21.15.116:0/1634479096 conn(0x7fae800b93a0 msgr2=0x7fae80063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.282 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 shutdown_connections 2020-07-16T20:30:11.282 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.277+0000 7fae86a25700 1 -- 172.21.15.116:0/1634479096 wait complete. 2020-07-16T20:30:11.289 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new ad13e8a9-e5b6-4dc9-935a-b41634158602 1 2020-07-16T20:30:11.417 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.413+0000 7f7b0076f700 1 Processor -- start 2020-07-16T20:30:11.418 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.413+0000 7f7b0076f700 1 -- start start 2020-07-16T20:30:11.418 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.413+0000 7f7b0076f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.418 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.418 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af8064620 con 0x7f7af809e170 2020-07-16T20:30:11.418 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af8064890 con 0x7f7af80b5930 2020-07-16T20:30:11.419 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8064b30 con 0x7f7af809e600 2020-07-16T20:30:11.419 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afed0c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.419 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.419 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afed0c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60462/0 (socket says 172.21.15.116:60462) 2020-07-16T20:30:11.419 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afed0c700 1 -- 172.21.15.116:0/2151578565 learned_addr learned my addr 172.21.15.116:0/2151578565 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:11.420 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41968/0 (socket says 172.21.15.116:41968) 2020-07-16T20:30:11.420 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 -- 172.21.15.116:0/2151578565 >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 msgr2=0x7f7af805f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:11.420 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 --2- 172.21.15.116:0/2151578565 >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.420 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 -- 172.21.15.116:0/2151578565 >> v1:172.21.15.22:6789/0 conn(0x7f7af809e170 legacy=0x7f7af80802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.420 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 -- 172.21.15.116:0/2151578565 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80627d0 con 0x7f7af809e600 2020-07-16T20:30:11.421 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afed0c700 1 --2- 172.21.15.116:0/2151578565 >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:11.421 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7aff50d700 1 --2- 172.21.15.116:0/2151578565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7af00032b0 tx=0x7f7af00091d0).ready entity=mon.2 client_cookie=a462f8f0aa01bcd4 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.421 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afdd0a700 1 -- 172.21.15.116:0/2151578565 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7af000b9a0 con 0x7f7af809e600 2020-07-16T20:30:11.421 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afdd0a700 1 -- 172.21.15.116:0/2151578565 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af000bb00 con 0x7f7af809e600 2020-07-16T20:30:11.421 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7afdd0a700 1 -- 172.21.15.116:0/2151578565 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7af000bc70 con 0x7f7af809e600 2020-07-16T20:30:11.430 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- 172.21.15.116:0/2151578565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 msgr2=0x7f7af80809e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.430 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 --2- 172.21.15.116:0/2151578565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f7af00032b0 tx=0x7f7af00091d0).stop 2020-07-16T20:30:11.430 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- 172.21.15.116:0/2151578565 shutdown_connections 2020-07-16T20:30:11.430 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 --2- 172.21.15.116:0/2151578565 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af809e600 0x7f7af80809e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.431 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 --2- 172.21.15.116:0/2151578565 >> v2:172.21.15.116:3300/0 conn(0x7f7af80b5930 0x7f7af805f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.431 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- 172.21.15.116:0/2151578565 >> 172.21.15.116:0/2151578565 conn(0x7f7af80b93a0 msgr2=0x7f7af80b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.431 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- 172.21.15.116:0/2151578565 shutdown_connections 2020-07-16T20:30:11.431 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.414+0000 7f7b0076f700 1 -- 172.21.15.116:0/2151578565 wait complete. 2020-07-16T20:30:11.433 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.416+0000 7f7b0076f700 1 Processor -- start 2020-07-16T20:30:11.434 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.416+0000 7f7b0076f700 1 -- start start 2020-07-16T20:30:11.434 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7b0076f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 0x7f7af80b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.434 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7b0076f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.434 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7b0076f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af812d510 con 0x7f7af809e170 2020-07-16T20:30:11.435 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7b0076f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af80b40e0 con 0x7f7af8065110 2020-07-16T20:30:11.435 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7b0076f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80b42d0 con 0x7f7af80b5930 2020-07-16T20:30:11.435 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7aff50d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.436 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7afe50b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 0x7f7af80b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.436 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7aff50d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60470/0 (socket says 172.21.15.116:60470) 2020-07-16T20:30:11.436 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7aff50d700 1 -- 172.21.15.116:0/1219633876 learned_addr learned my addr 172.21.15.116:0/1219633876 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:11.437 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7afe50b700 1 -- 172.21.15.116:0/1219633876 >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 msgr2=0x7f7af807fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.437 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7afe50b700 1 --2- 172.21.15.116:0/1219633876 >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.437 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7afe50b700 1 -- 172.21.15.116:0/1219633876 >> v1:172.21.15.22:6789/0 conn(0x7f7af809e170 legacy=0x7f7af80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.438 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7afe50b700 1 -- 172.21.15.116:0/1219633876 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af812d190 con 0x7f7af80b5930 2020-07-16T20:30:11.438 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.417+0000 7f7aff50d700 1 --2- 172.21.15.116:0/1219633876 >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:11.438 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7afe50b700 1 --2- 172.21.15.116:0/1219633876 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 0x7f7af80b2980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7af8062080 tx=0x7f7ae8007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.439 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ae800e4a0 con 0x7f7af80b5930 2020-07-16T20:30:11.439 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae800e600 con 0x7f7af80b5930 2020-07-16T20:30:11.439 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8065580 con 0x7f7af80b5930 2020-07-16T20:30:11.440 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ae800e960 con 0x7f7af80b5930 2020-07-16T20:30:11.440 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af80803d0 con 0x7f7af80b5930 2020-07-16T20:30:11.440 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.418+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f7ae8010030 con 0x7f7af80b5930 2020-07-16T20:30:11.441 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.419+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f7ae8037f20 con 0x7f7af80b5930 2020-07-16T20:30:11.441 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.419+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af812d380 con 0x7f7af80b5930 2020-07-16T20:30:11.441 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.421+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f7ae800eac0 con 0x7f7af80b5930 2020-07-16T20:30:11.506 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.504+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ad13e8a9-e5b6-4dc9-935a-b41634158602", "id": 1} v 0) v1 -- 0x7f7af812d6a0 con 0x7f7af80b5930 2020-07-16T20:30:11.514 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.512+0000 7f7ae6ffd700 1 -- 172.21.15.116:0/1219633876 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad13e8a9-e5b6-4dc9-935a-b41634158602", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ae801be40 con 0x7f7af80b5930 2020-07-16T20:30:11.515 INFO:teuthology.orchestra.run.smithi116.stdout:1 2020-07-16T20:30:11.517 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 msgr2=0x7f7af80b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.517 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 --2- 172.21.15.116:0/1219633876 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 0x7f7af80b2980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f7af8062080 tx=0x7f7ae8007b70).stop 2020-07-16T20:30:11.517 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 shutdown_connections 2020-07-16T20:30:11.517 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 --2- 172.21.15.116:0/1219633876 >> v2:172.21.15.116:3300/0 conn(0x7f7af8065110 0x7f7af807fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 --2- 172.21.15.116:0/1219633876 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7af80b5930 0x7f7af80b2980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 >> 172.21.15.116:0/1219633876 conn(0x7f7af80b93a0 msgr2=0x7f7af80663c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 shutdown_connections 2020-07-16T20:30:11.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.513+0000 7f7b0076f700 1 -- 172.21.15.116:0/1219633876 wait complete. 2020-07-16T20:30:11.527 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 5b2b9d45-ed43-4c75-b3c6-49b336e39c94 2 2020-07-16T20:30:11.647 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 Processor -- start 2020-07-16T20:30:11.648 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 -- start start 2020-07-16T20:30:11.648 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7c009e170 0x7fc7c009e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.649 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.649 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c0064620 con 0x7fc7c00b5930 2020-07-16T20:30:11.649 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c0064890 con 0x7fc7c009e170 2020-07-16T20:30:11.650 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7c4ee5700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0064b30 con 0x7fc7c00802d0 2020-07-16T20:30:11.650 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7bf59e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.651 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7be59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7c009e170 0x7fc7c009e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.651 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7bed9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc7c00b5930 0x7fc7c005f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37016/0 (socket says 172.21.15.116:37016) 2020-07-16T20:30:11.651 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7bed9d700 1 -- 172.21.15.116:0/1058679554 learned_addr learned my addr 172.21.15.116:0/1058679554 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:11.652 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7be59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc7c009e170 0x7fc7c009e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60472/0 (socket says 172.21.15.116:60472) 2020-07-16T20:30:11.652 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.644+0000 7fc7bf59e700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41980/0 (socket says 172.21.15.116:41980) 2020-07-16T20:30:11.652 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7be59c700 1 -- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 msgr2=0x7fc7c0080740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:11.653 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7be59c700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.653 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7be59c700 1 -- 172.21.15.116:0/1058679554 >> v1:172.21.15.116:6789/0 conn(0x7fc7c00b5930 legacy=0x7fc7c005f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.654 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7be59c700 1 -- 172.21.15.116:0/1058679554 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00627d0 con 0x7fc7c009e170 2020-07-16T20:30:11.654 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7bdd9b700 1 -- 172.21.15.116:0/1058679554 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982905030 0 0) 0x7fc7c0064620 con 0x7fc7c00b5930 2020-07-16T20:30:11.654 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7bf59e700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:11.655 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7be59c700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c009e170 0x7fc7c009e600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc7b4002f30 tx=0x7fc7b4006dd0).ready entity=mon.1 client_cookie=bf63ec5f74da039d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.656 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7bdd9b700 1 -- 172.21.15.116:0/1058679554 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7b4009760 con 0x7fc7c009e170 2020-07-16T20:30:11.656 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7bdd9b700 1 -- 172.21.15.116:0/1058679554 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b40098c0 con 0x7fc7c009e170 2020-07-16T20:30:11.656 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7bdd9b700 1 -- 172.21.15.116:0/1058679554 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7b4009c20 con 0x7fc7c009e170 2020-07-16T20:30:11.657 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c009e170 msgr2=0x7fc7c009e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.657 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c009e170 0x7fc7c009e600 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc7b4002f30 tx=0x7fc7b4006dd0).stop 2020-07-16T20:30:11.657 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/1058679554 shutdown_connections 2020-07-16T20:30:11.658 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c00802d0 0x7fc7c0080740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.658 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/1058679554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc7c009e170 0x7fc7c009e600 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.658 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/1058679554 >> 172.21.15.116:0/1058679554 conn(0x7fc7c00b93a0 msgr2=0x7fc7c00b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.659 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/1058679554 shutdown_connections 2020-07-16T20:30:11.659 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.645+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/1058679554 wait complete. 2020-07-16T20:30:11.664 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.647+0000 7fc7c4ee5700 1 Processor -- start 2020-07-16T20:30:11.665 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.647+0000 7fc7c4ee5700 1 -- start start 2020-07-16T20:30:11.665 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 0x7fc7c0065110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.666 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.666 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c00af300 con 0x7fc7c00b5930 2020-07-16T20:30:11.666 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00af570 con 0x7fc7c00802d0 2020-07-16T20:30:11.667 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00af810 con 0x7fc7c013f910 2020-07-16T20:30:11.668 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.668 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7be59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc7c00b5930 0x7fc7c00aebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37022/0 (socket says 172.21.15.116:37022) 2020-07-16T20:30:11.668 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7be59c700 1 -- 172.21.15.116:0/3652904440 learned_addr learned my addr 172.21.15.116:0/3652904440 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:11.669 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 --2- 172.21.15.116:0/3652904440 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41986/0 (socket says 172.21.15.116:41986) 2020-07-16T20:30:11.669 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bed9d700 1 --2- 172.21.15.116:0/3652904440 >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 0x7fc7c0065110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.670 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822319889 0 0) 0x7fc7c00af300 con 0x7fc7c00b5930 2020-07-16T20:30:11.670 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 -- 172.21.15.116:0/3652904440 >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 msgr2=0x7fc7c0065110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.670 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 --2- 172.21.15.116:0/3652904440 >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 0x7fc7c0065110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.671 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 -- 172.21.15.116:0/3652904440 >> v1:172.21.15.116:6789/0 conn(0x7fc7c00b5930 legacy=0x7fc7c00aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.671 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 -- 172.21.15.116:0/3652904440 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00afab0 con 0x7fc7c013f910 2020-07-16T20:30:11.671 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bed9d700 1 --2- 172.21.15.116:0/3652904440 >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 0x7fc7c0065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:11.672 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7bf59e700 1 --2- 172.21.15.116:0/3652904440 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc7b000c000 tx=0x7fc7b0006dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.672 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7b000cb40 con 0x7fc7c013f910 2020-07-16T20:30:11.672 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b000cca0 con 0x7fc7c013f910 2020-07-16T20:30:11.673 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7b00123f0 con 0x7fc7c013f910 2020-07-16T20:30:11.673 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c0065600 con 0x7fc7c013f910 2020-07-16T20:30:11.674 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.648+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c01404f0 con 0x7fc7c013f910 2020-07-16T20:30:11.674 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.649+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7fc7b0012550 con 0x7fc7c013f910 2020-07-16T20:30:11.674 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.649+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1360+0+0 (secure 0 0 0) 0x7fc7b0038d30 con 0x7fc7c013f910 2020-07-16T20:30:11.675 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.649+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c0080110 con 0x7fc7c013f910 2020-07-16T20:30:11.675 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.651+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fc7b0010670 con 0x7fc7c013f910 2020-07-16T20:30:11.737 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.735+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b2b9d45-ed43-4c75-b3c6-49b336e39c94", "id": 2} v 0) v1 -- 0x7fc7c0057490 con 0x7fc7c013f910 2020-07-16T20:30:11.751 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.744+0000 7fc7a67fc700 1 -- 172.21.15.116:0/3652904440 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b2b9d45-ed43-4c75-b3c6-49b336e39c94", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7b00102b0 con 0x7fc7c013f910 2020-07-16T20:30:11.751 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 msgr2=0x7fc7c013fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.751 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/3652904440 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fc7b000c000 tx=0x7fc7b0006dd0).stop 2020-07-16T20:30:11.751 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 shutdown_connections 2020-07-16T20:30:11.752 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/3652904440 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc7c013f910 0x7fc7c013fdc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.752 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 --2- 172.21.15.116:0/3652904440 >> v2:172.21.15.22:3300/0 conn(0x7fc7c00802d0 0x7fc7c0065110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.752 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 >> 172.21.15.116:0/3652904440 conn(0x7fc7c00b93a0 msgr2=0x7fc7c0067a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.752 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 shutdown_connections 2020-07-16T20:30:11.752 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.745+0000 7fc7c4ee5700 1 -- 172.21.15.116:0/3652904440 wait complete. 2020-07-16T20:30:11.753 INFO:teuthology.orchestra.run.smithi116.stdout:2 2020-07-16T20:30:11.756 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new d7f4bab9-7996-49ae-bcac-f1ce415ac8b6 3 2020-07-16T20:30:11.863 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.859+0000 7f4fe06af700 1 Processor -- start 2020-07-16T20:30:11.864 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.859+0000 7f4fe06af700 1 -- start start 2020-07-16T20:30:11.864 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.864 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4fd809e5d0 0x7f4fd80809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.865 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd8064620 con 0x7f4fd809e170 2020-07-16T20:30:11.865 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd8064890 con 0x7f4fd809e5d0 2020-07-16T20:30:11.866 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8064b30 con 0x7f4fd80b5930 2020-07-16T20:30:11.866 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.866 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:41990/0 (socket says 172.21.15.116:41990) 2020-07-16T20:30:11.867 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 -- 172.21.15.116:0/2865547877 learned_addr learned my addr 172.21.15.116:0/2865547877 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:11.867 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdf44d700 1 --2- 172.21.15.116:0/2865547877 >> v2:172.21.15.22:3300/0 conn(0x7f4fd809e5d0 0x7f4fd80809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.867 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 -- 172.21.15.116:0/2865547877 >> v2:172.21.15.22:3300/0 conn(0x7f4fd809e5d0 msgr2=0x7f4fd80809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:11.868 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 --2- 172.21.15.116:0/2865547877 >> v2:172.21.15.22:3300/0 conn(0x7f4fd809e5d0 0x7f4fd80809e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.869 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 -- 172.21.15.116:0/2865547877 >> v1:172.21.15.22:6789/0 conn(0x7f4fd809e170 legacy=0x7f4fd80802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:11.869 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 -- 172.21.15.116:0/2865547877 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80627d0 con 0x7f4fd80b5930 2020-07-16T20:30:11.870 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fdec4c700 1 --2- 172.21.15.116:0/2865547877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4fd80600b0 tx=0x7f4fd4006e90).ready entity=mon.2 client_cookie=6e8787d84db2c7b4 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.870 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fddc4a700 1 -- 172.21.15.116:0/2865547877 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd40098e0 con 0x7f4fd80b5930 2020-07-16T20:30:11.870 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fddc4a700 1 -- 172.21.15.116:0/2865547877 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd4009a40 con 0x7f4fd80b5930 2020-07-16T20:30:11.871 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fddc4a700 1 -- 172.21.15.116:0/2865547877 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd4009de0 con 0x7f4fd80b5930 2020-07-16T20:30:11.871 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 -- 172.21.15.116:0/2865547877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 msgr2=0x7f4fd805f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.871 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.860+0000 7f4fe06af700 1 --2- 172.21.15.116:0/2865547877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4fd80600b0 tx=0x7f4fd4006e90).stop 2020-07-16T20:30:11.872 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 -- 172.21.15.116:0/2865547877 shutdown_connections 2020-07-16T20:30:11.872 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 --2- 172.21.15.116:0/2865547877 >> v2:172.21.15.22:3300/0 conn(0x7f4fd809e5d0 0x7f4fd80809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.872 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 --2- 172.21.15.116:0/2865547877 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b5930 0x7f4fd805f7a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.873 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 -- 172.21.15.116:0/2865547877 >> 172.21.15.116:0/2865547877 conn(0x7f4fd80b93a0 msgr2=0x7f4fd80b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.873 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 -- 172.21.15.116:0/2865547877 shutdown_connections 2020-07-16T20:30:11.873 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.861+0000 7f4fe06af700 1 -- 172.21.15.116:0/2865547877 wait complete. 2020-07-16T20:30:11.879 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.862+0000 7f4fe06af700 1 Processor -- start 2020-07-16T20:30:11.879 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 -- start start 2020-07-16T20:30:11.880 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 0x7f4fd8080a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.880 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:11.880 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80b0130 con 0x7f4fd809e5d0 2020-07-16T20:30:11.881 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80aff50 con 0x7f4fd809e170 2020-07-16T20:30:11.881 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fe06af700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80b03d0 con 0x7f4fd80b0870 2020-07-16T20:30:11.881 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fdf44d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.881 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fdec4c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 0x7f4fd8080a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:11.882 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fdf44d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:42000/0 (socket says 172.21.15.116:42000) 2020-07-16T20:30:11.882 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.863+0000 7f4fdf44d700 1 -- 172.21.15.116:0/1190178178 learned_addr learned my addr 172.21.15.116:0/1190178178 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:11.882 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdf44d700 1 -- 172.21.15.116:0/1190178178 >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 msgr2=0x7f4fd8080a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.883 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdf44d700 1 --2- 172.21.15.116:0/1190178178 >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 0x7f4fd8080a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.883 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdf44d700 1 -- 172.21.15.116:0/1190178178 >> v1:172.21.15.22:6789/0 conn(0x7f4fd809e5d0 legacy=0x7f4fd8157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.884 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdf44d700 1 -- 172.21.15.116:0/1190178178 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8080f10 con 0x7f4fd80b0870 2020-07-16T20:30:11.884 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdec4c700 1 --2- 172.21.15.116:0/1190178178 >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 0x7f4fd8080a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:11.884 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fdf44d700 1 --2- 172.21.15.116:0/1190178178 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4fd0007000 tx=0x7f4fd0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd0007750 con 0x7f4fd80b0870 2020-07-16T20:30:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00078b0 con 0x7f4fd80b0870 2020-07-16T20:30:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd815da10 con 0x7f4fd80b0870 2020-07-16T20:30:11.886 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd0007c10 con 0x7f4fd80b0870 2020-07-16T20:30:11.886 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd80af980 con 0x7f4fd80b0870 2020-07-16T20:30:11.886 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.864+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f4fd001b460 con 0x7f4fd80b0870 2020-07-16T20:30:11.887 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.865+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1499+0+0 (secure 0 0 0) 0x7f4fd0038a80 con 0x7f4fd80b0870 2020-07-16T20:30:11.887 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.865+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8057490 con 0x7f4fd80b0870 2020-07-16T20:30:11.887 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.867+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f4fd001b8d0 con 0x7f4fd80b0870 2020-07-16T20:30:11.952 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.951+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d7f4bab9-7996-49ae-bcac-f1ce415ac8b6", "id": 3} v 0) v1 -- 0x7f4fd80b0540 con 0x7f4fd80b0870 2020-07-16T20:30:11.964 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.959+0000 7f4fc6ffd700 1 -- 172.21.15.116:0/1190178178 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7f4bab9-7996-49ae-bcac-f1ce415ac8b6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4fd000f2d0 con 0x7f4fd80b0870 2020-07-16T20:30:11.965 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 msgr2=0x7f4fd8152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:11.965 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 --2- 172.21.15.116:0/1190178178 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4fd0007000 tx=0x7f4fd0008040).stop 2020-07-16T20:30:11.965 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 shutdown_connections 2020-07-16T20:30:11.965 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 --2- 172.21.15.116:0/1190178178 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4fd80b0870 0x7f4fd8152b70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.966 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 --2- 172.21.15.116:0/1190178178 >> v2:172.21.15.116:3300/0 conn(0x7f4fd809e170 0x7f4fd8080a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:11.966 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 >> 172.21.15.116:0/1190178178 conn(0x7f4fd80b93a0 msgr2=0x7f4fd80b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:11.966 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 shutdown_connections 2020-07-16T20:30:11.967 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:11.960+0000 7f4fe06af700 1 -- 172.21.15.116:0/1190178178 wait complete. 2020-07-16T20:30:11.967 INFO:teuthology.orchestra.run.smithi116.stdout:3 2020-07-16T20:30:11.973 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new c17a5db4-2138-4206-9e5f-5024c7fbfea5 4 2020-07-16T20:30:12.081 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.077+0000 7fe04e6b5700 1 Processor -- start 2020-07-16T20:30:12.081 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.077+0000 7fe04e6b5700 1 -- start start 2020-07-16T20:30:12.082 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.077+0000 7fe04e6b5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04805f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.082 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.077+0000 7fe04e6b5700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe04809e170 0x7fe04809e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.082 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.077+0000 7fe04e6b5700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe048064620 con 0x7fe0480802d0 2020-07-16T20:30:12.083 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe048064890 con 0x7fe0480b5930 2020-07-16T20:30:12.083 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe048064b30 con 0x7fe04809e170 2020-07-16T20:30:12.083 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe04809e170 0x7fe04809e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.084 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe04809e170 0x7fe04809e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60498/0 (socket says 172.21.15.116:60498) 2020-07-16T20:30:12.084 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04d453700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fe0480802d0 0x7fe048080740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37044/0 (socket says 172.21.15.116:37044) 2020-07-16T20:30:12.084 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 -- 172.21.15.116:0/3992641653 learned_addr learned my addr 172.21.15.116:0/3992641653 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.085 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04cc52700 1 --2- 172.21.15.116:0/3992641653 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04805f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.085 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 -- 172.21.15.116:0/3992641653 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 msgr2=0x7fe04805f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:12.085 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 --2- 172.21.15.116:0/3992641653 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04805f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.085 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 -- 172.21.15.116:0/3992641653 >> v1:172.21.15.116:6789/0 conn(0x7fe0480802d0 legacy=0x7fe048080740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.086 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 -- 172.21.15.116:0/3992641653 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480627d0 con 0x7fe04809e170 2020-07-16T20:30:12.086 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe0477fe700 1 -- 172.21.15.116:0/3992641653 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117773951 0 0) 0x7fe048064620 con 0x7fe0480802d0 2020-07-16T20:30:12.086 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe047fff700 1 --2- 172.21.15.116:0/3992641653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe04809e170 0x7fe04809e600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe038002f30 tx=0x7fe038006e90).ready entity=mon.1 client_cookie=b7b1886772212e08 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.086 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe0477fe700 1 -- 172.21.15.116:0/3992641653 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0380099c0 con 0x7fe04809e170 2020-07-16T20:30:12.086 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe0477fe700 1 -- 172.21.15.116:0/3992641653 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe038009b20 con 0x7fe04809e170 2020-07-16T20:30:12.087 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe0477fe700 1 -- 172.21.15.116:0/3992641653 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe038009e80 con 0x7fe04809e170 2020-07-16T20:30:12.087 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- 172.21.15.116:0/3992641653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe04809e170 msgr2=0x7fe04809e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.087 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/3992641653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe04809e170 0x7fe04809e600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fe038002f30 tx=0x7fe038006e90).stop 2020-07-16T20:30:12.087 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- 172.21.15.116:0/3992641653 shutdown_connections 2020-07-16T20:30:12.087 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/3992641653 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04805f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.088 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/3992641653 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe04809e170 0x7fe04809e600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.088 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- 172.21.15.116:0/3992641653 >> 172.21.15.116:0/3992641653 conn(0x7fe0480b93a0 msgr2=0x7fe0480b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.088 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- 172.21.15.116:0/3992641653 shutdown_connections 2020-07-16T20:30:12.088 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.078+0000 7fe04e6b5700 1 -- 172.21.15.116:0/3992641653 wait complete. 2020-07-16T20:30:12.091 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.080+0000 7fe04e6b5700 1 Processor -- start 2020-07-16T20:30:12.091 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.080+0000 7fe04e6b5700 1 -- start start 2020-07-16T20:30:12.092 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe0480802d0 0x7fe04813beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.092 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.092 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe048157d20 con 0x7fe048156430 2020-07-16T20:30:12.092 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe048157fc0 con 0x7fe0480b5930 2020-07-16T20:30:12.092 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe048158260 con 0x7fe0480802d0 2020-07-16T20:30:12.093 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe0480802d0 0x7fe04813beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.093 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe0480802d0 0x7fe04813beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60502/0 (socket says 172.21.15.116:60502) 2020-07-16T20:30:12.093 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 -- 172.21.15.116:0/1256550990 learned_addr learned my addr 172.21.15.116:0/1256550990 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.093 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe047fff700 1 --2- 172.21.15.116:0/1256550990 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.093 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 -- 172.21.15.116:0/1256550990 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 msgr2=0x7fe04815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.094 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 --2- 172.21.15.116:0/1256550990 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.094 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 -- 172.21.15.116:0/1256550990 >> v1:172.21.15.22:6789/0 conn(0x7fe048156430 legacy=0x7fe048158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.094 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 -- 172.21.15.116:0/1256550990 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04813c3a0 con 0x7fe0480802d0 2020-07-16T20:30:12.094 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04cc52700 1 --2- 172.21.15.116:0/1256550990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0480802d0 0x7fe04813beb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe030003070 tx=0x7fe030008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.094 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe030009980 con 0x7fe0480802d0 2020-07-16T20:30:12.095 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030009ae0 con 0x7fe0480802d0 2020-07-16T20:30:12.095 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe048158e10 con 0x7fe0480802d0 2020-07-16T20:30:12.095 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe030009e40 con 0x7fe0480802d0 2020-07-16T20:30:12.097 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.081+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048155140 con 0x7fe0480802d0 2020-07-16T20:30:12.097 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.082+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7fe030013480 con 0x7fe0480802d0 2020-07-16T20:30:12.098 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.082+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1614+0+0 (secure 0 0 0) 0x7fe030038df0 con 0x7fe0480802d0 2020-07-16T20:30:12.098 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.082+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe048057490 con 0x7fe0480802d0 2020-07-16T20:30:12.098 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.084+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7fe0300104c0 con 0x7fe0480802d0 2020-07-16T20:30:12.170 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.168+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c17a5db4-2138-4206-9e5f-5024c7fbfea5", "id": 4} v 0) v1 -- 0x7fe0480645d0 con 0x7fe0480802d0 2020-07-16T20:30:12.177 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.175+0000 7fe03ffff700 1 -- 172.21.15.116:0/1256550990 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c17a5db4-2138-4206-9e5f-5024c7fbfea5", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0300102e0 con 0x7fe0480802d0 2020-07-16T20:30:12.177 INFO:teuthology.orchestra.run.smithi116.stdout:4 2020-07-16T20:30:12.178 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0480802d0 msgr2=0x7fe04813beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.178 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/1256550990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0480802d0 0x7fe04813beb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe030003070 tx=0x7fe030008040).stop 2020-07-16T20:30:12.178 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 shutdown_connections 2020-07-16T20:30:12.179 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/1256550990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe0480802d0 0x7fe04813beb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.179 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 --2- 172.21.15.116:0/1256550990 >> v2:172.21.15.22:3300/0 conn(0x7fe0480b5930 0x7fe04815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.179 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 >> 172.21.15.116:0/1256550990 conn(0x7fe0480b93a0 msgr2=0x7fe048063b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.179 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 shutdown_connections 2020-07-16T20:30:12.179 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.176+0000 7fe04e6b5700 1 -- 172.21.15.116:0/1256550990 wait complete. 2020-07-16T20:30:12.188 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new c671f599-5dc0-4842-8efe-cbbe9a2905fb 5 2020-07-16T20:30:12.296 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.292+0000 7f5792bd9700 1 Processor -- start 2020-07-16T20:30:12.297 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.292+0000 7f5792bd9700 1 -- start start 2020-07-16T20:30:12.297 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.292+0000 7f5792bd9700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.297 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.298 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c064620 con 0x7f578c09e170 2020-07-16T20:30:12.306 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c064890 con 0x7f578c0b5930 2020-07-16T20:30:12.307 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c064b30 con 0x7f578c09e600 2020-07-16T20:30:12.307 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.307 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791176700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.308 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:42018/0 (socket says 172.21.15.116:42018) 2020-07-16T20:30:12.308 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791176700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:60508/0 (socket says 172.21.15.116:60508) 2020-07-16T20:30:12.308 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 -- 172.21.15.116:0/657948454 learned_addr learned my addr 172.21.15.116:0/657948454 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.309 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 -- 172.21.15.116:0/657948454 >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 msgr2=0x7f578c05f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:12.309 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 --2- 172.21.15.116:0/657948454 >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.312 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 -- 172.21.15.116:0/657948454 >> v1:172.21.15.22:6789/0 conn(0x7f578c09e170 legacy=0x7f578c0802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:12.312 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 -- 172.21.15.116:0/657948454 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0627d0 con 0x7f578c09e600 2020-07-16T20:30:12.313 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791176700 1 --2- 172.21.15.116:0/657948454 >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:12.313 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5791977700 1 --2- 172.21.15.116:0/657948454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f578c062080 tx=0x7f5784009270).ready entity=mon.2 client_cookie=e61205b9ba275240 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.314 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5783fff700 1 -- 172.21.15.116:0/657948454 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784009e60 con 0x7f578c09e600 2020-07-16T20:30:12.314 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5783fff700 1 -- 172.21.15.116:0/657948454 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400bbc0 con 0x7f578c09e600 2020-07-16T20:30:12.314 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5783fff700 1 -- 172.21.15.116:0/657948454 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578400bd30 con 0x7f578c09e600 2020-07-16T20:30:12.315 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- 172.21.15.116:0/657948454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 msgr2=0x7f578c0809e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.315 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 --2- 172.21.15.116:0/657948454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f578c062080 tx=0x7f5784009270).stop 2020-07-16T20:30:12.316 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- 172.21.15.116:0/657948454 shutdown_connections 2020-07-16T20:30:12.316 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 --2- 172.21.15.116:0/657948454 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e600 0x7f578c0809e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.316 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 --2- 172.21.15.116:0/657948454 >> v2:172.21.15.116:3300/0 conn(0x7f578c0b5930 0x7f578c05f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.319 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- 172.21.15.116:0/657948454 >> 172.21.15.116:0/657948454 conn(0x7f578c0b93a0 msgr2=0x7f578c0b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.320 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- 172.21.15.116:0/657948454 shutdown_connections 2020-07-16T20:30:12.320 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.293+0000 7f5792bd9700 1 -- 172.21.15.116:0/657948454 wait complete. 2020-07-16T20:30:12.345 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.295+0000 7f5792bd9700 1 Processor -- start 2020-07-16T20:30:12.345 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.295+0000 7f5792bd9700 1 -- start start 2020-07-16T20:30:12.346 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5792bd9700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.346 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5792bd9700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f578c064f50 0x7f578c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.346 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5792bd9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c13c7f0 con 0x7f578c0b5930 2020-07-16T20:30:12.347 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5792bd9700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c065a20 con 0x7f578c064f50 2020-07-16T20:30:12.347 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5792bd9700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c155fe0 con 0x7f578c09e170 2020-07-16T20:30:12.347 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791176700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.348 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f578c064f50 0x7f578c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.348 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791176700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:42020/0 (socket says 172.21.15.116:42020) 2020-07-16T20:30:12.348 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791176700 1 -- 172.21.15.116:0/3901523988 learned_addr learned my addr 172.21.15.116:0/3901523988 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.349 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 -- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 msgr2=0x7f578c13c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.349 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.349 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 -- 172.21.15.116:0/3901523988 >> v1:172.21.15.22:6789/0 conn(0x7f578c0b5930 legacy=0x7f578c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.350 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 -- 172.21.15.116:0/3901523988 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c156280 con 0x7f578c064f50 2020-07-16T20:30:12.350 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791176700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:12.351 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5791977700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f578c064f50 0x7f578c156720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f578c062080 tx=0x7f5784016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.351 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57840107a0 con 0x7f578c064f50 2020-07-16T20:30:12.351 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.296+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784010900 con 0x7f578c064f50 2020-07-16T20:30:12.352 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.297+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c156c10 con 0x7f578c064f50 2020-07-16T20:30:12.352 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.297+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784010c60 con 0x7f578c064f50 2020-07-16T20:30:12.352 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.297+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0802d0 con 0x7f578c064f50 2020-07-16T20:30:12.353 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.297+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 2) v1 ==== 31010+0+0 (secure 0 0 0) 0x7f578400f070 con 0x7f578c064f50 2020-07-16T20:30:12.353 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.297+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f5784039b20 con 0x7f578c064f50 2020-07-16T20:30:12.353 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.298+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c057490 con 0x7f578c064f50 2020-07-16T20:30:12.354 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.299+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+68080 (secure 0 0 0) 0x7f5784015080 con 0x7f578c064f50 2020-07-16T20:30:12.354 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.337+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7f578402a710 con 0x7f578c064f50 2020-07-16T20:30:12.354 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.338+0000 7f5780ff9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 0x7f5764053220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.355 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.338+0000 7f5791176700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 0x7f5764053220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.355 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.339+0000 7f5791176700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 0x7f5764053220 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f577c00b000 tx=0x7f577c006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.392 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.391+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c671f599-5dc0-4842-8efe-cbbe9a2905fb", "id": 5} v 0) v1 -- 0x7f578c15f150 con 0x7f578c064f50 2020-07-16T20:30:12.398 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.397+0000 7f5780ff9700 1 -- 172.21.15.116:0/3901523988 <== mon.1 v2:172.21.15.116:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c671f599-5dc0-4842-8efe-cbbe9a2905fb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5784033cf0 con 0x7f578c064f50 2020-07-16T20:30:12.399 INFO:teuthology.orchestra.run.smithi116.stdout:5 2020-07-16T20:30:12.401 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 msgr2=0x7f5764053220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.401 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 0x7f5764053220 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f577c00b000 tx=0x7f577c006dd0).stop 2020-07-16T20:30:12.402 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f578c064f50 msgr2=0x7f578c156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.402 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f578c064f50 0x7f578c156720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f578c062080 tx=0x7f5784016000).stop 2020-07-16T20:30:12.402 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 shutdown_connections 2020-07-16T20:30:12.402 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5764050e30 0x7f5764053220 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.403 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f578c064f50 0x7f578c156720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.403 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 --2- 172.21.15.116:0/3901523988 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f578c09e170 0x7f578c13c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.403 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 >> 172.21.15.116:0/3901523988 conn(0x7f578c0b93a0 msgr2=0x7f578c09d570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.403 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 shutdown_connections 2020-07-16T20:30:12.404 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.398+0000 7f5792bd9700 1 -- 172.21.15.116:0/3901523988 wait complete. 2020-07-16T20:30:12.409 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 072fab5f-a44c-4162-bd12-87d991ab2823 6 2020-07-16T20:30:12.517 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.513+0000 7fdbc46b1700 1 Processor -- start 2020-07-16T20:30:12.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.513+0000 7fdbc46b1700 1 -- start start 2020-07-16T20:30:12.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.513+0000 7fdbc46b1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdbbc0b5930 0x7fdbbc05f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.513+0000 7fdbc46b1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc064620 con 0x7fdbbc09e170 2020-07-16T20:30:12.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc064890 con 0x7fdbbc09e600 2020-07-16T20:30:12.518 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc064b30 con 0x7fdbbc0b5930 2020-07-16T20:30:12.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc2c4e700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdbbc0b5930 0x7fdbbc05f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc344f700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdbbc09e600 0x7fdbbc0809e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37080/0 (socket says 172.21.15.116:37080) 2020-07-16T20:30:12.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc344f700 1 -- 172.21.15.116:0/1827981777 learned_addr learned my addr 172.21.15.116:0/1827981777 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:12.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc2c4e700 1 -- 172.21.15.116:0/1827981777 >> v1:172.21.15.116:6789/0 conn(0x7fdbbc09e600 legacy=0x7fdbbc0809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.519 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc2c4e700 1 -- 172.21.15.116:0/1827981777 >> v1:172.21.15.22:6789/0 conn(0x7fdbbc09e170 legacy=0x7fdbbc0802d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.520 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc1c4c700 1 -- 172.21.15.116:0/1827981777 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944478219 0 0) 0x7fdbbc064890 con 0x7fdbbc09e600 2020-07-16T20:30:12.520 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc2c4e700 1 -- 172.21.15.116:0/1827981777 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0627d0 con 0x7fdbbc0b5930 2020-07-16T20:30:12.520 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc2c4e700 1 --2- 172.21.15.116:0/1827981777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc0b5930 0x7fdbbc05f7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdbb8002f30 tx=0x7fdbb8006dd0).ready entity=mon.1 client_cookie=cd43677ad3733d98 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.520 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc1c4c700 1 -- 172.21.15.116:0/1827981777 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb80097f0 con 0x7fdbbc0b5930 2020-07-16T20:30:12.521 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc1c4c700 1 -- 172.21.15.116:0/1827981777 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8009950 con 0x7fdbbc0b5930 2020-07-16T20:30:12.521 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc1c4c700 1 -- 172.21.15.116:0/1827981777 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb8009cb0 con 0x7fdbbc0b5930 2020-07-16T20:30:12.521 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- 172.21.15.116:0/1827981777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc0b5930 msgr2=0x7fdbbc05f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.521 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/1827981777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc0b5930 0x7fdbbc05f7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdbb8002f30 tx=0x7fdbb8006dd0).stop 2020-07-16T20:30:12.521 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- 172.21.15.116:0/1827981777 shutdown_connections 2020-07-16T20:30:12.522 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/1827981777 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc0b5930 0x7fdbbc05f7a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.522 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- 172.21.15.116:0/1827981777 >> 172.21.15.116:0/1827981777 conn(0x7fdbbc0b93a0 msgr2=0x7fdbbc0b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.522 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- 172.21.15.116:0/1827981777 shutdown_connections 2020-07-16T20:30:12.522 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.514+0000 7fdbc46b1700 1 -- 172.21.15.116:0/1827981777 wait complete. 2020-07-16T20:30:12.525 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.516+0000 7fdbc46b1700 1 Processor -- start 2020-07-16T20:30:12.525 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.516+0000 7fdbc46b1700 1 -- start start 2020-07-16T20:30:12.525 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc46b1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdbbc09e600 0x7fdbbc1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.526 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc46b1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdbbc066fe0 0x7fdbbc141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.526 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc46b1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc1546b0 con 0x7fdbbc09e170 2020-07-16T20:30:12.526 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc46b1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc067560 con 0x7fdbbc09e600 2020-07-16T20:30:12.526 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc46b1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc067800 con 0x7fdbbc066fe0 2020-07-16T20:30:12.526 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc2c4e700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdbbc09e170 0x7fdbbc0b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37082/0 (socket says 172.21.15.116:37082) 2020-07-16T20:30:12.527 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc2c4e700 1 -- 172.21.15.116:0/3809155529 learned_addr learned my addr 172.21.15.116:0/3809155529 (peer_addr_for_me v1:172.21.15.116:0/0) 2020-07-16T20:30:12.527 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 --2- 172.21.15.116:0/3809155529 >> v2:172.21.15.116:3300/0 conn(0x7fdbbc066fe0 0x7fdbbc141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.527 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc244d700 1 --2- 172.21.15.116:0/3809155529 >> v2:172.21.15.22:3300/0 conn(0x7fdbbc09e600 0x7fdbbc1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.527 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205006605 0 0) 0x7fdbbc1546b0 con 0x7fdbbc09e170 2020-07-16T20:30:12.527 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb98003240 con 0x7fdbbc09e170 2020-07-16T20:30:12.528 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 -- 172.21.15.116:0/3809155529 >> v2:172.21.15.22:3300/0 conn(0x7fdbbc09e600 msgr2=0x7fdbbc1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.528 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 --2- 172.21.15.116:0/3809155529 >> v2:172.21.15.22:3300/0 conn(0x7fdbbc09e600 0x7fdbbc1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.528 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 -- 172.21.15.116:0/3809155529 >> v1:172.21.15.116:6789/0 conn(0x7fdbbc09e170 legacy=0x7fdbbc0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.528 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 -- 172.21.15.116:0/3809155529 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0b6870 con 0x7fdbbc066fe0 2020-07-16T20:30:12.528 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.517+0000 7fdbc344f700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc066fe0 0x7fdbbc141b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdbb4000f00 tx=0x7fdbb4007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.529 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb4005950 con 0x7fdbbc066fe0 2020-07-16T20:30:12.529 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4005ab0 con 0x7fdbbc066fe0 2020-07-16T20:30:12.529 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc153cf0 con 0x7fdbbc066fe0 2020-07-16T20:30:12.529 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbb4005e10 con 0x7fdbbc066fe0 2020-07-16T20:30:12.529 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc142050 con 0x7fdbbc066fe0 2020-07-16T20:30:12.530 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc068090 con 0x7fdbbc066fe0 2020-07-16T20:30:12.530 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.518+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7fdbb4010030 con 0x7fdbbc066fe0 2020-07-16T20:30:12.530 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.519+0000 7fdbaaffd700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 0x7fdb98052700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.530 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.519+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7fdbb4066810 con 0x7fdbbc066fe0 2020-07-16T20:30:12.530 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.519+0000 7fdbc2c4e700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 0x7fdb98052700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.531 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.519+0000 7fdbc2c4e700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 0x7fdb98052700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fdbb800d000 tx=0x7fdbb8015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.531 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.522+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fdbb40401e0 con 0x7fdbbc066fe0 2020-07-16T20:30:12.684 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.682+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "072fab5f-a44c-4162-bd12-87d991ab2823", "id": 6} v 0) v1 -- 0x7fdbbc057490 con 0x7fdbbc066fe0 2020-07-16T20:30:12.692 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.690+0000 7fdbaaffd700 1 -- 172.21.15.116:0/3809155529 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "072fab5f-a44c-4162-bd12-87d991ab2823", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbb4043800 con 0x7fdbbc066fe0 2020-07-16T20:30:12.692 INFO:teuthology.orchestra.run.smithi116.stdout:6 2020-07-16T20:30:12.694 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 msgr2=0x7fdb98052700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.694 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 0x7fdb98052700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fdbb800d000 tx=0x7fdbb8015000).stop 2020-07-16T20:30:12.694 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc066fe0 msgr2=0x7fdbbc141b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.695 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc066fe0 0x7fdbbc141b60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fdbb4000f00 tx=0x7fdbb4007c60).stop 2020-07-16T20:30:12.695 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 shutdown_connections 2020-07-16T20:30:12.695 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdb98050240 0x7fdb98052700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.696 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/3809155529 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdbbc066fe0 0x7fdbbc141b60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.696 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 --2- 172.21.15.116:0/3809155529 >> v2:172.21.15.22:3300/0 conn(0x7fdbbc09e600 0x7fdbbc1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.696 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 >> 172.21.15.116:0/3809155529 conn(0x7fdbbc0b93a0 msgr2=0x7fdbbc159340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.697 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 shutdown_connections 2020-07-16T20:30:12.697 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.692+0000 7fdbc46b1700 1 -- 172.21.15.116:0/3809155529 wait complete. 2020-07-16T20:30:12.704 INFO:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new ee32368a-83d8-4845-bc9a-e556bc1dd5ff 7 2020-07-16T20:30:12.813 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.808+0000 7fb55fa0f700 1 Processor -- start 2020-07-16T20:30:12.813 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.808+0000 7fb55fa0f700 1 -- start start 2020-07-16T20:30:12.814 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55fa0f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 0x7fb558080c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.814 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55fa0f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.814 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55fa0f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580b3740 con 0x7fb55805fad0 2020-07-16T20:30:12.815 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55fa0f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580b58c0 con 0x7fb5580b5180 2020-07-16T20:30:12.815 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55fa0f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580b5620 con 0x7fb5580b3300 2020-07-16T20:30:12.815 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.817 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:42052/0 (socket says 172.21.15.116:42052) 2020-07-16T20:30:12.817 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3296826883 learned_addr learned my addr 172.21.15.116:0/3296826883 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.817 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55dfac700 1 --2- 172.21.15.116:0/3296826883 >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 0x7fb558080c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.818 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3296826883 >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 msgr2=0x7fb558080c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:12.818 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 --2- 172.21.15.116:0/3296826883 >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 0x7fb558080c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.818 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3296826883 >> v1:172.21.15.22:6789/0 conn(0x7fb55805fad0 legacy=0x7fb5580b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.819 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3296826883 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580b2e60 con 0x7fb5580b3300 2020-07-16T20:30:12.819 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55dfac700 1 --2- 172.21.15.116:0/3296826883 >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 0x7fb558080c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:12.819 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.809+0000 7fb55d7ab700 1 --2- 172.21.15.116:0/3296826883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb548002f30 tx=0x7fb548006e90).ready entity=mon.2 client_cookie=8dc897a321969b18 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.820 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55cfaa700 1 -- 172.21.15.116:0/3296826883 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb548009970 con 0x7fb5580b3300 2020-07-16T20:30:12.820 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55cfaa700 1 -- 172.21.15.116:0/3296826883 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548009ad0 con 0x7fb5580b3300 2020-07-16T20:30:12.820 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55cfaa700 1 -- 172.21.15.116:0/3296826883 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb548009e30 con 0x7fb5580b3300 2020-07-16T20:30:12.821 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3296826883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 msgr2=0x7fb55805f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.821 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3296826883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb548002f30 tx=0x7fb548006e90).stop 2020-07-16T20:30:12.821 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3296826883 shutdown_connections 2020-07-16T20:30:12.823 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3296826883 >> v2:172.21.15.22:3300/0 conn(0x7fb5580b5180 0x7fb558080c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.823 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3296826883 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b3300 0x7fb55805f5e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.824 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3296826883 >> 172.21.15.116:0/3296826883 conn(0x7fb5580b9330 msgr2=0x7fb5580b9740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:12.824 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3296826883 shutdown_connections 2020-07-16T20:30:12.824 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.810+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3296826883 wait complete. 2020-07-16T20:30:12.825 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.811+0000 7fb55fa0f700 1 Processor -- start 2020-07-16T20:30:12.825 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.811+0000 7fb55fa0f700 1 -- start start 2020-07-16T20:30:12.829 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55fa0f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.829 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55fa0f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb558146080 0x7fb5581497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.829 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55fa0f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb558146a50 con 0x7fb55805fad0 2020-07-16T20:30:12.830 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55fa0f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558132040 con 0x7fb558146080 2020-07-16T20:30:12.830 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55fa0f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558146510 con 0x7fb5580b5180 2020-07-16T20:30:12.831 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55d7ab700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.831 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55d7ab700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:42056/0 (socket says 172.21.15.116:42056) 2020-07-16T20:30:12.831 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3948800600 learned_addr learned my addr 172.21.15.116:0/3948800600 (peer_addr_for_me v2:172.21.15.116:0/0) 2020-07-16T20:30:12.832 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.812+0000 7fb55e7ad700 1 --2- 172.21.15.116:0/3948800600 >> v2:172.21.15.22:3300/0 conn(0x7fb558146080 0x7fb5581497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.832 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3948800600 >> v2:172.21.15.22:3300/0 conn(0x7fb558146080 msgr2=0x7fb5581497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.832 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55d7ab700 1 --2- 172.21.15.116:0/3948800600 >> v2:172.21.15.22:3300/0 conn(0x7fb558146080 0x7fb5581497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:12.833 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3948800600 >> v1:172.21.15.22:6789/0 conn(0x7fb55805fad0 legacy=0x7fb5580b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:12.833 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55d7ab700 1 -- 172.21.15.116:0/3948800600 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5581467b0 con 0x7fb5580b5180 2020-07-16T20:30:12.834 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55d7ab700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb548002f30 tx=0x7fb548015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.835 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb548011e40 con 0x7fb5580b5180 2020-07-16T20:30:12.835 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54801d5d0 con 0x7fb5580b5180 2020-07-16T20:30:12.835 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558149280 con 0x7fb5580b5180 2020-07-16T20:30:12.836 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb54801d930 con 0x7fb5580b5180 2020-07-16T20:30:12.836 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.813+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5580648b0 con 0x7fb5580b5180 2020-07-16T20:30:12.836 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558057490 con 0x7fb5580b5180 2020-07-16T20:30:12.837 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 3) v1 ==== 61955+0+0 (secure 0 0 0) 0x7fb548025030 con 0x7fb5580b5180 2020-07-16T20:30:12.838 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb54d7fa700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 0x7fb530052510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:12.839 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7fb548068240 con 0x7fb5580b5180 2020-07-16T20:30:12.839 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb55dfac700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 0x7fb530052510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:12.839 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.814+0000 7fb55dfac700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 0x7fb530052510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb5580b7ac0 tx=0x7fb554008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:12.840 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.818+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb548041c20 con 0x7fb5580b5180 2020-07-16T20:30:12.982 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.981+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ee32368a-83d8-4845-bc9a-e556bc1dd5ff", "id": 7} v 0) v1 -- 0x7fb55805b210 con 0x7fb5580b5180 2020-07-16T20:30:13.008 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.985+0000 7fb54d7fa700 1 -- 172.21.15.116:0/3948800600 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee32368a-83d8-4845-bc9a-e556bc1dd5ff", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb548023070 con 0x7fb5580b5180 2020-07-16T20:30:13.008 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 msgr2=0x7fb530052510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:13.008 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 0x7fb530052510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb5580b7ac0 tx=0x7fb554008040).stop 2020-07-16T20:30:13.009 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 msgr2=0x7fb558145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:13.009 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fb548002f30 tx=0x7fb548015000).stop 2020-07-16T20:30:13.009 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 shutdown_connections 2020-07-16T20:30:13.009 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb530050050 0x7fb530052510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:13.009 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3948800600 >> v2:172.21.15.22:3300/0 conn(0x7fb558146080 0x7fb5581497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:13.015 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 --2- 172.21.15.116:0/3948800600 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb5580b5180 0x7fb558145b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:13.015 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 >> 172.21.15.116:0/3948800600 conn(0x7fb5580b9330 msgr2=0x7fb558132320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:13.016 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 shutdown_connections 2020-07-16T20:30:13.016 INFO:teuthology.orchestra.run.smithi116.stderr:2020-07-16T20:30:12.986+0000 7fb55fa0f700 1 -- 172.21.15.116:0/3948800600 wait complete. 2020-07-16T20:30:13.016 INFO:teuthology.orchestra.run.smithi116.stdout:7 2020-07-16T20:30:13.017 INFO:tasks.ceph.osd.0:Restarting daemon 2020-07-16T20:30:13.018 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-07-16T20:30:13.041 INFO:tasks.ceph.osd.0:Started 2020-07-16T20:30:13.042 INFO:tasks.ceph.osd.1:Restarting daemon 2020-07-16T20:30:13.042 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-07-16T20:30:13.048 INFO:tasks.ceph.osd.1:Started 2020-07-16T20:30:13.049 INFO:tasks.ceph.osd.2:Restarting daemon 2020-07-16T20:30:13.049 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-07-16T20:30:13.056 INFO:tasks.ceph.osd.2:Started 2020-07-16T20:30:13.056 INFO:tasks.ceph.osd.3:Restarting daemon 2020-07-16T20:30:13.057 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-07-16T20:30:13.063 INFO:tasks.ceph.osd.3:Started 2020-07-16T20:30:13.064 INFO:tasks.ceph.osd.4:Restarting daemon 2020-07-16T20:30:13.064 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-07-16T20:30:13.084 INFO:tasks.ceph.osd.4:Started 2020-07-16T20:30:13.085 INFO:tasks.ceph.osd.5:Restarting daemon 2020-07-16T20:30:13.085 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-07-16T20:30:13.088 INFO:tasks.ceph.osd.5:Started 2020-07-16T20:30:13.089 INFO:tasks.ceph.osd.6:Restarting daemon 2020-07-16T20:30:13.089 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-07-16T20:30:13.099 INFO:tasks.ceph.osd.6:Started 2020-07-16T20:30:13.104 INFO:tasks.ceph.osd.7:Restarting daemon 2020-07-16T20:30:13.105 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-07-16T20:30:13.110 INFO:tasks.ceph.osd.7:Started 2020-07-16T20:30:13.110 INFO:tasks.ceph:Waiting for OSDs to come up 2020-07-16T20:30:13.662 INFO:tasks.ceph.osd.1.smithi022.stderr:2020-07-16T20:30:13.660+0000 7f50dad43ec0 -1 Falling back to public interface 2020-07-16T20:30:13.669 INFO:tasks.ceph.osd.0.smithi022.stderr:2020-07-16T20:30:13.667+0000 7f0bc2d33ec0 -1 Falling back to public interface 2020-07-16T20:30:13.676 INFO:tasks.ceph.osd.4.smithi116.stderr:2020-07-16T20:30:13.674+0000 7f448d9a6ec0 -1 Falling back to public interface 2020-07-16T20:30:13.694 INFO:tasks.ceph.osd.5.smithi116.stderr:2020-07-16T20:30:13.682+0000 7f4e1b491ec0 -1 Falling back to public interface 2020-07-16T20:30:13.695 INFO:tasks.ceph.osd.2.smithi022.stderr:2020-07-16T20:30:13.677+0000 7f93ddeb2ec0 -1 Falling back to public interface 2020-07-16T20:30:13.696 INFO:tasks.ceph.osd.3.smithi022.stderr:2020-07-16T20:30:13.680+0000 7f5676affec0 -1 Falling back to public interface 2020-07-16T20:30:13.706 INFO:tasks.ceph.osd.6.smithi116.stderr:2020-07-16T20:30:13.702+0000 7f7aa7fd1ec0 -1 Falling back to public interface 2020-07-16T20:30:13.722 INFO:tasks.ceph.osd.7.smithi116.stderr:2020-07-16T20:30:13.720+0000 7fa73ce33ec0 -1 Falling back to public interface 2020-07-16T20:30:13.936 INFO:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-16T20:30:14.059 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 Processor -- start 2020-07-16T20:30:14.060 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 -- start start 2020-07-16T20:30:14.060 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa530157920 0x7fa53005f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:14.061 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5300ae440 con 0x7fa530154530 2020-07-16T20:30:14.061 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5301571e0 con 0x7fa53005fb40 2020-07-16T20:30:14.062 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.050+0000 7fa534d07700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa530157480 con 0x7fa530157920 2020-07-16T20:30:14.062 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52ed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa530154530 0x7fa530080a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38914/0 (socket says 172.21.15.22:38914) 2020-07-16T20:30:14.062 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52ed9d700 1 -- 172.21.15.22:0/3426513069 learned_addr learned my addr 172.21.15.22:0/3426513069 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:14.063 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52659c700 1 --2- 172.21.15.22:0/3426513069 >> v2:172.21.15.116:3300/0 conn(0x7fa530157920 0x7fa53005f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:14.063 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325415394 0 0) 0x7fa5300ae440 con 0x7fa530154530 2020-07-16T20:30:14.064 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c003240 con 0x7fa530154530 2020-07-16T20:30:14.064 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237710871 0 0) 0x7fa5301571e0 con 0x7fa53005fb40 2020-07-16T20:30:14.064 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5300ae440 con 0x7fa53005fb40 2020-07-16T20:30:14.065 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52659c700 1 -- 172.21.15.22:0/3426513069 >> v1:172.21.15.116:6789/0 conn(0x7fa53005fb40 legacy=0x7fa5300b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.065 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52659c700 1 -- 172.21.15.22:0/3426513069 >> v1:172.21.15.22:6789/0 conn(0x7fa530154530 legacy=0x7fa530080a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.065 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52659c700 1 -- 172.21.15.22:0/3426513069 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530153900 con 0x7fa530157920 2020-07-16T20:30:14.066 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52659c700 1 --2- 172.21.15.22:0/3426513069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa530157920 0x7fa53005f650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa518002f30 tx=0x7fa518006dd0).ready entity=mon.1 client_cookie=6f959fd0d209e01e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:14.066 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa518009740 con 0x7fa530157920 2020-07-16T20:30:14.067 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5180098a0 con 0x7fa530157920 2020-07-16T20:30:14.067 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa52e59c700 1 -- 172.21.15.22:0/3426513069 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa518009c00 con 0x7fa530157920 2020-07-16T20:30:14.067 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa534d07700 1 -- 172.21.15.22:0/3426513069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa530157920 msgr2=0x7fa53005f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.068 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.051+0000 7fa534d07700 1 --2- 172.21.15.22:0/3426513069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa530157920 0x7fa53005f650 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fa518002f30 tx=0x7fa518006dd0).stop 2020-07-16T20:30:14.068 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.052+0000 7fa534d07700 1 -- 172.21.15.22:0/3426513069 shutdown_connections 2020-07-16T20:30:14.069 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.052+0000 7fa534d07700 1 --2- 172.21.15.22:0/3426513069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa530157920 0x7fa53005f650 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:14.069 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.052+0000 7fa534d07700 1 -- 172.21.15.22:0/3426513069 >> 172.21.15.22:0/3426513069 conn(0x7fa5300b9210 msgr2=0x7fa5300b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:14.069 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.052+0000 7fa534d07700 1 -- 172.21.15.22:0/3426513069 shutdown_connections 2020-07-16T20:30:14.070 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.052+0000 7fa534d07700 1 -- 172.21.15.22:0/3426513069 wait complete. 2020-07-16T20:30:14.070 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 Processor -- start 2020-07-16T20:30:14.070 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 -- start start 2020-07-16T20:30:14.087 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 0x7fa53011f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:14.087 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 0x7fa53013b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:14.088 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53011fb90 con 0x7fa53005fb40 2020-07-16T20:30:14.088 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53011f970 con 0x7fa53013b240 2020-07-16T20:30:14.088 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.054+0000 7fa534d07700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53011fe30 con 0x7fa530154530 2020-07-16T20:30:14.089 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52ed9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fa53005fb40 0x7fa5300b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:41270/0 (socket says 172.21.15.22:41270) 2020-07-16T20:30:14.089 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52f59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 0x7fa53013b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:14.089 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52ed9d700 1 -- 172.21.15.22:0/2663784148 learned_addr learned my addr 172.21.15.22:0/2663784148 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:14.102 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 0x7fa53011f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:14.102 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243151502 0 0) 0x7fa53011fb90 con 0x7fa53005fb40 2020-07-16T20:30:14.103 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003240 con 0x7fa53005fb40 2020-07-16T20:30:14.103 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 -- 172.21.15.22:0/2663784148 >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 msgr2=0x7fa53013b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.103 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 --2- 172.21.15.22:0/2663784148 >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 0x7fa53013b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:14.104 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 -- 172.21.15.22:0/2663784148 >> v1:172.21.15.116:6789/0 conn(0x7fa53005fb40 legacy=0x7fa5300b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.104 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 -- 172.21.15.22:0/2663784148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5301200d0 con 0x7fa530154530 2020-07-16T20:30:14.104 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52f59e700 1 --2- 172.21.15.22:0/2663784148 >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 0x7fa53013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:14.105 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa52659c700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 0x7fa53011f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa518002f30 tx=0x7fa518015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:14.105 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa518011e80 con 0x7fa530154530 2020-07-16T20:30:14.106 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51801d3c0 con 0x7fa530154530 2020-07-16T20:30:14.107 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53013be40 con 0x7fa530154530 2020-07-16T20:30:14.107 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa530063850 con 0x7fa530154530 2020-07-16T20:30:14.107 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.055+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa51801d720 con 0x7fa530154530 2020-07-16T20:30:14.108 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.056+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5300b9a60 con 0x7fa530154530 2020-07-16T20:30:14.108 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.056+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa51801a040 con 0x7fa530154530 2020-07-16T20:30:14.109 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.057+0000 7fa526ffd700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 0x7fa50c052870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:14.109 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.057+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fa518067dc0 con 0x7fa530154530 2020-07-16T20:30:14.110 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.057+0000 7fa52ed9d700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 0x7fa50c052870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:14.118 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.057+0000 7fa52ed9d700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 0x7fa50c052870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa520000f10 tx=0x7fa5200078a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:14.119 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.060+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa518041700 con 0x7fa530154530 2020-07-16T20:30:14.220 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.219+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa530120260 con 0x7fa530154530 2020-07-16T20:30:14.221 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.220+0000 7fa526ffd700 1 -- 172.21.15.22:0/2663784148 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8277 (secure 0 0 0) 0x7fa51802f070 con 0x7fa530154530 2020-07-16T20:30:14.222 INFO:teuthology.misc.health.smithi022.stdout: 2020-07-16T20:30:14.222 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:12.983324+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"5","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:14.224 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 msgr2=0x7fa50c052870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.224 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 0x7fa50c052870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fa520000f10 tx=0x7fa5200078a0).stop 2020-07-16T20:30:14.224 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 msgr2=0x7fa53011f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:14.225 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 0x7fa53011f480 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa518002f30 tx=0x7fa518015000).stop 2020-07-16T20:30:14.225 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 shutdown_connections 2020-07-16T20:30:14.251 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa50c0503b0 0x7fa50c052870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:14.251 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 --2- 172.21.15.22:0/2663784148 >> v2:172.21.15.22:3300/0 conn(0x7fa53013b240 0x7fa53013b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:14.251 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 --2- 172.21.15.22:0/2663784148 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa530154530 0x7fa53011f480 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:14.252 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 >> 172.21.15.22:0/2663784148 conn(0x7fa5300b9210 msgr2=0x7fa530154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:14.252 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 shutdown_connections 2020-07-16T20:30:14.252 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:14.222+0000 7fa534d07700 1 -- 172.21.15.22:0/2663784148 wait complete. 2020-07-16T20:30:14.254 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-07-16T20:30:14.738 INFO:tasks.ceph.osd.1.smithi022.stderr:2020-07-16T20:30:14.734+0000 7f50dad43ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-07-16T20:30:14.754 INFO:tasks.ceph.osd.4.smithi116.stderr:2020-07-16T20:30:14.749+0000 7f448d9a6ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-07-16T20:30:14.761 INFO:tasks.ceph.osd.0.smithi022.stderr:2020-07-16T20:30:14.752+0000 7f0bc2d33ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-07-16T20:30:14.762 INFO:tasks.ceph.osd.3.smithi022.stderr:2020-07-16T20:30:14.758+0000 7f5676affec0 -1 osd.3 0 log_to_monitors {default=true} 2020-07-16T20:30:14.765 INFO:tasks.ceph.osd.2.smithi022.stderr:2020-07-16T20:30:14.764+0000 7f93ddeb2ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-07-16T20:30:14.774 INFO:tasks.ceph.osd.5.smithi116.stderr:2020-07-16T20:30:14.772+0000 7f4e1b491ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-07-16T20:30:14.790 INFO:tasks.ceph.osd.6.smithi116.stderr:2020-07-16T20:30:14.788+0000 7f7aa7fd1ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-07-16T20:30:14.818 INFO:tasks.ceph.osd.7.smithi116.stderr:2020-07-16T20:30:14.814+0000 7fa73ce33ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-07-16T20:30:16.006 INFO:tasks.ceph.osd.3.smithi022.stderr:2020-07-16T20:30:16.001+0000 7f566d315700 -1 osd.3 0 waiting for initial osdmap 2020-07-16T20:30:16.007 INFO:tasks.ceph.osd.2.smithi022.stderr:2020-07-16T20:30:16.001+0000 7f93d46c8700 -1 osd.2 0 waiting for initial osdmap 2020-07-16T20:30:16.007 INFO:tasks.ceph.osd.4.smithi116.stderr:2020-07-16T20:30:16.000+0000 7f44841bc700 -1 osd.4 0 waiting for initial osdmap 2020-07-16T20:30:16.007 INFO:tasks.ceph.osd.5.smithi116.stderr:2020-07-16T20:30:16.001+0000 7f4e11ca7700 -1 osd.5 0 waiting for initial osdmap 2020-07-16T20:30:16.011 INFO:tasks.ceph.osd.6.smithi116.stderr:2020-07-16T20:30:16.009+0000 7f7a9e7e7700 -1 osd.6 0 waiting for initial osdmap 2020-07-16T20:30:16.012 INFO:tasks.ceph.osd.0.smithi022.stderr:2020-07-16T20:30:16.009+0000 7f0bb9549700 -1 osd.0 0 waiting for initial osdmap 2020-07-16T20:30:16.012 INFO:tasks.ceph.osd.1.smithi022.stderr:2020-07-16T20:30:16.009+0000 7f50d1559700 -1 osd.1 0 waiting for initial osdmap 2020-07-16T20:30:16.013 INFO:tasks.ceph.osd.7.smithi116.stderr:2020-07-16T20:30:16.011+0000 7fa734e4c700 -1 osd.7 0 waiting for initial osdmap 2020-07-16T20:30:21.073 INFO:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-07-16T20:30:21.186 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 Processor -- start 2020-07-16T20:30:21.187 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 -- start start 2020-07-16T20:30:21.187 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86c01574f0 0x7f86c00b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.188 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0157a20 con 0x7f86c0157110 2020-07-16T20:30:21.188 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0157cc0 con 0x7f86c00802d0 2020-07-16T20:30:21.188 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.183+0000 7f86bf59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c009cfc0 con 0x7f86c01574f0 2020-07-16T20:30:21.188 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86be59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86c01574f0 0x7f86c00b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.189 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f86c0157110 0x7f86c00b4f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39144/0 (socket says 172.21.15.22:39144) 2020-07-16T20:30:21.189 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bed9d700 1 -- 172.21.15.22:0/684449232 learned_addr learned my addr 172.21.15.22:0/684449232 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:21.189 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86be59c700 1 -- 172.21.15.22:0/684449232 >> v1:172.21.15.116:6789/0 conn(0x7f86c00802d0 legacy=0x7f86c0080780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.190 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86be59c700 1 -- 172.21.15.22:0/684449232 >> v1:172.21.15.22:6789/0 conn(0x7f86c0157110 legacy=0x7f86c00b4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.190 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bdd9b700 1 -- 172.21.15.22:0/684449232 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362972244 0 0) 0x7f86c0157a20 con 0x7f86c0157110 2020-07-16T20:30:21.190 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86be59c700 1 -- 172.21.15.22:0/684449232 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0157f60 con 0x7f86c01574f0 2020-07-16T20:30:21.190 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86be59c700 1 --2- 172.21.15.22:0/684449232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c01574f0 0x7f86c00b5620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f86b0002f30 tx=0x7f86b0006d70).ready entity=mon.0 client_cookie=a68d6302fe8bdfe6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.191 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bdd9b700 1 -- 172.21.15.22:0/684449232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b00097f0 con 0x7f86c01574f0 2020-07-16T20:30:21.191 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bdd9b700 1 -- 172.21.15.22:0/684449232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0009950 con 0x7f86c01574f0 2020-07-16T20:30:21.191 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bdd9b700 1 -- 172.21.15.22:0/684449232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b0009ac0 con 0x7f86c01574f0 2020-07-16T20:30:21.191 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 -- 172.21.15.22:0/684449232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c01574f0 msgr2=0x7f86c00b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.192 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 --2- 172.21.15.22:0/684449232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c01574f0 0x7f86c00b5620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f86b0002f30 tx=0x7f86b0006d70).stop 2020-07-16T20:30:21.193 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 -- 172.21.15.22:0/684449232 shutdown_connections 2020-07-16T20:30:21.193 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 --2- 172.21.15.22:0/684449232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c01574f0 0x7f86c00b5620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.193 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 -- 172.21.15.22:0/684449232 >> 172.21.15.22:0/684449232 conn(0x7f86c00bb180 msgr2=0x7f86c00b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:21.193 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 -- 172.21.15.22:0/684449232 shutdown_connections 2020-07-16T20:30:21.194 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.184+0000 7f86bf59e700 1 -- 172.21.15.22:0/684449232 wait complete. 2020-07-16T20:30:21.197 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.186+0000 7f86bf59e700 1 Processor -- start 2020-07-16T20:30:21.200 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.186+0000 7f86bf59e700 1 -- start start 2020-07-16T20:30:21.200 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86bf59e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86c0157110 0x7f86c0076370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.201 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86bf59e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86c015a750 0x7f86c0130260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.201 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86bf59e700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c0076a30 con 0x7f86c00802d0 2020-07-16T20:30:21.201 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86bf59e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c0154a80 con 0x7f86c015a750 2020-07-16T20:30:21.201 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86bf59e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0076cd0 con 0x7f86c0157110 2020-07-16T20:30:21.202 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86c015a750 0x7f86c0130260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.202 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f86c015a750 0x7f86c0130260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38446/0 (socket says 172.21.15.22:38446) 2020-07-16T20:30:21.202 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 -- 172.21.15.22:0/2178274766 learned_addr learned my addr 172.21.15.22:0/2178274766 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:21.205 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86be59c700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86c0157110 0x7f86c0076370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.206 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 -- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86c0157110 msgr2=0x7f86c0076370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.206 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86c0157110 0x7f86c0076370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.206 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 -- 172.21.15.22:0/2178274766 >> v1:172.21.15.116:6789/0 conn(0x7f86c00802d0 legacy=0x7f86c009ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.207 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.187+0000 7f86c4ec0700 1 -- 172.21.15.22:0/2178274766 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c0076f70 con 0x7f86c015a750 2020-07-16T20:30:21.207 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86c4ec0700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c015a750 0x7f86c0130260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f86c0063560 tx=0x7f86b8007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.207 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b800a5a0 con 0x7f86c015a750 2020-07-16T20:30:21.208 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800a700 con 0x7f86c015a750 2020-07-16T20:30:21.208 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c0130750 con 0x7f86c015a750 2020-07-16T20:30:21.208 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b800a870 con 0x7f86c015a750 2020-07-16T20:30:21.209 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.188+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c0130bf0 con 0x7f86c015a750 2020-07-16T20:30:21.209 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.189+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c0076860 con 0x7f86c015a750 2020-07-16T20:30:21.210 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.189+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f86b8019030 con 0x7f86c015a750 2020-07-16T20:30:21.210 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.189+0000 7f86b67fc700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 0x7f869c0524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.210 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.189+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f86b8066dc0 con 0x7f86c015a750 2020-07-16T20:30:21.211 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.190+0000 7f86bed9d700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 0x7f869c0524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.211 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.190+0000 7f86bed9d700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 0x7f869c0524a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c009b990 tx=0x7f86a8007720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.211 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.193+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f86b806a030 con 0x7f86c015a750 2020-07-16T20:30:21.353 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.351+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c0057490 con 0x7f86c015a750 2020-07-16T20:30:21.354 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.352+0000 7f86b67fc700 1 -- 172.21.15.22:0/2178274766 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11856 (secure 0 0 0) 0x7f86b8017020 con 0x7f86c015a750 2020-07-16T20:30:21.355 INFO:teuthology.misc.health.smithi022.stdout: 2020-07-16T20:30:21.355 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":15,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:19.023635+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:21.362 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 msgr2=0x7f869c0524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.367 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 0x7f869c0524a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f86c009b990 tx=0x7f86a8007720).stop 2020-07-16T20:30:21.367 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c015a750 msgr2=0x7f86c0130260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.368 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c015a750 0x7f86c0130260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f86c0063560 tx=0x7f86b8007e50).stop 2020-07-16T20:30:21.368 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 shutdown_connections 2020-07-16T20:30:21.368 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f869c04ffe0 0x7f869c0524a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.369 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86c015a750 0x7f86c0130260 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.369 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 --2- 172.21.15.22:0/2178274766 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f86c0157110 0x7f86c0076370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.370 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 >> 172.21.15.22:0/2178274766 conn(0x7f86c00bb180 msgr2=0x7f86c009fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:21.370 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 shutdown_connections 2020-07-16T20:30:21.370 INFO:teuthology.misc.health.smithi022.stderr:2020-07-16T20:30:21.354+0000 7f86bf59e700 1 -- 172.21.15.22:0/2178274766 wait complete. 2020-07-16T20:30:21.372 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-07-16T20:30:21.373 INFO:tasks.ceph:Creating RBD pool 2020-07-16T20:30:21.373 INFO:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool create rbd 8 2020-07-16T20:30:21.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.491+0000 7f5908dfd700 1 Processor -- start 2020-07-16T20:30:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.491+0000 7f5908dfd700 1 -- start start 2020-07-16T20:30:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5908dfd700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f5904154690 0x7f59040b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5908dfd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5904062f00 0x7f59040b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5908dfd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5904153f50 con 0x7f59040b4fd0 2020-07-16T20:30:21.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5908dfd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59041541f0 con 0x7f5904062f00 2020-07-16T20:30:21.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5908dfd700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5904158040 con 0x7f5904154690 2020-07-16T20:30:21.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5904062f00 0x7f59040b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590259c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59040b4fd0 0x7f59040627f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39158/0 (socket says 172.21.15.22:39158) 2020-07-16T20:30:21.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590259c700 1 -- 172.21.15.22:0/92558967 learned_addr learned my addr 172.21.15.22:0/92558967 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:21.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5902d9d700 1 --2- 172.21.15.22:0/92558967 >> v2:172.21.15.116:3300/0 conn(0x7f5904154690 0x7f59040b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590359e700 1 -- 172.21.15.22:0/92558967 >> v2:172.21.15.116:3300/0 conn(0x7f5904154690 msgr2=0x7f59040b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:21.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590359e700 1 --2- 172.21.15.22:0/92558967 >> v2:172.21.15.116:3300/0 conn(0x7f5904154690 0x7f59040b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590359e700 1 -- 172.21.15.22:0/92558967 >> v1:172.21.15.22:6789/0 conn(0x7f59040b4fd0 legacy=0x7f59040627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f5901d9b700 1 -- 172.21.15.22:0/92558967 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578851079 0 0) 0x7f5904153f50 con 0x7f59040b4fd0 2020-07-16T20:30:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.492+0000 7f590359e700 1 -- 172.21.15.22:0/92558967 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904153c40 con 0x7f5904062f00 2020-07-16T20:30:21.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f590359e700 1 --2- 172.21.15.22:0/92558967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904062f00 0x7f59040b3ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f58fc0032b0 tx=0x7f58fc0091d0).ready entity=mon.0 client_cookie=d4e5d3b925ca4958 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5901d9b700 1 -- 172.21.15.22:0/92558967 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc00b9a0 con 0x7f5904062f00 2020-07-16T20:30:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5901d9b700 1 -- 172.21.15.22:0/92558967 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58fc00bb00 con 0x7f5904062f00 2020-07-16T20:30:21.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5901d9b700 1 -- 172.21.15.22:0/92558967 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58fc00bc70 con 0x7f5904062f00 2020-07-16T20:30:21.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 -- 172.21.15.22:0/92558967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904062f00 msgr2=0x7f59040b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 --2- 172.21.15.22:0/92558967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904062f00 0x7f59040b3ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f58fc0032b0 tx=0x7f58fc0091d0).stop 2020-07-16T20:30:21.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 -- 172.21.15.22:0/92558967 shutdown_connections 2020-07-16T20:30:21.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 --2- 172.21.15.22:0/92558967 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904062f00 0x7f59040b3ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 --2- 172.21.15.22:0/92558967 >> v2:172.21.15.116:3300/0 conn(0x7f5904154690 0x7f59040b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 -- 172.21.15.22:0/92558967 >> 172.21.15.22:0/92558967 conn(0x7f59040b94b0 msgr2=0x7f59040b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:21.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 -- 172.21.15.22:0/92558967 shutdown_connections 2020-07-16T20:30:21.504 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.493+0000 7f5908dfd700 1 -- 172.21.15.22:0/92558967 wait complete. 2020-07-16T20:30:21.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 Processor -- start 2020-07-16T20:30:21.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 -- start start 2020-07-16T20:30:21.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59040b4fd0 0x7f590413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5904154690 0x7f59040660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5904065960 con 0x7f5904157480 2020-07-16T20:30:21.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5904065c00 con 0x7f5904154690 2020-07-16T20:30:21.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f5908dfd700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59040b3010 con 0x7f59040b4fd0 2020-07-16T20:30:21.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f590259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5904154690 0x7f59040660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f590259c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5904154690 0x7f59040660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38458/0 (socket says 172.21.15.22:38458) 2020-07-16T20:30:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.495+0000 7f590259c700 1 -- 172.21.15.22:0/2800421412 learned_addr learned my addr 172.21.15.22:0/2800421412 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:21.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f5902d9d700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59040b4fd0 0x7f590413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f590259c700 1 -- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59040b4fd0 msgr2=0x7f590413d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f590259c700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59040b4fd0 0x7f590413d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:21.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f590259c700 1 -- 172.21.15.22:0/2800421412 >> v1:172.21.15.116:6789/0 conn(0x7f5904157480 legacy=0x7f59040b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:21.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f590259c700 1 -- 172.21.15.22:0/2800421412 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59040652d0 con 0x7f5904154690 2020-07-16T20:30:21.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f590259c700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904154690 0x7f59040660a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f58f8000e90 tx=0x7f58f8007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f80072e0 con 0x7f5904154690 2020-07-16T20:30:21.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8007440 con 0x7f5904154690 2020-07-16T20:30:21.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590413e040 con 0x7f5904154690 2020-07-16T20:30:21.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58f80057e0 con 0x7f5904154690 2020-07-16T20:30:21.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.496+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590413e590 con 0x7f5904154690 2020-07-16T20:30:21.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.497+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5904065520 con 0x7f5904154690 2020-07-16T20:30:21.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.497+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f58f801a060 con 0x7f5904154690 2020-07-16T20:30:21.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.497+0000 7f58f27fc700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 0x7f58dc0524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:21.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.497+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f58f8066fa0 con 0x7f5904154690 2020-07-16T20:30:21.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.498+0000 7f5902d9d700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 0x7f58dc0524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:21.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.498+0000 7f5902d9d700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 0x7f58dc0524d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f58f4008000 tx=0x7f58f4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:21.517 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.501+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f5904065520 con 0x7f5904154690 2020-07-16T20:30:21.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:21.658+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f5904065520 con 0x7f5904154690 2020-07-16T20:30:22.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.557+0000 7f58f27fc700 1 -- 172.21.15.22:0/2800421412 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f58f8047070 con 0x7f5904154690 2020-07-16T20:30:22.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 msgr2=0x7f58dc0524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:22.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 0x7f58dc0524d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f58f4008000 tx=0x7f58f4008040).stop 2020-07-16T20:30:22.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904154690 msgr2=0x7f59040660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:22.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904154690 0x7f59040660a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f58f8000e90 tx=0x7f58f8007a00).stop 2020-07-16T20:30:22.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 shutdown_connections 2020-07-16T20:30:22.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f58dc050010 0x7f58dc0524d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f59040b4fd0 0x7f590413d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 --2- 172.21.15.22:0/2800421412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5904154690 0x7f59040660a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 >> 172.21.15.22:0/2800421412 conn(0x7f59040b94b0 msgr2=0x7f590405fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:22.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 shutdown_connections 2020-07-16T20:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.560+0000 7f5908dfd700 1 -- 172.21.15.22:0/2800421412 wait complete. 2020-07-16T20:30:22.566 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'rbd' created 2020-07-16T20:30:22.574 INFO:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-07-16T20:30:22.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.696+0000 7f11bc8ec700 1 Processor -- start 2020-07-16T20:30:22.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.696+0000 7f11bc8ec700 1 -- start start 2020-07-16T20:30:22.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11bc8ec700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b80b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:22.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11bc8ec700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8062f00 0x7f11b80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:22.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11bc8ec700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b8153f50 con 0x7f11b80b4fd0 2020-07-16T20:30:22.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11bc8ec700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b81541f0 con 0x7f11b8062f00 2020-07-16T20:30:22.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11bc8ec700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b8158040 con 0x7f11b8154690 2020-07-16T20:30:22.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8062f00 0x7f11b80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:22.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8062f00 0x7f11b80b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38466/0 (socket says 172.21.15.22:38466) 2020-07-16T20:30:22.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 -- 172.21.15.22:0/3908373564 learned_addr learned my addr 172.21.15.22:0/3908373564 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:22.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 -- 172.21.15.22:0/3908373564 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 msgr2=0x7f11b80b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:22.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b6d9d700 1 --2- 172.21.15.22:0/3908373564 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b80b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:22.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 --2- 172.21.15.22:0/3908373564 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b80b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 -- 172.21.15.22:0/3908373564 >> v1:172.21.15.116:6789/0 conn(0x7f11b80b4fd0 legacy=0x7f11b80627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 -- 172.21.15.22:0/3908373564 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8153c40 con 0x7f11b8062f00 2020-07-16T20:30:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b6d9d700 1 --2- 172.21.15.22:0/3908373564 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b759e700 1 --2- 172.21.15.22:0/3908373564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8062f00 0x7f11b80b3ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f11b805cc40 tx=0x7f11b0009270).ready entity=mon.0 client_cookie=b3e715c740f427e5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b5d9b700 1 -- 172.21.15.22:0/3908373564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b000bbc0 con 0x7f11b8062f00 2020-07-16T20:30:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.697+0000 7f11b5d9b700 1 -- 172.21.15.22:0/3908373564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000bd20 con 0x7f11b8062f00 2020-07-16T20:30:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11b5d9b700 1 -- 172.21.15.22:0/3908373564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b000be90 con 0x7f11b8062f00 2020-07-16T20:30:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3908373564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8062f00 msgr2=0x7f11b80b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3908373564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8062f00 0x7f11b80b3ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f11b805cc40 tx=0x7f11b0009270).stop 2020-07-16T20:30:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3908373564 shutdown_connections 2020-07-16T20:30:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3908373564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8062f00 0x7f11b80b3ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3908373564 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b80b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3908373564 >> 172.21.15.22:0/3908373564 conn(0x7f11b80b94b0 msgr2=0x7f11b80b98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3908373564 shutdown_connections 2020-07-16T20:30:22.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.698+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3908373564 wait complete. 2020-07-16T20:30:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.699+0000 7f11bc8ec700 1 Processor -- start 2020-07-16T20:30:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.699+0000 7f11bc8ec700 1 -- start start 2020-07-16T20:30:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11bc8ec700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b813bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11bc8ec700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8066fe0 0x7f11b80b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:22.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11bc8ec700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b8137e50 con 0x7f11b80b4fd0 2020-07-16T20:30:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11bc8ec700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80b26f0 con 0x7f11b8066fe0 2020-07-16T20:30:22.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11bc8ec700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80b2990 con 0x7f11b8154690 2020-07-16T20:30:22.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11b759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8066fe0 0x7f11b80b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:22.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11b759e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11b8066fe0 0x7f11b80b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38472/0 (socket says 172.21.15.22:38472) 2020-07-16T20:30:22.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11b759e700 1 -- 172.21.15.22:0/3855877900 learned_addr learned my addr 172.21.15.22:0/3855877900 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:22.720 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.700+0000 7f11b659c700 1 --2- 172.21.15.22:0/3855877900 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b813bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:22.720 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11b759e700 1 -- 172.21.15.22:0/3855877900 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 msgr2=0x7f11b813bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:22.720 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11b759e700 1 --2- 172.21.15.22:0/3855877900 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b813bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:22.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11b759e700 1 -- 172.21.15.22:0/3855877900 >> v1:172.21.15.116:6789/0 conn(0x7f11b80b4fd0 legacy=0x7f11b8137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:22.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11b759e700 1 -- 172.21.15.22:0/3855877900 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80b2400 con 0x7f11b8066fe0 2020-07-16T20:30:22.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11b759e700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8066fe0 0x7f11b80b2e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f11b80b0fd0 tx=0x7f11b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:22.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b0010940 con 0x7f11b8066fe0 2020-07-16T20:30:22.724 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0010aa0 con 0x7f11b8066fe0 2020-07-16T20:30:22.724 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b80b3320 con 0x7f11b8066fe0 2020-07-16T20:30:22.724 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b0010e00 con 0x7f11b8066fe0 2020-07-16T20:30:22.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.701+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b815e810 con 0x7f11b8066fe0 2020-07-16T20:30:22.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.702+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b813c4f0 con 0x7f11b8066fe0 2020-07-16T20:30:22.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.702+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f11b000f070 con 0x7f11b8066fe0 2020-07-16T20:30:22.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.702+0000 7f11a67fc700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 0x7f118c0524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:22.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.702+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f11b0068e80 con 0x7f11b8066fe0 2020-07-16T20:30:22.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.703+0000 7f11b6d9d700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 0x7f118c0524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.703+0000 7f11b6d9d700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 0x7f118c0524d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f11b80b0470 tx=0x7f11a8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:22.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.706+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f11b0041b60 con 0x7f11b8066fe0 2020-07-16T20:30:22.869 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:22.865+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f11b8057490 con 0x7f11b8066fe0 2020-07-16T20:30:23.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.558+0000 7f11a67fc700 1 -- 172.21.15.22:0/3855877900 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f11b0015020 con 0x7f11b8066fe0 2020-07-16T20:30:23.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.561+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 msgr2=0x7f118c0524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.561+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 0x7f118c0524d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f11b80b0470 tx=0x7f11a8008040).stop 2020-07-16T20:30:23.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.561+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8066fe0 msgr2=0x7f11b80b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.561+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8066fe0 0x7f11b80b2e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f11b80b0fd0 tx=0x7f11b0016000).stop 2020-07-16T20:30:23.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 shutdown_connections 2020-07-16T20:30:23.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f118c050010 0x7f118c0524d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3855877900 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11b8066fe0 0x7f11b80b2e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 --2- 172.21.15.22:0/3855877900 >> v2:172.21.15.116:3300/0 conn(0x7f11b8154690 0x7f11b813bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 >> 172.21.15.22:0/3855877900 conn(0x7f11b80b94b0 msgr2=0x7f11b80b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:23.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 shutdown_connections 2020-07-16T20:30:23.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.562+0000 7f11bc8ec700 1 -- 172.21.15.22:0/3855877900 wait complete. 2020-07-16T20:30:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rbd' on pool 'rbd' 2020-07-16T20:30:23.578 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-07-16T20:30:23.579 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.702+0000 7f8d486d1700 1 Processor -- start 2020-07-16T20:30:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.703+0000 7f8d486d1700 1 -- start start 2020-07-16T20:30:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.703+0000 7f8d486d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d40142b10 0x7f8d40142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.703+0000 7f8d486d1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400b5c20 con 0x7f8d4014ac40 2020-07-16T20:30:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.703+0000 7f8d486d1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400ae6f0 con 0x7f8d400b4fb0 2020-07-16T20:30:23.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.703+0000 7f8d486d1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d40143460 con 0x7f8d40142b10 2020-07-16T20:30:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d45c6c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d40142b10 0x7f8d40142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d46c6e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8d4014ac40 0x7f8d4014d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39186/0 (socket says 172.21.15.22:39186) 2020-07-16T20:30:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d46c6e700 1 -- 172.21.15.22:0/1891831398 learned_addr learned my addr 172.21.15.22:0/1891831398 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d45c6c700 1 -- 172.21.15.22:0/1891831398 >> v1:172.21.15.116:6789/0 conn(0x7f8d400b4fb0 legacy=0x7f8d40060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d45c6c700 1 -- 172.21.15.22:0/1891831398 >> v1:172.21.15.22:6789/0 conn(0x7f8d4014ac40 legacy=0x7f8d4014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d45c6c700 1 -- 172.21.15.22:0/1891831398 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400aeb90 con 0x7f8d40142b10 2020-07-16T20:30:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d4546b700 1 -- 172.21.15.22:0/1891831398 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074715223 0 0) 0x7f8d400b5c20 con 0x7f8d4014ac40 2020-07-16T20:30:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d45c6c700 1 --2- 172.21.15.22:0/1891831398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d40142b10 0x7f8d40142f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d34002f30 tx=0x7f8d34006dd0).ready entity=mon.0 client_cookie=f982e73c1c2e9f10 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d4546b700 1 -- 172.21.15.22:0/1891831398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d340097f0 con 0x7f8d40142b10 2020-07-16T20:30:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d4546b700 1 -- 172.21.15.22:0/1891831398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34009950 con 0x7f8d40142b10 2020-07-16T20:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d4546b700 1 -- 172.21.15.22:0/1891831398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d34009cb0 con 0x7f8d40142b10 2020-07-16T20:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 -- 172.21.15.22:0/1891831398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d40142b10 msgr2=0x7f8d40142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 --2- 172.21.15.22:0/1891831398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d40142b10 0x7f8d40142f70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8d34002f30 tx=0x7f8d34006dd0).stop 2020-07-16T20:30:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 -- 172.21.15.22:0/1891831398 shutdown_connections 2020-07-16T20:30:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 --2- 172.21.15.22:0/1891831398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d40142b10 0x7f8d40142f70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 -- 172.21.15.22:0/1891831398 >> 172.21.15.22:0/1891831398 conn(0x7f8d400b9530 msgr2=0x7f8d400b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 -- 172.21.15.22:0/1891831398 shutdown_connections 2020-07-16T20:30:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.704+0000 7f8d486d1700 1 -- 172.21.15.22:0/1891831398 wait complete. 2020-07-16T20:30:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.706+0000 7f8d486d1700 1 Processor -- start 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.706+0000 7f8d486d1700 1 -- start start 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d400b0490 0x7f8d400b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d400b0a10 con 0x7f8d400b4fb0 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d40156e60 con 0x7f8d4014ac40 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d40157100 con 0x7f8d400b0490 2020-07-16T20:30:23.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d400b0490 0x7f8d400b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d4646d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8d400b4fb0 0x7f8d40066c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39190/0 (socket says 172.21.15.22:39190) 2020-07-16T20:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d4646d700 1 -- 172.21.15.22:0/2650831549 learned_addr learned my addr 172.21.15.22:0/2650831549 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d400b0490 0x7f8d400b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38486/0 (socket says 172.21.15.22:38486) 2020-07-16T20:30:23.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 -- 172.21.15.22:0/2650831549 >> v1:172.21.15.116:6789/0 conn(0x7f8d4014ac40 legacy=0x7f8d401575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 -- 172.21.15.22:0/2650831549 >> v1:172.21.15.22:6789/0 conn(0x7f8d400b4fb0 legacy=0x7f8d40066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 -- 172.21.15.22:0/2650831549 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40157cb0 con 0x7f8d400b0490 2020-07-16T20:30:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d46c6e700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d400b0490 0x7f8d400b2520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8d380014e0 tx=0x7f8d300078c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d30007320 con 0x7f8d400b0490 2020-07-16T20:30:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d30007480 con 0x7f8d400b0490 2020-07-16T20:30:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d400b2a10 con 0x7f8d400b0490 2020-07-16T20:30:23.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d30005220 con 0x7f8d400b0490 2020-07-16T20:30:23.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.707+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4008fc50 con 0x7f8d400b0490 2020-07-16T20:30:23.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.708+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4008ff30 con 0x7f8d400b0490 2020-07-16T20:30:23.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.709+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8d300055d0 con 0x7f8d400b0490 2020-07-16T20:30:23.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.709+0000 7f8d3e7fc700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 0x7f8d180524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:23.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.709+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8d30066f80 con 0x7f8d400b0490 2020-07-16T20:30:23.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.709+0000 7f8d4646d700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 0x7f8d180524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:23.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.709+0000 7f8d4646d700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 0x7f8d180524d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8d38002680 tx=0x7f8d38007b50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:23.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.712+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f8d3003fb40 con 0x7f8d400b0490 2020-07-16T20:30:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.869+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d4005f320 con 0x7f8d400b0490 2020-07-16T20:30:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.870+0000 7f8d3e7fc700 1 -- 172.21.15.22:0/2650831549 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13242 (secure 0 0 0) 0x7f8d30043160 con 0x7f8d400b0490 2020-07-16T20:30:23.876 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 msgr2=0x7f8d180524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 0x7f8d180524d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8d38002680 tx=0x7f8d38007b50).stop 2020-07-16T20:30:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d400b0490 msgr2=0x7f8d400b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d400b0490 0x7f8d400b2520 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8d380014e0 tx=0x7f8d300078c0).stop 2020-07-16T20:30:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 shutdown_connections 2020-07-16T20:30:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8d18050010 0x7f8d180524d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 --2- 172.21.15.22:0/2650831549 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d400b0490 0x7f8d400b2520 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 >> 172.21.15.22:0/2650831549 conn(0x7f8d400b9530 msgr2=0x7f8d400b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:23.879 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 shutdown_connections 2020-07-16T20:30:23.880 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:23.871+0000 7f8d486d1700 1 -- 172.21.15.22:0/2650831549 wait complete. 2020-07-16T20:30:23.880 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:23.881 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:23.555232+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:23.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:11.371623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:21.693414+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-07-16T20:30:23.896 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.020+0000 7f0816aa6700 1 Processor -- start 2020-07-16T20:30:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.020+0000 7f0816aa6700 1 -- start start 2020-07-16T20:30:24.034 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f0816aa6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08100b0870 0x7f08100b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.034 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f0816aa6700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0810144890 0x7f0810144d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f0816aa6700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100b1a40 con 0x7f0810060200 2020-07-16T20:30:24.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f0816aa6700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100b1340 con 0x7f08100b0870 2020-07-16T20:30:24.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f0816aa6700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08100b15a0 con 0x7f0810144890 2020-07-16T20:30:24.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f080ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08100b0870 0x7f08100b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f080ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08100b0870 0x7f08100b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38492/0 (socket says 172.21.15.22:38492) 2020-07-16T20:30:24.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.021+0000 7f080ffff700 1 -- 172.21.15.22:0/1454366180 learned_addr learned my addr 172.21.15.22:0/1454366180 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:24.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0815043700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0810144890 0x7f0810144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080ffff700 1 -- 172.21.15.22:0/1454366180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0810144890 msgr2=0x7f0810144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:24.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080ffff700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0810144890 0x7f0810144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080ffff700 1 -- 172.21.15.22:0/1454366180 >> v1:172.21.15.116:6789/0 conn(0x7f0810060200 legacy=0x7f081005ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:24.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080ffff700 1 -- 172.21.15.22:0/1454366180 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100606a0 con 0x7f08100b0870 2020-07-16T20:30:24.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080ffff700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08100b0870 0x7f08100b0c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0804002f30 tx=0x7f0804006e90).ready entity=mon.0 client_cookie=2914dd4b0d46061e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080f7fe700 1 -- 172.21.15.22:0/1454366180 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804009850 con 0x7f08100b0870 2020-07-16T20:30:24.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080f7fe700 1 -- 172.21.15.22:0/1454366180 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08040099b0 con 0x7f08100b0870 2020-07-16T20:30:24.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f080f7fe700 1 -- 172.21.15.22:0/1454366180 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0804009d10 con 0x7f08100b0870 2020-07-16T20:30:24.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 -- 172.21.15.22:0/1454366180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08100b0870 msgr2=0x7f08100b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08100b0870 0x7f08100b0c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0804002f30 tx=0x7f0804006e90).stop 2020-07-16T20:30:24.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 -- 172.21.15.22:0/1454366180 shutdown_connections 2020-07-16T20:30:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0810144890 0x7f0810144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 --2- 172.21.15.22:0/1454366180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08100b0870 0x7f08100b0c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 -- 172.21.15.22:0/1454366180 >> 172.21.15.22:0/1454366180 conn(0x7f08100b6c00 msgr2=0x7f08100b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 -- 172.21.15.22:0/1454366180 shutdown_connections 2020-07-16T20:30:24.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.022+0000 7f0816aa6700 1 -- 172.21.15.22:0/1454366180 wait complete. 2020-07-16T20:30:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.023+0000 7f0816aa6700 1 Processor -- start 2020-07-16T20:30:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0816aa6700 1 -- start start 2020-07-16T20:30:24.048 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0816aa6700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f0810060200 0x7f08100643b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.060 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0816aa6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0810141aa0 con 0x7f0810141360 2020-07-16T20:30:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0816aa6700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0810141d40 con 0x7f0810144890 2020-07-16T20:30:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0816aa6700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0810143a60 con 0x7f0810060200 2020-07-16T20:30:24.061 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0815043700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0810141360 0x7f08101588c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39208/0 (socket says 172.21.15.22:39208) 2020-07-16T20:30:24.062 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.024+0000 7f0815043700 1 -- 172.21.15.22:0/3686802393 learned_addr learned my addr 172.21.15.22:0/3686802393 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:24.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> v2:172.21.15.116:3300/0 conn(0x7f0810060200 0x7f08100643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666324033 0 0) 0x7f0810141aa0 con 0x7f0810141360 2020-07-16T20:30:24.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e8003240 con 0x7f0810141360 2020-07-16T20:30:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767182913 0 0) 0x7f0810141d40 con 0x7f0810144890 2020-07-16T20:30:24.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0810141aa0 con 0x7f0810144890 2020-07-16T20:30:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3300991860 0 0) 0x7f07e8003240 con 0x7f0810141360 2020-07-16T20:30:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0810141d40 con 0x7f0810141360 2020-07-16T20:30:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f0808001810 con 0x7f0810141360 2020-07-16T20:30:24.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 >> v2:172.21.15.116:3300/0 conn(0x7f0810060200 msgr2=0x7f08100643b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 --2- 172.21.15.22:0/3686802393 >> v2:172.21.15.116:3300/0 conn(0x7f0810060200 0x7f08100643b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 >> v1:172.21.15.116:6789/0 conn(0x7f0810144890 legacy=0x7f081013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 >> v1:172.21.15.22:6789/0 conn(0x7f0810141360 legacy=0x7f08101588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 0x7f07e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07e80044e0 0x7f07e8004960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07e8004e50 0x7f07e800b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810143a60 con 0x7f07e8003970 2020-07-16T20:30:24.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800bd10 con 0x7f07e8004e50 2020-07-16T20:30:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800bed0 con 0x7f07e80044e0 2020-07-16T20:30:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> v2:172.21.15.116:3300/0 conn(0x7f0810060200 0x7f08100643b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f080ffff700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07e80044e0 0x7f07e8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0815043700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07e8004e50 0x7f07e800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 0x7f07e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 -- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07e80044e0 msgr2=0x7f07e8004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f07e80044e0 0x7f07e8004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 -- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07e8004e50 msgr2=0x7f07e800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f07e8004e50 0x7f07e800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0815043700 1 -- 172.21.15.22:0/3686802393 reap_dead start 2020-07-16T20:30:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.025+0000 7f0814842700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100648a0 con 0x7f07e8003970 2020-07-16T20:30:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100643b0 con 0x7f07e8003970 2020-07-16T20:30:24.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081013fa90 con 0x7f07e8003970 2020-07-16T20:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f0814842700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 0x7f07e8003d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f080000d000 tx=0x7f0800009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0800011780 con 0x7f07e8003970 2020-07-16T20:30:24.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08000118e0 con 0x7f07e8003970 2020-07-16T20:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0800011c40 con 0x7f07e8003970 2020-07-16T20:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.026+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08100af310 con 0x7f07e8003970 2020-07-16T20:30:24.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.027+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f08000133f0 con 0x7f07e8003970 2020-07-16T20:30:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.027+0000 7f080cff9700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 0x7f07e8056490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.027+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0800066f00 con 0x7f07e8003970 2020-07-16T20:30:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.027+0000 7f080ffff700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 0x7f07e8056490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.028+0000 7f080ffff700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 0x7f07e8056490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f080401c000 tx=0x7f0804015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.031+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f080003fa40 con 0x7f07e8003970 2020-07-16T20:30:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.193+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f081005f320 con 0x7f07e8003970 2020-07-16T20:30:24.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.193+0000 7f080cff9700 1 -- 172.21.15.22:0/3686802393 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0800018020 con 0x7f07e8003970 2020-07-16T20:30:24.195 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2020-07-16T20:30:24.202 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 msgr2=0x7f07e8056490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 0x7f07e8056490 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f080401c000 tx=0x7f0804015000).stop 2020-07-16T20:30:24.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 msgr2=0x7f07e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 0x7f07e8003d90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f080000d000 tx=0x7f0800009040).stop 2020-07-16T20:30:24.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 shutdown_connections 2020-07-16T20:30:24.203 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f07e8053fd0 0x7f07e8056490 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 --2- 172.21.15.22:0/3686802393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07e8003970 0x7f07e8003d90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 >> 172.21.15.22:0/3686802393 conn(0x7f08100b6c00 msgr2=0x7f08100b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 shutdown_connections 2020-07-16T20:30:24.204 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.195+0000 7f0816aa6700 1 -- 172.21.15.22:0/3686802393 wait complete. 2020-07-16T20:30:24.210 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:24.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.327+0000 7f656247e700 1 Processor -- start 2020-07-16T20:30:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.327+0000 7f656247e700 1 -- start start 2020-07-16T20:30:24.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f656247e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f656247e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f655c09d720 0x7f655c09db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f656247e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c0b8ff0 con 0x7f655c0b4280 2020-07-16T20:30:24.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f656247e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0b3de0 con 0x7f655c09d720 2020-07-16T20:30:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f656247e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c09f700 con 0x7f655c0b8670 2020-07-16T20:30:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f655b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f655c09d720 0x7f655c09db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f6560a1b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f655c0b4280 0x7f655c05f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39222/0 (socket says 172.21.15.22:39222) 2020-07-16T20:30:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.328+0000 7f6560a1b700 1 -- 172.21.15.22:0/2501435366 learned_addr learned my addr 172.21.15.22:0/2501435366 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:24.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655bfff700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655b7fe700 1 -- 172.21.15.22:0/2501435366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 msgr2=0x7f655c0b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655b7fe700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c0b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655b7fe700 1 -- 172.21.15.22:0/2501435366 >> v1:172.21.15.22:6789/0 conn(0x7f655c0b4280 legacy=0x7f655c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655affd700 1 -- 172.21.15.22:0/2501435366 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449399898 0 0) 0x7f655c0b8ff0 con 0x7f655c0b4280 2020-07-16T20:30:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655b7fe700 1 -- 172.21.15.22:0/2501435366 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c0b56f0 con 0x7f655c09d720 2020-07-16T20:30:24.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655b7fe700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c09d720 0x7f655c09db80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6550002f30 tx=0x7f6550006dd0).ready entity=mon.0 client_cookie=fb8544eae6ce0110 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655affd700 1 -- 172.21.15.22:0/2501435366 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65500097f0 con 0x7f655c09d720 2020-07-16T20:30:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655affd700 1 -- 172.21.15.22:0/2501435366 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6550009950 con 0x7f655c09d720 2020-07-16T20:30:24.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f655affd700 1 -- 172.21.15.22:0/2501435366 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6550009cb0 con 0x7f655c09d720 2020-07-16T20:30:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 -- 172.21.15.22:0/2501435366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c09d720 msgr2=0x7f655c09db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c09d720 0x7f655c09db80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6550002f30 tx=0x7f6550006dd0).stop 2020-07-16T20:30:24.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 -- 172.21.15.22:0/2501435366 shutdown_connections 2020-07-16T20:30:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c0b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 --2- 172.21.15.22:0/2501435366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c09d720 0x7f655c09db80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 -- 172.21.15.22:0/2501435366 >> 172.21.15.22:0/2501435366 conn(0x7f655c0b9660 msgr2=0x7f655c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 -- 172.21.15.22:0/2501435366 shutdown_connections 2020-07-16T20:30:24.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.329+0000 7f656247e700 1 -- 172.21.15.22:0/2501435366 wait complete. 2020-07-16T20:30:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 Processor -- start 2020-07-16T20:30:24.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 -- start start 2020-07-16T20:30:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f655c13d9e0 0x7f655c13de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c067360 con 0x7f655c0b4280 2020-07-16T20:30:24.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c062820 con 0x7f655c13d9e0 2020-07-16T20:30:24.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.331+0000 7f656247e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c067600 con 0x7f655c0b8670 2020-07-16T20:30:24.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f655bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f655c0b4280 0x7f655c13e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39224/0 (socket says 172.21.15.22:39224) 2020-07-16T20:30:24.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f655bfff700 1 -- 172.21.15.22:0/3455767193 learned_addr learned my addr 172.21.15.22:0/3455767193 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:24.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 --2- 172.21.15.22:0/3455767193 >> v2:172.21.15.22:3300/0 conn(0x7f655c13d9e0 0x7f655c13de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.368 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843007380 0 0) 0x7f655c067360 con 0x7f655c0b4280 2020-07-16T20:30:24.368 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f655b7fe700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.368 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6534003240 con 0x7f655c0b4280 2020-07-16T20:30:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 -- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 msgr2=0x7f655c066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c066700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 -- 172.21.15.22:0/3455767193 >> v1:172.21.15.22:6789/0 conn(0x7f655c0b4280 legacy=0x7f655c13e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.370 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 -- 172.21.15.22:0/3455767193 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c066fe0 con 0x7f655c13d9e0 2020-07-16T20:30:24.370 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f6560a1b700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c13d9e0 0x7f655c13de70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f655c065c80 tx=0x7f6554007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.370 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f655400ce40 con 0x7f655c13d9e0 2020-07-16T20:30:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6554005b80 con 0x7f655c13d9e0 2020-07-16T20:30:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6554007110 con 0x7f655c13d9e0 2020-07-16T20:30:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c066bf0 con 0x7f655c13d9e0 2020-07-16T20:30:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.332+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c062dd0 con 0x7f655c13d9e0 2020-07-16T20:30:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.333+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c05f320 con 0x7f655c13d9e0 2020-07-16T20:30:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.333+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6554010030 con 0x7f655c13d9e0 2020-07-16T20:30:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.334+0000 7f653bfff700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 0x7f65340528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.334+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6554067650 con 0x7f655c13d9e0 2020-07-16T20:30:24.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.334+0000 7f655bfff700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 0x7f65340528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.334+0000 7f655bfff700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 0x7f65340528d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f654c00a000 tx=0x7f654c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.337+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6554040270 con 0x7f655c13d9e0 2020-07-16T20:30:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.492+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f655c0b5e40 con 0x7f655c13d9e0 2020-07-16T20:30:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.492+0000 7f653bfff700 1 -- 172.21.15.22:0/3455767193 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6554043890 con 0x7f655c13d9e0 2020-07-16T20:30:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 msgr2=0x7f65340528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 0x7f65340528d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f654c00a000 tx=0x7f654c008040).stop 2020-07-16T20:30:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c13d9e0 msgr2=0x7f655c13de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c13d9e0 0x7f655c13de70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f655c065c80 tx=0x7f6554007c40).stop 2020-07-16T20:30:24.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 shutdown_connections 2020-07-16T20:30:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6534050410 0x7f65340528d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f655c13d9e0 0x7f655c13de70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 --2- 172.21.15.22:0/3455767193 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f655c0b8670 0x7f655c066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 >> 172.21.15.22:0/3455767193 conn(0x7f655c0b9660 msgr2=0x7f655c14ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 shutdown_connections 2020-07-16T20:30:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.494+0000 7f656247e700 1 -- 172.21.15.22:0/3455767193 wait complete. 2020-07-16T20:30:24.502 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:24.521 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-07-16T20:30:24.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.640+0000 7f682053b700 1 Processor -- start 2020-07-16T20:30:24.642 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.640+0000 7f682053b700 1 -- start start 2020-07-16T20:30:24.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f682053b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f68180b9450 0x7f6818151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f682053b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681814a7e0 con 0x7f68180b41d0 2020-07-16T20:30:24.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f682053b700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681814aa80 con 0x7f68180b3df0 2020-07-16T20:30:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f682053b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180604b0 con 0x7f68180b9450 2020-07-16T20:30:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681dad6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f68180b41d0 0x7f68180b8d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39234/0 (socket says 172.21.15.22:39234) 2020-07-16T20:30:24.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681dad6700 1 -- 172.21.15.22:0/445682284 learned_addr learned my addr 172.21.15.22:0/445682284 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:24.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681ead8700 1 --2- 172.21.15.22:0/445682284 >> v2:172.21.15.116:3300/0 conn(0x7f68180b9450 0x7f6818151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122412504 0 0) 0x7f681814a7e0 con 0x7f68180b41d0 2020-07-16T20:30:24.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6800003240 con 0x7f68180b41d0 2020-07-16T20:30:24.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292968528 0 0) 0x7f681814aa80 con 0x7f68180b3df0 2020-07-16T20:30:24.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681814a7e0 con 0x7f68180b3df0 2020-07-16T20:30:24.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681ead8700 1 -- 172.21.15.22:0/445682284 >> v1:172.21.15.116:6789/0 conn(0x7f68180b3df0 legacy=0x7f6818146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681ead8700 1 -- 172.21.15.22:0/445682284 >> v1:172.21.15.22:6789/0 conn(0x7f68180b41d0 legacy=0x7f68180b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681ead8700 1 -- 172.21.15.22:0/445682284 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818146f40 con 0x7f68180b9450 2020-07-16T20:30:24.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.641+0000 7f681ead8700 1 --2- 172.21.15.22:0/445682284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68180b9450 0x7f6818151f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6814002f30 tx=0x7f6814006dd0).ready entity=mon.1 client_cookie=df7de9e6091c54c server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6814009740 con 0x7f68180b9450 2020-07-16T20:30:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68140098a0 con 0x7f68180b9450 2020-07-16T20:30:24.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f681d2d5700 1 -- 172.21.15.22:0/445682284 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6814009c00 con 0x7f68180b9450 2020-07-16T20:30:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 -- 172.21.15.22:0/445682284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68180b9450 msgr2=0x7f6818151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 --2- 172.21.15.22:0/445682284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68180b9450 0x7f6818151f60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6814002f30 tx=0x7f6814006dd0).stop 2020-07-16T20:30:24.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 -- 172.21.15.22:0/445682284 shutdown_connections 2020-07-16T20:30:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 --2- 172.21.15.22:0/445682284 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68180b9450 0x7f6818151f60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 -- 172.21.15.22:0/445682284 >> 172.21.15.22:0/445682284 conn(0x7f68180bd9b0 msgr2=0x7f68180bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 -- 172.21.15.22:0/445682284 shutdown_connections 2020-07-16T20:30:24.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.642+0000 7f682053b700 1 -- 172.21.15.22:0/445682284 wait complete. 2020-07-16T20:30:24.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.643+0000 7f682053b700 1 Processor -- start 2020-07-16T20:30:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.643+0000 7f682053b700 1 -- start start 2020-07-16T20:30:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f682053b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f68180b3df0 0x7f6818142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f682053b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 0x7f681809ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f682053b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68181453e0 con 0x7f6818144ca0 2020-07-16T20:30:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f682053b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68181451d0 con 0x7f68180b3df0 2020-07-16T20:30:24.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f682053b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6818145680 con 0x7f68180b41d0 2020-07-16T20:30:24.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f68180b3df0 0x7f6818142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f68180b3df0 0x7f6818142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38530/0 (socket says 172.21.15.22:38530) 2020-07-16T20:30:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 -- 172.21.15.22:0/1895269115 learned_addr learned my addr 172.21.15.22:0/1895269115 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:24.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681dad6700 1 --2- 172.21.15.22:0/1895269115 >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 0x7f681809ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 -- 172.21.15.22:0/1895269115 >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 msgr2=0x7f681809ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 --2- 172.21.15.22:0/1895269115 >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 0x7f681809ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 -- 172.21.15.22:0/1895269115 >> v1:172.21.15.22:6789/0 conn(0x7f6818144ca0 legacy=0x7f681813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 -- 172.21.15.22:0/1895269115 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68181433c0 con 0x7f68180b3df0 2020-07-16T20:30:24.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904210876 0 0) 0x7f68181453e0 con 0x7f6818144ca0 2020-07-16T20:30:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681dad6700 1 --2- 172.21.15.22:0/1895269115 >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 0x7f681809ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:24.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.644+0000 7f681e2d7700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68180b3df0 0x7f6818142340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6810001450 tx=0x7f6810007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6810002240 con 0x7f68180b3df0 2020-07-16T20:30:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100023a0 con 0x7f68180b3df0 2020-07-16T20:30:24.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681809f330 con 0x7f68180b3df0 2020-07-16T20:30:24.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6810001600 con 0x7f68180b3df0 2020-07-16T20:30:24.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681813e310 con 0x7f68180b3df0 2020-07-16T20:30:24.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.645+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681805f320 con 0x7f68180b3df0 2020-07-16T20:30:24.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.646+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6810019030 con 0x7f68180b3df0 2020-07-16T20:30:24.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.646+0000 7f68067fc700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 0x7f67f0052380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.646+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6810067030 con 0x7f68180b3df0 2020-07-16T20:30:24.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.646+0000 7f681dad6700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 0x7f67f0052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.647+0000 7f681dad6700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 0x7f67f0052380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f680800b000 tx=0x7f6808009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.650+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f681003fc50 con 0x7f68180b3df0 2020-07-16T20:30:24.810 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.808+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6818043fd0 con 0x7f68180b3df0 2020-07-16T20:30:24.810 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.808+0000 7f68067fc700 1 -- 172.21.15.22:0/1895269115 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6810043270 con 0x7f68180b3df0 2020-07-16T20:30:24.811 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:24.811 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2020-07-16T20:30:24.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2020-07-16T20:30:24.812 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2020-07-16T20:30:24.812 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": "device_health_metrics" 2020-07-16T20:30:24.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2020-07-16T20:30:24.814 INFO:teuthology.orchestra.run.smithi022.stdout: { 2020-07-16T20:30:24.814 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 2, 2020-07-16T20:30:24.815 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": "rbd" 2020-07-16T20:30:24.815 INFO:teuthology.orchestra.run.smithi022.stdout: } 2020-07-16T20:30:24.815 INFO:teuthology.orchestra.run.smithi022.stdout:] 2020-07-16T20:30:24.817 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 msgr2=0x7f67f0052380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.826 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 0x7f67f0052380 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f680800b000 tx=0x7f6808009040).stop 2020-07-16T20:30:24.828 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68180b3df0 msgr2=0x7f6818142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.828 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68180b3df0 0x7f6818142340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6810001450 tx=0x7f6810007e40).stop 2020-07-16T20:30:24.828 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 shutdown_connections 2020-07-16T20:30:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f67f004fec0 0x7f67f0052380 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 --2- 172.21.15.22:0/1895269115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68180b3df0 0x7f6818142340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.829 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 --2- 172.21.15.22:0/1895269115 >> v2:172.21.15.116:3300/0 conn(0x7f68180b41d0 0x7f681809ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.830 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.809+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 >> 172.21.15.22:0/1895269115 conn(0x7f68180bd9b0 msgr2=0x7f681813fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.830 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.810+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 shutdown_connections 2020-07-16T20:30:24.830 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.810+0000 7f682053b700 1 -- 172.21.15.22:0/1895269115 wait complete. 2020-07-16T20:30:24.832 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-07-16T20:30:24.833 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-07-16T20:30:24.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.961+0000 7f11c086f700 1 Processor -- start 2020-07-16T20:30:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.961+0000 7f11c086f700 1 -- start start 2020-07-16T20:30:24.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11c086f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11c086f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 0x7f11bc0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11c086f700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc09e030 con 0x7f11bc0b7560 2020-07-16T20:30:24.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11c086f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc09daf0 con 0x7f11bc09f240 2020-07-16T20:30:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11c086f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc09dd90 con 0x7f11bc0b87b0 2020-07-16T20:30:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11ba59c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.973 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11bad9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 0x7f11bc0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.974 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11ba59c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:44366/0 (socket says 172.21.15.22:44366) 2020-07-16T20:30:24.974 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11bad9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 0x7f11bc0b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:37656/0 (socket says 172.21.15.22:37656) 2020-07-16T20:30:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11ba59c700 1 -- 172.21.15.22:0/3240360635 learned_addr learned my addr 172.21.15.22:0/3240360635 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.962+0000 7f11b9d9b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f11bc0b7560 0x7f11bc09cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:41596/0 (socket says 172.21.15.22:41596) 2020-07-16T20:30:24.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11ba59c700 1 -- 172.21.15.22:0/3240360635 >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 msgr2=0x7f11bc0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:24.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11ba59c700 1 --2- 172.21.15.22:0/3240360635 >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 0x7f11bc0b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11ba59c700 1 -- 172.21.15.22:0/3240360635 >> v1:172.21.15.116:6789/0 conn(0x7f11bc0b7560 legacy=0x7f11bc09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11ba59c700 1 -- 172.21.15.22:0/3240360635 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0b7eb0 con 0x7f11bc0b87b0 2020-07-16T20:30:24.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11ba59c700 1 --2- 172.21.15.22:0/3240360635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f11b0002f30 tx=0x7f11b0006f20).ready entity=mon.2 client_cookie=11ac8e61e8bda21c server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11b959a700 1 -- 172.21.15.22:0/3240360635 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b000dda0 con 0x7f11bc0b87b0 2020-07-16T20:30:24.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11b959a700 1 -- 172.21.15.22:0/3240360635 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0010470 con 0x7f11bc0b87b0 2020-07-16T20:30:24.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11b959a700 1 -- 172.21.15.22:0/3240360635 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b00107d0 con 0x7f11bc0b87b0 2020-07-16T20:30:24.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 -- 172.21.15.22:0/3240360635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 msgr2=0x7f11bc0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 --2- 172.21.15.22:0/3240360635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f11b0002f30 tx=0x7f11b0006f20).stop 2020-07-16T20:30:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 -- 172.21.15.22:0/3240360635 shutdown_connections 2020-07-16T20:30:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 --2- 172.21.15.22:0/3240360635 >> v2:172.21.15.116:3300/0 conn(0x7f11bc09f240 0x7f11bc0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 --2- 172.21.15.22:0/3240360635 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc0b87b0 0x7f11bc0b4980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 -- 172.21.15.22:0/3240360635 >> 172.21.15.22:0/3240360635 conn(0x7f11bc0b9660 msgr2=0x7f11bc0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 -- 172.21.15.22:0/3240360635 shutdown_connections 2020-07-16T20:30:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.963+0000 7f11c086f700 1 -- 172.21.15.22:0/3240360635 wait complete. 2020-07-16T20:30:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.964+0000 7f11c086f700 1 Processor -- start 2020-07-16T20:30:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 -- start start 2020-07-16T20:30:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11bc0b7560 0x7f11bc066df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11bc064170 0x7f11bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc1509b0 0x7f11bc150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc064ff0 con 0x7f11bc0b7560 2020-07-16T20:30:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc064610 con 0x7f11bc064170 2020-07-16T20:30:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11c086f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0648b0 con 0x7f11bc1509b0 2020-07-16T20:30:24.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11ba59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11bc0b7560 0x7f11bc066df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11ba59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f11bc0b7560 0x7f11bc066df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38544/0 (socket says 172.21.15.22:38544) 2020-07-16T20:30:24.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11ba59c700 1 -- 172.21.15.22:0/2370060732 learned_addr learned my addr 172.21.15.22:0/2370060732 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:24.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11b9d9b700 1 --2- 172.21.15.22:0/2370060732 >> v2:172.21.15.116:3300/0 conn(0x7f11bc064170 0x7f11bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.965+0000 7f11bad9d700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc1509b0 0x7f11bc150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 -- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc1509b0 msgr2=0x7f11bc150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc1509b0 0x7f11bc150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.987 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 -- 172.21.15.22:0/2370060732 >> v2:172.21.15.116:3300/0 conn(0x7f11bc064170 msgr2=0x7f11bc0672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:24.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 --2- 172.21.15.22:0/2370060732 >> v2:172.21.15.116:3300/0 conn(0x7f11bc064170 0x7f11bc0672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:24.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 -- 172.21.15.22:0/2370060732 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc064b50 con 0x7f11bc0b7560 2020-07-16T20:30:24.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11ba59c700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11bc0b7560 0x7f11bc066df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f11b0002f30 tx=0x7f11b0018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b001d070 con 0x7f11bc0b7560 2020-07-16T20:30:24.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0018950 con 0x7f11bc0b7560 2020-07-16T20:30:24.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11b0018cb0 con 0x7f11bc0b7560 2020-07-16T20:30:24.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc094940 con 0x7f11bc0b7560 2020-07-16T20:30:24.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.966+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc1514e0 con 0x7f11bc0b7560 2020-07-16T20:30:24.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.967+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc05f320 con 0x7f11bc0b7560 2020-07-16T20:30:24.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.967+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f11b000f3d0 con 0x7f11bc0b7560 2020-07-16T20:30:24.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.967+0000 7f11aa7fc700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 0x7f1190052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:24.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.967+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f11b00695e0 con 0x7f11bc0b7560 2020-07-16T20:30:24.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.968+0000 7f11b9d9b700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 0x7f1190052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:24.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.968+0000 7f11b9d9b700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 0x7f1190052490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f11ac00d000 tx=0x7f11ac007b20).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:24.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:24.971+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f11b00421a0 con 0x7f11bc0b7560 2020-07-16T20:30:25.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.128+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f11bc067e10 con 0x7f11bc0b7560 2020-07-16T20:30:25.568 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.567+0000 7f11aa7fc700 1 -- 172.21.15.22:0/2370060732 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f11b00457c0 con 0x7f11bc0b7560 2020-07-16T20:30:25.571 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 msgr2=0x7f1190052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.572 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 0x7f1190052490 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f11ac00d000 tx=0x7f11ac007b20).stop 2020-07-16T20:30:25.572 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11bc0b7560 msgr2=0x7f11bc066df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.572 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11bc0b7560 0x7f11bc066df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f11b0002f30 tx=0x7f11b0018000).stop 2020-07-16T20:30:25.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 shutdown_connections 2020-07-16T20:30:25.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f119004ffd0 0x7f1190052490 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11bc0b7560 0x7f11bc066df0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11bc1509b0 0x7f11bc150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 --2- 172.21.15.22:0/2370060732 >> v2:172.21.15.116:3300/0 conn(0x7f11bc064170 0x7f11bc0672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 >> 172.21.15.22:0/2370060732 conn(0x7f11bc0b9660 msgr2=0x7f11bc1425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 shutdown_connections 2020-07-16T20:30:25.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.569+0000 7f11c086f700 1 -- 172.21.15.22:0/2370060732 wait complete. 2020-07-16T20:30:25.576 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2020-07-16T20:30:25.588 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-07-16T20:30:25.590 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-07-16T20:30:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.722+0000 7fa3fd853700 1 Processor -- start 2020-07-16T20:30:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.722+0000 7fa3fd853700 1 -- start start 2020-07-16T20:30:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3fd853700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa3f809f240 0x7fa3f80b7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3fd853700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3f809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3fd853700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f809e030 con 0x7fa3f80b87b0 2020-07-16T20:30:25.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3fd853700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80b5090 con 0x7fa3f809f240 2020-07-16T20:30:25.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3fd853700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80b7f00 con 0x7fa3f80b7a50 2020-07-16T20:30:25.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3f80b87b0 0x7fa3f80b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39260/0 (socket says 172.21.15.22:39260) 2020-07-16T20:30:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f6ffd700 1 -- 172.21.15.22:0/2639030181 learned_addr learned my addr 172.21.15.22:0/2639030181 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> v2:172.21.15.116:3300/0 conn(0x7fa3f809f240 0x7fa3f80b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f77fe700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3f809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397078574 0 0) 0x7fa3f809e030 con 0x7fa3f80b87b0 2020-07-16T20:30:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.723+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8003240 con 0x7fa3f80b87b0 2020-07-16T20:30:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2698469911 0 0) 0x7fa3d8003240 con 0x7fa3f80b87b0 2020-07-16T20:30:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 msgr2=0x7fa3f809cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3f809cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 >> v2:172.21.15.116:3300/0 conn(0x7fa3f809f240 msgr2=0x7fa3f80b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 --2- 172.21.15.22:0/2639030181 >> v2:172.21.15.116:3300/0 conn(0x7fa3f809f240 0x7fa3f80b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f809daf0 con 0x7fa3f80b87b0 2020-07-16T20:30:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fa3e00016d0 con 0x7fa3f80b87b0 2020-07-16T20:30:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 >> v1:172.21.15.22:6789/0 conn(0x7fa3f80b87b0 legacy=0x7fa3f80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3d8003730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d8003c40 0x7fa3d80044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d80049d0 0x7fa3d8004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80b5090 con 0x7fa3d8003c40 2020-07-16T20:30:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80b7f00 con 0x7fa3d80049d0 2020-07-16T20:30:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8004200 con 0x7fa3f80b7a50 2020-07-16T20:30:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> v2:172.21.15.116:3300/0 conn(0x7fa3f809f240 0x7fa3f80b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:25.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f6ffd700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3d8003730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f77fe700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d80049d0 0x7fa3d8004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d8003c40 0x7fa3d80044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 -- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 msgr2=0x7fa3d8003730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3f80b7a50 0x7fa3d8003730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 -- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d80049d0 msgr2=0x7fa3d8004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa3d80049d0 0x7fa3d8004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 -- 172.21.15.22:0/2639030181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8003240 con 0x7fa3d8003c40 2020-07-16T20:30:25.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d8003c40 0x7fa3d80044e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa3e800c000 tx=0x7fa3e8008040).ready entity=mon.0 client_cookie=6cfd6dec30834242 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:25.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e800ebd0 con 0x7fa3d8003c40 2020-07-16T20:30:25.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800ed30 con 0x7fa3d8003c40 2020-07-16T20:30:25.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f5ffb700 1 -- 172.21.15.22:0/2639030181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e800eea0 con 0x7fa3d8003c40 2020-07-16T20:30:25.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3fd853700 1 -- 172.21.15.22:0/2639030181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d8003c40 msgr2=0x7fa3d80044e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3fd853700 1 --2- 172.21.15.22:0/2639030181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3d8003c40 0x7fa3d80044e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa3e800c000 tx=0x7fa3e8008040).stop 2020-07-16T20:30:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.724+0000 7fa3f77fe700 1 -- 172.21.15.22:0/2639030181 reap_dead start 2020-07-16T20:30:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.725+0000 7fa3fd853700 1 -- 172.21.15.22:0/2639030181 shutdown_connections 2020-07-16T20:30:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.725+0000 7fa3fd853700 1 -- 172.21.15.22:0/2639030181 >> 172.21.15.22:0/2639030181 conn(0x7fa3f80b9660 msgr2=0x7fa3f80b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.725+0000 7fa3fd853700 1 -- 172.21.15.22:0/2639030181 shutdown_connections 2020-07-16T20:30:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.725+0000 7fa3fd853700 1 -- 172.21.15.22:0/2639030181 wait complete. 2020-07-16T20:30:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.726+0000 7fa3fd853700 1 Processor -- start 2020-07-16T20:30:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.726+0000 7fa3fd853700 1 -- start start 2020-07-16T20:30:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3fd853700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f813a5c0 0x7fa3f80b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3fd853700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 0x7fa3f813ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3fd853700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f80b1130 con 0x7fa3f813a9a0 2020-07-16T20:30:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3fd853700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80b0f20 con 0x7fa3f813a5c0 2020-07-16T20:30:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3fd853700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80b13d0 con 0x7fa3f8135b40 2020-07-16T20:30:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f813a5c0 0x7fa3f80b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3f813a5c0 0x7fa3f80b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38564/0 (socket says 172.21.15.22:38564) 2020-07-16T20:30:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 -- 172.21.15.22:0/1997387187 learned_addr learned my addr 172.21.15.22:0/1997387187 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f77fe700 1 --2- 172.21.15.22:0/1997387187 >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 0x7fa3f813ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 -- 172.21.15.22:0/1997387187 >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 msgr2=0x7fa3f813ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 --2- 172.21.15.22:0/1997387187 >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 0x7fa3f813ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 -- 172.21.15.22:0/1997387187 >> v1:172.21.15.116:6789/0 conn(0x7fa3f813a9a0 legacy=0x7fa3f8135430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f6ffd700 1 -- 172.21.15.22:0/1997387187 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80b0b50 con 0x7fa3f813a5c0 2020-07-16T20:30:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.727+0000 7fa3f77fe700 1 --2- 172.21.15.22:0/1997387187 >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 0x7fa3f813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3f6ffd700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f813a5c0 0x7fa3f80b0660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa3e0001930 tx=0x7fa3f8061100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e000fa90 con 0x7fa3f813a5c0 2020-07-16T20:30:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e000fbf0 con 0x7fa3f813a5c0 2020-07-16T20:30:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f8139f20 con 0x7fa3f813a5c0 2020-07-16T20:30:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e0012350 con 0x7fa3f813a5c0 2020-07-16T20:30:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.728+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f813f1c0 con 0x7fa3f813a5c0 2020-07-16T20:30:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.729+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f80b1790 con 0x7fa3f813a5c0 2020-07-16T20:30:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.729+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa3e001b030 con 0x7fa3f813a5c0 2020-07-16T20:30:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.729+0000 7fa3eeffd700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 0x7fa3d40524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.729+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa3e0067530 con 0x7fa3f813a5c0 2020-07-16T20:30:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.729+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 0x7fa3d40524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.730+0000 7fa3f67fc700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 0x7fa3d40524d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa3f813e920 tx=0x7fa3e8019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:25.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.733+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa3e003fff0 con 0x7fa3f813a5c0 2020-07-16T20:30:25.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:25.905+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa3f80b0ce0 con 0x7fa3f813a5c0 2020-07-16T20:30:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.569+0000 7fa3eeffd700 1 -- 172.21.15.22:0/1997387187 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fa3e0019020 con 0x7fa3f813a5c0 2020-07-16T20:30:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.573+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 msgr2=0x7fa3d40524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.573+0000 7fa3fd853700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 0x7fa3d40524d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa3f813e920 tx=0x7fa3e8019000).stop 2020-07-16T20:30:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.573+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f813a5c0 msgr2=0x7fa3f80b0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.573+0000 7fa3fd853700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f813a5c0 0x7fa3f80b0660 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa3e0001930 tx=0x7fa3f8061100).stop 2020-07-16T20:30:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.574+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 shutdown_connections 2020-07-16T20:30:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.574+0000 7fa3fd853700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa3d4050010 0x7fa3d40524d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.574+0000 7fa3fd853700 1 --2- 172.21.15.22:0/1997387187 >> v2:172.21.15.116:3300/0 conn(0x7fa3f8135b40 0x7fa3f813ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.574+0000 7fa3fd853700 1 --2- 172.21.15.22:0/1997387187 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f813a5c0 0x7fa3f80b0660 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.574+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 >> 172.21.15.22:0/1997387187 conn(0x7fa3f80b9660 msgr2=0x7fa3f809cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.575+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 shutdown_connections 2020-07-16T20:30:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.575+0000 7fa3fd853700 1 -- 172.21.15.22:0/1997387187 wait complete. 2020-07-16T20:30:26.590 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-07-16T20:30:26.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.715+0000 7fba80b3d700 1 Processor -- start 2020-07-16T20:30:26.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.715+0000 7fba80b3d700 1 -- start start 2020-07-16T20:30:26.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.715+0000 7fba80b3d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b4990 0x7fba7c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba80b3d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0b8ff0 con 0x7fba7c0b8670 2020-07-16T20:30:26.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba80b3d700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c0b3de0 con 0x7fba7c0b8a50 2020-07-16T20:30:26.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba80b3d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c09de30 con 0x7fba7c0b4990 2020-07-16T20:30:26.726 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba7c0b8670 0x7fba7c09d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39280/0 (socket says 172.21.15.22:39280) 2020-07-16T20:30:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7a59c700 1 -- 172.21.15.22:0/1943268321 learned_addr learned my addr 172.21.15.22:0/1943268321 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946158043 0 0) 0x7fba7c0b8ff0 con 0x7fba7c0b8670 2020-07-16T20:30:26.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c003240 con 0x7fba7c0b8670 2020-07-16T20:30:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7ad9d700 1 --2- 172.21.15.22:0/1943268321 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b4990 0x7fba7c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 602740544 0 0) 0x7fba5c003240 con 0x7fba7c0b8670 2020-07-16T20:30:26.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b4990 msgr2=0x7fba7c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:26.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 --2- 172.21.15.22:0/1943268321 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b4990 0x7fba7c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 >> v1:172.21.15.116:6789/0 conn(0x7fba7c0b8a50 legacy=0x7fba7c0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c09f700 con 0x7fba7c0b8670 2020-07-16T20:30:26.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fba640016d0 con 0x7fba7c0b8670 2020-07-16T20:30:26.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 >> v1:172.21.15.22:6789/0 conn(0x7fba7c0b8670 legacy=0x7fba7c09d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba5c003760 0x7fba5c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 0x7fba5c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba5c004e50 0x7fba5c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c09de30 con 0x7fba5c0044e0 2020-07-16T20:30:26.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c00bc20 con 0x7fba5c003760 2020-07-16T20:30:26.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c00bd60 con 0x7fba5c004e50 2020-07-16T20:30:26.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7a59c700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba5c003760 0x7fba5c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba79d9b700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 0x7fba5c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.716+0000 7fba7ad9d700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba5c004e50 0x7fba5c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 -- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba5c004e50 msgr2=0x7fba5c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:26.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fba5c004e50 0x7fba5c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 -- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba5c003760 msgr2=0x7fba5c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:26.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba5c003760 0x7fba5c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 -- 172.21.15.22:0/1943268321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c003240 con 0x7fba5c0044e0 2020-07-16T20:30:26.736 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba7ad9d700 1 -- 172.21.15.22:0/1943268321 reap_dead start 2020-07-16T20:30:26.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba79d9b700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 0x7fba5c004960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fba7c068410 tx=0x7fba6c007ae0).ready entity=mon.0 client_cookie=cb3a147ff74acdf3 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:26.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6c00c600 con 0x7fba5c0044e0 2020-07-16T20:30:26.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00c760 con 0x7fba5c0044e0 2020-07-16T20:30:26.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba7959a700 1 -- 172.21.15.22:0/1943268321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba6c00cac0 con 0x7fba5c0044e0 2020-07-16T20:30:26.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 -- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 msgr2=0x7fba5c004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 0x7fba5c004960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fba7c068410 tx=0x7fba6c007ae0).stop 2020-07-16T20:30:26.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 -- 172.21.15.22:0/1943268321 shutdown_connections 2020-07-16T20:30:26.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1943268321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba5c0044e0 0x7fba5c004960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 -- 172.21.15.22:0/1943268321 >> 172.21.15.22:0/1943268321 conn(0x7fba7c0b9660 msgr2=0x7fba7c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:26.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 -- 172.21.15.22:0/1943268321 shutdown_connections 2020-07-16T20:30:26.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.717+0000 7fba80b3d700 1 -- 172.21.15.22:0/1943268321 wait complete. 2020-07-16T20:30:26.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 Processor -- start 2020-07-16T20:30:26.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 -- start start 2020-07-16T20:30:26.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b7720 0x7fba7c142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba7c1571b0 0x7fba7c0644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba7c15b4f0 con 0x7fba7c0b7b00 2020-07-16T20:30:26.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c064010 con 0x7fba7c1571b0 2020-07-16T20:30:26.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba80b3d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c15b170 con 0x7fba7c0b7720 2020-07-16T20:30:26.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.719+0000 7fba7ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba7c1571b0 0x7fba7c0644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba79d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba7c0b7b00 0x7fba7c1430a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39296/0 (socket says 172.21.15.22:39296) 2020-07-16T20:30:26.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba79d9b700 1 -- 172.21.15.22:0/1050007218 learned_addr learned my addr 172.21.15.22:0/1050007218 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:26.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7a59c700 1 --2- 172.21.15.22:0/1050007218 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b7720 0x7fba7c142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7ad9d700 1 -- 172.21.15.22:0/1050007218 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b7720 msgr2=0x7fba7c142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7ad9d700 1 --2- 172.21.15.22:0/1050007218 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b7720 0x7fba7c142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:26.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7ad9d700 1 -- 172.21.15.22:0/1050007218 >> v1:172.21.15.22:6789/0 conn(0x7fba7c0b7b00 legacy=0x7fba7c1430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:26.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939263564 0 0) 0x7fba7c15b4f0 con 0x7fba7c0b7b00 2020-07-16T20:30:26.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7ad9d700 1 -- 172.21.15.22:0/1050007218 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c15b2b0 con 0x7fba7c1571b0 2020-07-16T20:30:26.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba7ad9d700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1571b0 0x7fba7c0644b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fba7400b000 tx=0x7fba740091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:26.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba7400f9e0 con 0x7fba7c1571b0 2020-07-16T20:30:26.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400fb40 con 0x7fba7c1571b0 2020-07-16T20:30:26.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c063ac0 con 0x7fba7c1571b0 2020-07-16T20:30:26.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba7400fcb0 con 0x7fba7c1571b0 2020-07-16T20:30:26.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.720+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c065d00 con 0x7fba7c1571b0 2020-07-16T20:30:26.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.721+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c063cb0 con 0x7fba7c1571b0 2020-07-16T20:30:26.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.721+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fba74014440 con 0x7fba7c1571b0 2020-07-16T20:30:26.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.722+0000 7fba727fc700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 0x7fba580523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:26.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.722+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7fba74067d50 con 0x7fba7c1571b0 2020-07-16T20:30:26.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.722+0000 7fba7a59c700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 0x7fba580523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:26.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.722+0000 7fba7a59c700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 0x7fba580523e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fba64005000 tx=0x7fba64007750).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:26.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.725+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fba7c063cb0 con 0x7fba7c1571b0 2020-07-16T20:30:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:26.885+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7fba7c063cb0 con 0x7fba7c1571b0 2020-07-16T20:30:28.581 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.579+0000 7fba727fc700 1 -- 172.21.15.22:0/1050007218 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7fba7c063cb0 con 0x7fba7c1571b0 2020-07-16T20:30:28.584 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 msgr2=0x7fba580523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.584 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 0x7fba580523e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fba64005000 tx=0x7fba64007750).stop 2020-07-16T20:30:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1571b0 msgr2=0x7fba7c0644b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1571b0 0x7fba7c0644b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fba7400b000 tx=0x7fba740091d0).stop 2020-07-16T20:30:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 shutdown_connections 2020-07-16T20:30:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fba5804ff20 0x7fba580523e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1050007218 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba7c1571b0 0x7fba7c0644b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 --2- 172.21.15.22:0/1050007218 >> v2:172.21.15.116:3300/0 conn(0x7fba7c0b7720 0x7fba7c142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 >> 172.21.15.22:0/1050007218 conn(0x7fba7c0b9660 msgr2=0x7fba7c146d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 shutdown_connections 2020-07-16T20:30:28.588 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.582+0000 7fba80b3d700 1 -- 172.21.15.22:0/1050007218 wait complete. 2020-07-16T20:30:28.588 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2020-07-16T20:30:28.603 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-07-16T20:30:28.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 Processor -- start 2020-07-16T20:30:28.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 -- start start 2020-07-16T20:30:28.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa81c05f9c0 0x7fa81c144a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:28.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa81c144f80 0x7fa81c145430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:28.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0b8520 con 0x7fa81c05f5e0 2020-07-16T20:30:28.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0b8310 con 0x7fa81c05f9c0 2020-07-16T20:30:28.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa82113f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0b87c0 con 0x7fa81c144f80 2020-07-16T20:30:28.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa81a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa81c05f9c0 0x7fa81c144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:28.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa81ad9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa81c05f5e0 0x7fa81c0b8c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39300/0 (socket says 172.21.15.22:39300) 2020-07-16T20:30:28.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.728+0000 7fa81ad9d700 1 -- 172.21.15.22:0/3590965862 learned_addr learned my addr 172.21.15.22:0/3590965862 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:28.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81b59e700 1 --2- 172.21.15.22:0/3590965862 >> v2:172.21.15.116:3300/0 conn(0x7fa81c144f80 0x7fa81c145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:28.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81a59c700 1 -- 172.21.15.22:0/3590965862 >> v2:172.21.15.116:3300/0 conn(0x7fa81c144f80 msgr2=0x7fa81c145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:28.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81a59c700 1 --2- 172.21.15.22:0/3590965862 >> v2:172.21.15.116:3300/0 conn(0x7fa81c144f80 0x7fa81c145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81a59c700 1 -- 172.21.15.22:0/3590965862 >> v1:172.21.15.22:6789/0 conn(0x7fa81c05f5e0 legacy=0x7fa81c0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81a59c700 1 -- 172.21.15.22:0/3590965862 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c09d3c0 con 0x7fa81c05f9c0 2020-07-16T20:30:28.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa819d9b700 1 -- 172.21.15.22:0/3590965862 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683329797 0 0) 0x7fa81c0b8520 con 0x7fa81c05f5e0 2020-07-16T20:30:28.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa81a59c700 1 --2- 172.21.15.22:0/3590965862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa81c05f9c0 0x7fa81c144a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa81c09deb0 tx=0x7fa80c006dd0).ready entity=mon.0 client_cookie=8e665a0009a6619c server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:28.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa819d9b700 1 -- 172.21.15.22:0/3590965862 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c0097b0 con 0x7fa81c05f9c0 2020-07-16T20:30:28.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa819d9b700 1 -- 172.21.15.22:0/3590965862 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c009910 con 0x7fa81c05f9c0 2020-07-16T20:30:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa819d9b700 1 -- 172.21.15.22:0/3590965862 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c009c70 con 0x7fa81c05f9c0 2020-07-16T20:30:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 -- 172.21.15.22:0/3590965862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa81c05f9c0 msgr2=0x7fa81c144a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 --2- 172.21.15.22:0/3590965862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa81c05f9c0 0x7fa81c144a90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fa81c09deb0 tx=0x7fa80c006dd0).stop 2020-07-16T20:30:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 -- 172.21.15.22:0/3590965862 shutdown_connections 2020-07-16T20:30:28.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 --2- 172.21.15.22:0/3590965862 >> v2:172.21.15.116:3300/0 conn(0x7fa81c144f80 0x7fa81c145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 --2- 172.21.15.22:0/3590965862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa81c05f9c0 0x7fa81c144a90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 -- 172.21.15.22:0/3590965862 >> 172.21.15.22:0/3590965862 conn(0x7fa81c0b9660 msgr2=0x7fa81c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 -- 172.21.15.22:0/3590965862 shutdown_connections 2020-07-16T20:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.729+0000 7fa82113f700 1 -- 172.21.15.22:0/3590965862 wait complete. 2020-07-16T20:30:28.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 Processor -- start 2020-07-16T20:30:28.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 -- start start 2020-07-16T20:30:28.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:28.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa81c130580 0x7fa81c130a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:28.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c066420 con 0x7fa81c05f5e0 2020-07-16T20:30:28.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c130f00 con 0x7fa81c130580 2020-07-16T20:30:28.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.731+0000 7fa82113f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c155110 con 0x7fa81c144f80 2020-07-16T20:30:28.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:28.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:44428/0 (socket says 172.21.15.22:44428) 2020-07-16T20:30:28.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 -- 172.21.15.22:0/173111588 learned_addr learned my addr 172.21.15.22:0/173111588 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:28.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81b59e700 1 --2- 172.21.15.22:0/173111588 >> v2:172.21.15.116:3300/0 conn(0x7fa81c130580 0x7fa81c130a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:28.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 -- 172.21.15.22:0/173111588 >> v2:172.21.15.116:3300/0 conn(0x7fa81c130580 msgr2=0x7fa81c130a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 --2- 172.21.15.22:0/173111588 >> v2:172.21.15.116:3300/0 conn(0x7fa81c130580 0x7fa81c130a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:28.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 -- 172.21.15.22:0/173111588 >> v1:172.21.15.116:6789/0 conn(0x7fa81c05f5e0 legacy=0x7fa81c13d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:28.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 -- 172.21.15.22:0/173111588 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c154dc0 con 0x7fa81c144f80 2020-07-16T20:30:28.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa81a59c700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa81c09deb0 tx=0x7fa80c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:28.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c009e60 con 0x7fa81c144f80 2020-07-16T20:30:28.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c01d5d0 con 0x7fa81c144f80 2020-07-16T20:30:28.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80c01d930 con 0x7fa81c144f80 2020-07-16T20:30:28.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.732+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c1435b0 con 0x7fa81c144f80 2020-07-16T20:30:28.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.733+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c066850 con 0x7fa81c144f80 2020-07-16T20:30:28.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.733+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c05f320 con 0x7fa81c144f80 2020-07-16T20:30:28.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.734+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa80c025030 con 0x7fa81c144f80 2020-07-16T20:30:28.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.734+0000 7fa812ffd700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 0x7fa7f8052480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:28.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.734+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fa80c069460 con 0x7fa81c144f80 2020-07-16T20:30:28.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.734+0000 7fa81ad9d700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 0x7fa7f8052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:28.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.735+0000 7fa81ad9d700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 0x7fa7f8052480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa81c1434e0 tx=0x7fa804007720).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:28.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.738+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa80c041be0 con 0x7fa81c144f80 2020-07-16T20:30:28.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:28.895+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa81c067e10 con 0x7fa81c144f80 2020-07-16T20:30:29.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.585+0000 7fa812ffd700 1 -- 172.21.15.22:0/173111588 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7fa80c0230c0 con 0x7fa81c144f80 2020-07-16T20:30:29.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 msgr2=0x7fa7f8052480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 0x7fa7f8052480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa81c1434e0 tx=0x7fa804007720).stop 2020-07-16T20:30:29.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 msgr2=0x7fa81c064cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fa81c09deb0 tx=0x7fa80c015000).stop 2020-07-16T20:30:29.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 shutdown_connections 2020-07-16T20:30:29.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa7f804ffc0 0x7fa7f8052480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 --2- 172.21.15.22:0/173111588 >> v2:172.21.15.116:3300/0 conn(0x7fa81c130580 0x7fa81c130a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 --2- 172.21.15.22:0/173111588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa81c144f80 0x7fa81c064cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 >> 172.21.15.22:0/173111588 conn(0x7fa81c0b9660 msgr2=0x7fa81c0ae7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:29.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 shutdown_connections 2020-07-16T20:30:29.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.588+0000 7fa82113f700 1 -- 172.21.15.22:0/173111588 wait complete. 2020-07-16T20:30:29.593 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 4 allow_ec_overwrites to true 2020-07-16T20:30:29.604 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-07-16T20:30:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.728+0000 7f0088527700 1 Processor -- start 2020-07-16T20:30:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.728+0000 7f0088527700 1 -- start start 2020-07-16T20:30:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.728+0000 7f0088527700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00800b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.728+0000 7f0088527700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800b8ff0 con 0x7f008009d720 2020-07-16T20:30:29.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f0088527700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800b3de0 con 0x7f00800b4990 2020-07-16T20:30:29.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f0088527700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008009f700 con 0x7f00800b8670 2020-07-16T20:30:29.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f0085ac2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f008009d720 0x7f00800b4280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39314/0 (socket says 172.21.15.22:39314) 2020-07-16T20:30:29.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f0085ac2700 1 -- 172.21.15.22:0/2367205019 learned_addr learned my addr 172.21.15.22:0/2367205019 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:29.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00862c3700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00800b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372640434 0 0) 0x7f00800b8ff0 con 0x7f008009d720 2020-07-16T20:30:29.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068003240 con 0x7f008009d720 2020-07-16T20:30:29.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998652105 0 0) 0x7f00800b3de0 con 0x7f00800b4990 2020-07-16T20:30:29.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00800b8ff0 con 0x7f00800b4990 2020-07-16T20:30:29.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2875450594 0 0) 0x7f0068003240 con 0x7f008009d720 2020-07-16T20:30:29.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 msgr2=0x7f00800b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:29.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00800b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 >> v1:172.21.15.116:6789/0 conn(0x7f00800b4990 legacy=0x7f0080147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800b56f0 con 0x7f008009d720 2020-07-16T20:30:29.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f00700016d0 con 0x7f008009d720 2020-07-16T20:30:29.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 >> v1:172.21.15.22:6789/0 conn(0x7f008009d720 legacy=0x7f00800b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00680038f0 0x7f0068003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00680044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00680049d0 0x7f0068004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008009f700 con 0x7f00680049d0 2020-07-16T20:30:29.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0068005370 con 0x7f00680038f0 2020-07-16T20:30:29.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006800b780 con 0x7f00800b8670 2020-07-16T20:30:29.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.729+0000 7f0086ac4700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00680049d0 0x7f0068004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f00862c3700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00680038f0 0x7f0068003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0085ac2700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00680044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 -- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 msgr2=0x7f00680044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:29.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00800b8670 0x7f00680044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 -- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00680038f0 msgr2=0x7f0068003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:29.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00680038f0 0x7f0068003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 -- 172.21.15.22:0/2367205019 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068003240 con 0x7f00680049d0 2020-07-16T20:30:29.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00680049d0 0x7f0068004e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f00680054b0 tx=0x7f0078007e60).ready entity=mon.0 client_cookie=2eff63d4c5e98e14 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:29.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007800cbc0 con 0x7f00680049d0 2020-07-16T20:30:29.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007800cd20 con 0x7f00680049d0 2020-07-16T20:30:29.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f00852c1700 1 -- 172.21.15.22:0/2367205019 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00780125f0 con 0x7f00680049d0 2020-07-16T20:30:29.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 -- 172.21.15.22:0/2367205019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00680049d0 msgr2=0x7f0068004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 --2- 172.21.15.22:0/2367205019 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f00680049d0 0x7f0068004e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f00680054b0 tx=0x7f0078007e60).stop 2020-07-16T20:30:29.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0086ac4700 1 -- 172.21.15.22:0/2367205019 reap_dead start 2020-07-16T20:30:29.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 -- 172.21.15.22:0/2367205019 shutdown_connections 2020-07-16T20:30:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 -- 172.21.15.22:0/2367205019 >> 172.21.15.22:0/2367205019 conn(0x7f00800b9660 msgr2=0x7f00800b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 -- 172.21.15.22:0/2367205019 shutdown_connections 2020-07-16T20:30:29.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.730+0000 7f0088527700 1 -- 172.21.15.22:0/2367205019 wait complete. 2020-07-16T20:30:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 Processor -- start 2020-07-16T20:30:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 -- start start 2020-07-16T20:30:29.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 0x7f0080091850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0080144310 con 0x7f008009b130 2020-07-16T20:30:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00801445b0 con 0x7f0080150e10 2020-07-16T20:30:29.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0088527700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008009bc80 con 0x7f00801579d0 2020-07-16T20:30:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0085ac2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f008009b130 0x7f0080066ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39328/0 (socket says 172.21.15.22:39328) 2020-07-16T20:30:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0085ac2700 1 -- 172.21.15.22:0/1356094889 learned_addr learned my addr 172.21.15.22:0/1356094889 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:29.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.732+0000 7f0086ac4700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 0x7f0080091850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051836799 0 0) 0x7f0080144310 con 0x7f008009b130 2020-07-16T20:30:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0058003240 con 0x7f008009b130 2020-07-16T20:30:29.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133372661 0 0) 0x7f00801445b0 con 0x7f0080150e10 2020-07-16T20:30:29.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0080144310 con 0x7f0080150e10 2020-07-16T20:30:29.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0086ac4700 1 -- 172.21.15.22:0/1356094889 >> v1:172.21.15.116:6789/0 conn(0x7f0080150e10 legacy=0x7f0080144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0086ac4700 1 -- 172.21.15.22:0/1356094889 >> v1:172.21.15.22:6789/0 conn(0x7f008009b130 legacy=0x7f0080066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.774 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0086ac4700 1 -- 172.21.15.22:0/1356094889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080144850 con 0x7f00801579d0 2020-07-16T20:30:29.774 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0086ac4700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 0x7f0080091850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f008009d670 tx=0x7f0078017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:29.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007800cbc0 con 0x7f00801579d0 2020-07-16T20:30:29.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078012e90 con 0x7f00801579d0 2020-07-16T20:30:29.775 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0078011bf0 con 0x7f00801579d0 2020-07-16T20:30:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00800672b0 con 0x7f00801579d0 2020-07-16T20:30:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.733+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00801513b0 con 0x7f00801579d0 2020-07-16T20:30:29.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.734+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00801449e0 con 0x7f00801579d0 2020-07-16T20:30:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.734+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0078025030 con 0x7f00801579d0 2020-07-16T20:30:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.735+0000 7f006e7fc700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 0x7f0058052980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:29.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.735+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f0078068ef0 con 0x7f00801579d0 2020-07-16T20:30:29.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.735+0000 7f00862c3700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 0x7f0058052980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:29.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.735+0000 7f00862c3700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 0x7f0058052980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f007c00c000 tx=0x7f007c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.739+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f0078041610 con 0x7f00801579d0 2020-07-16T20:30:29.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.953+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f0080157e00 con 0x7f00801579d0 2020-07-16T20:30:29.959 INFO:tasks.ceph.mon.a.smithi022.stderr:2020-07-16T20:30:29.954+0000 7fc11e44f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-07-16T20:30:29.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.963+0000 7f006e7fc700 1 -- 172.21.15.22:0/1356094889 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f00780230d0 con 0x7f00801579d0 2020-07-16T20:30:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 msgr2=0x7f0058052980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 0x7f0058052980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f007c00c000 tx=0x7f007c008040).stop 2020-07-16T20:30:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 msgr2=0x7f0080091850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 0x7f0080091850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f008009d670 tx=0x7f0078017000).stop 2020-07-16T20:30:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 shutdown_connections 2020-07-16T20:30:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f00580504c0 0x7f0058052980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 --2- 172.21.15.22:0/1356094889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f00801579d0 0x7f0080091850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 >> 172.21.15.22:0/1356094889 conn(0x7f00800b9660 msgr2=0x7f00800ae650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 shutdown_connections 2020-07-16T20:30:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:29.965+0000 7f0088527700 1 -- 172.21.15.22:0/1356094889 wait complete. 2020-07-16T20:30:29.969 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 3 and data pool 4 2020-07-16T20:30:29.978 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.105+0000 7fd72cbbb700 1 Processor -- start 2020-07-16T20:30:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.105+0000 7fd72cbbb700 1 -- start start 2020-07-16T20:30:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd72cbbb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809e050 0x7fd728144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd72cbbb700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 0x7fd7280b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd72cbbb700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd728147ed0 con 0x7fd72809dc70 2020-07-16T20:30:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd72cbbb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd728148170 con 0x7fd72809e050 2020-07-16T20:30:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd72cbbb700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72809cb10 con 0x7fd728144780 2020-07-16T20:30:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809e050 0x7fd728144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809e050 0x7fd728144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38630/0 (socket says 172.21.15.22:38630) 2020-07-16T20:30:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 -- 172.21.15.22:0/3382324676 learned_addr learned my addr 172.21.15.22:0/3382324676 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd726d9d700 1 --2- 172.21.15.22:0/3382324676 >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 0x7fd7280b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 -- 172.21.15.22:0/3382324676 >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 msgr2=0x7fd7280b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 --2- 172.21.15.22:0/3382324676 >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 0x7fd7280b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 -- 172.21.15.22:0/3382324676 >> v1:172.21.15.116:6789/0 conn(0x7fd72809dc70 legacy=0x7fd7281475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 -- 172.21.15.22:0/3382324676 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72809cc80 con 0x7fd72809e050 2020-07-16T20:30:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd726d9d700 1 --2- 172.21.15.22:0/3382324676 >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 0x7fd7280b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.106+0000 7fd725d9b700 1 --2- 172.21.15.22:0/3382324676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809e050 0x7fd728144290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd728062390 tx=0x7fd718006e90).ready entity=mon.0 client_cookie=42ce170dc55fdd86 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72559a700 1 -- 172.21.15.22:0/3382324676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd718009930 con 0x7fd72809e050 2020-07-16T20:30:30.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72559a700 1 -- 172.21.15.22:0/3382324676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd718009a90 con 0x7fd72809e050 2020-07-16T20:30:30.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72559a700 1 -- 172.21.15.22:0/3382324676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd718009e30 con 0x7fd72809e050 2020-07-16T20:30:30.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 -- 172.21.15.22:0/3382324676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809e050 msgr2=0x7fd728144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/3382324676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809e050 0x7fd728144290 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd728062390 tx=0x7fd718006e90).stop 2020-07-16T20:30:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 -- 172.21.15.22:0/3382324676 shutdown_connections 2020-07-16T20:30:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/3382324676 >> v2:172.21.15.116:3300/0 conn(0x7fd728144780 0x7fd7280b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/3382324676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809e050 0x7fd728144290 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 -- 172.21.15.22:0/3382324676 >> 172.21.15.22:0/3382324676 conn(0x7fd7280b9530 msgr2=0x7fd7280b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 -- 172.21.15.22:0/3382324676 shutdown_connections 2020-07-16T20:30:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.107+0000 7fd72cbbb700 1 -- 172.21.15.22:0/3382324676 wait complete. 2020-07-16T20:30:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.108+0000 7fd72cbbb700 1 Processor -- start 2020-07-16T20:30:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.108+0000 7fd72cbbb700 1 -- start start 2020-07-16T20:30:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72cbbb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809dc70 0x7fd72813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72cbbb700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd728144780 0x7fd7280b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72cbbb700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7280b6670 con 0x7fd7280b84b0 2020-07-16T20:30:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72cbbb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7280b6910 con 0x7fd72809dc70 2020-07-16T20:30:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72cbbb700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7280b6bb0 con 0x7fd728144780 2020-07-16T20:30:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809dc70 0x7fd72813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd72809dc70 0x7fd72813bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38632/0 (socket says 172.21.15.22:38632) 2020-07-16T20:30:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 -- 172.21.15.22:0/1724624207 learned_addr learned my addr 172.21.15.22:0/1724624207 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd725d9b700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd728144780 0x7fd7280b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 -- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd728144780 msgr2=0x7fd7280b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd728144780 0x7fd7280b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 -- 172.21.15.22:0/1724624207 >> v1:172.21.15.116:6789/0 conn(0x7fd7280b84b0 legacy=0x7fd7280b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 -- 172.21.15.22:0/1724624207 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7280b7760 con 0x7fd72809dc70 2020-07-16T20:30:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd72659c700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809dc70 0x7fd72813bf00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd71c001f50 tx=0x7fd71c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.109+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71c00e4a0 con 0x7fd72809dc70 2020-07-16T20:30:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.110+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c00e600 con 0x7fd72809dc70 2020-07-16T20:30:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.110+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7280b8930 con 0x7fd72809dc70 2020-07-16T20:30:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.110+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd71c00e770 con 0x7fd72809dc70 2020-07-16T20:30:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.110+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72813f580 con 0x7fd72809dc70 2020-07-16T20:30:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.110+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72805f320 con 0x7fd72809dc70 2020-07-16T20:30:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.111+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd71c010030 con 0x7fd72809dc70 2020-07-16T20:30:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.111+0000 7fd7167fc700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 0x7fd6fc0524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.111+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd71c067960 con 0x7fd72809dc70 2020-07-16T20:30:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.111+0000 7fd725d9b700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 0x7fd6fc0524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.111+0000 7fd725d9b700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 0x7fd6fc0524d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd71801c000 tx=0x7fd718015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.115+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fd71c0400f0 con 0x7fd72809dc70 2020-07-16T20:30:30.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.271+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7280b5800 con 0x7fd72809dc70 2020-07-16T20:30:30.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.272+0000 7fd7167fc700 1 -- 172.21.15.22:0/1724624207 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16363 (secure 0 0 0) 0x7fd71c043710 con 0x7fd72809dc70 2020-07-16T20:30:30.274 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:30.275 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:29.955688+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:30.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 msgr2=0x7fd6fc0524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 0x7fd6fc0524d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fd71801c000 tx=0x7fd718015000).stop 2020-07-16T20:30:30.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809dc70 msgr2=0x7fd72813bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809dc70 0x7fd72813bf00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd71c001f50 tx=0x7fd71c007c10).stop 2020-07-16T20:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 shutdown_connections 2020-07-16T20:30:30.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd6fc050010 0x7fd6fc0524d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd72809dc70 0x7fd72813bf00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.273+0000 7fd72cbbb700 1 --2- 172.21.15.22:0/1724624207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd728144780 0x7fd7280b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.274+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 >> 172.21.15.22:0/1724624207 conn(0x7fd7280b9530 msgr2=0x7fd728143130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:30.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.274+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 shutdown_connections 2020-07-16T20:30:30.280 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.274+0000 7fd72cbbb700 1 -- 172.21.15.22:0/1724624207 wait complete. 2020-07-16T20:30:30.286 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:30.416 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 Processor -- start 2020-07-16T20:30:30.417 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 -- start start 2020-07-16T20:30:30.417 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 0x7fd2f0060030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.418 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd2f005fa40 0x7fd2f014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.418 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f00b5c20 con 0x7fd2f005f5e0 2020-07-16T20:30:30.418 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f00ae6f0 con 0x7fd2f005fa40 2020-07-16T20:30:30.419 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.399+0000 7fd2f7ee0700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0060520 con 0x7fd2f00b4fb0 2020-07-16T20:30:30.419 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f5c7c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 0x7fd2f0060030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.419 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd2f005fa40 0x7fd2f014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.420 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd2f005fa40 0x7fd2f014dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:37754/0 (socket says 172.21.15.22:37754) 2020-07-16T20:30:30.420 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f5c7c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 0x7fd2f0060030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:44468/0 (socket says 172.21.15.22:44468) 2020-07-16T20:30:30.420 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f547b700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd2f005f5e0 0x7fd2f0142b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:41698/0 (socket says 172.21.15.22:41698) 2020-07-16T20:30:30.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 -- 172.21.15.22:0/3602316987 learned_addr learned my addr 172.21.15.22:0/3602316987 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:30.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 -- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 msgr2=0x7fd2f0060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:30.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 --2- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 0x7fd2f0060030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 -- 172.21.15.22:0/3602316987 >> v1:172.21.15.116:6789/0 conn(0x7fd2f005f5e0 legacy=0x7fd2f0142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f4c7a700 1 -- 172.21.15.22:0/3602316987 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821338436 0 0) 0x7fd2f00b5c20 con 0x7fd2f005f5e0 2020-07-16T20:30:30.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 -- 172.21.15.22:0/3602316987 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00aeb90 con 0x7fd2f005fa40 2020-07-16T20:30:30.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f647d700 1 --2- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005fa40 0x7fd2f014dd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd2e80032b0 tx=0x7fd2e8009270).ready entity=mon.1 client_cookie=bbbb8f86beac5fc8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f4c7a700 1 -- 172.21.15.22:0/3602316987 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e8009e60 con 0x7fd2f005fa40 2020-07-16T20:30:30.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f4c7a700 1 -- 172.21.15.22:0/3602316987 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800bc00 con 0x7fd2f005fa40 2020-07-16T20:30:30.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.400+0000 7fd2f4c7a700 1 -- 172.21.15.22:0/3602316987 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e800bd70 con 0x7fd2f005fa40 2020-07-16T20:30:30.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005fa40 msgr2=0x7fd2f014dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005fa40 0x7fd2f014dd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd2e80032b0 tx=0x7fd2e8009270).stop 2020-07-16T20:30:30.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/3602316987 shutdown_connections 2020-07-16T20:30:30.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005fa40 0x7fd2f014dd60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/3602316987 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2f00b4fb0 0x7fd2f0060030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/3602316987 >> 172.21.15.22:0/3602316987 conn(0x7fd2f00b9530 msgr2=0x7fd2f00b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:30.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/3602316987 shutdown_connections 2020-07-16T20:30:30.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.401+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/3602316987 wait complete. 2020-07-16T20:30:30.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.402+0000 7fd2f7ee0700 1 Processor -- start 2020-07-16T20:30:30.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.402+0000 7fd2f7ee0700 1 -- start start 2020-07-16T20:30:30.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f7ee0700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd2f005f5e0 0x7fd2f013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f7ee0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f7ee0700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f01568b0 con 0x7fd2f00afd60 2020-07-16T20:30:30.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f7ee0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f00b0180 con 0x7fd2f00b4fb0 2020-07-16T20:30:30.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f7ee0700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f013e780 con 0x7fd2f005f5e0 2020-07-16T20:30:30.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f547b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f547b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38648/0 (socket says 172.21.15.22:38648) 2020-07-16T20:30:30.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f547b700 1 -- 172.21.15.22:0/2216851260 learned_addr learned my addr 172.21.15.22:0/2216851260 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:30.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 --2- 172.21.15.22:0/2216851260 >> v2:172.21.15.116:3300/0 conn(0x7fd2f005f5e0 0x7fd2f013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 -- 172.21.15.22:0/2216851260 >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 msgr2=0x7fd2f00af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 --2- 172.21.15.22:0/2216851260 >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326987227 0 0) 0x7fd2f01568b0 con 0x7fd2f00afd60 2020-07-16T20:30:30.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 -- 172.21.15.22:0/2216851260 >> v1:172.21.15.116:6789/0 conn(0x7fd2f00afd60 legacy=0x7fd2f0155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 -- 172.21.15.22:0/2216851260 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00b0390 con 0x7fd2f005f5e0 2020-07-16T20:30:30.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f547b700 1 --2- 172.21.15.22:0/2216851260 >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:30.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2f5c7c700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005f5e0 0x7fd2f013f1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd2e400c000 tx=0x7fd2e4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.403+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e400ca10 con 0x7fd2f005f5e0 2020-07-16T20:30:30.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.404+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400cb70 con 0x7fd2f005f5e0 2020-07-16T20:30:30.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.404+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2e40123f0 con 0x7fd2f005f5e0 2020-07-16T20:30:30.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.404+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f00b0830 con 0x7fd2f005f5e0 2020-07-16T20:30:30.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.404+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f0156480 con 0x7fd2f005f5e0 2020-07-16T20:30:30.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.405+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f00b0520 con 0x7fd2f005f5e0 2020-07-16T20:30:30.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.405+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd2e4012550 con 0x7fd2f005f5e0 2020-07-16T20:30:30.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.405+0000 7fd2e1ffb700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 0x7fd2c8052450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.405+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd2e4068100 con 0x7fd2f005f5e0 2020-07-16T20:30:30.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.405+0000 7fd2f547b700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 0x7fd2c8052450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.406+0000 7fd2f547b700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 0x7fd2c8052450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd2ec00d000 tx=0x7fd2ec007980).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.409+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fd2e4040830 con 0x7fd2f005f5e0 2020-07-16T20:30:30.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.565+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2f005f320 con 0x7fd2f005f5e0 2020-07-16T20:30:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.567+0000 7fd2e1ffb700 1 -- 172.21.15.22:0/2216851260 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16363 (secure 0 0 0) 0x7fd2e4016020 con 0x7fd2f005f5e0 2020-07-16T20:30:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 msgr2=0x7fd2c8052450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 0x7fd2c8052450 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd2ec00d000 tx=0x7fd2ec007980).stop 2020-07-16T20:30:30.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005f5e0 msgr2=0x7fd2f013f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005f5e0 0x7fd2f013f1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd2e400c000 tx=0x7fd2e4008040).stop 2020-07-16T20:30:30.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 shutdown_connections 2020-07-16T20:30:30.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd2c804ff90 0x7fd2c8052450 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/2216851260 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2f005f5e0 0x7fd2f013f1d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 --2- 172.21.15.22:0/2216851260 >> v2:172.21.15.22:3300/0 conn(0x7fd2f00b4fb0 0x7fd2f00af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 >> 172.21.15.22:0/2216851260 conn(0x7fd2f00b9530 msgr2=0x7fd2f00b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:30.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 shutdown_connections 2020-07-16T20:30:30.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.568+0000 7fd2f7ee0700 1 -- 172.21.15.22:0/2216851260 wait complete. 2020-07-16T20:30:30.580 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:30.581 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":24,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:29.955688+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:30.583 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-07-16T20:30:30.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.700+0000 7f852336a700 1 Processor -- start 2020-07-16T20:30:30.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.700+0000 7f852336a700 1 -- start start 2020-07-16T20:30:30.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f851c0b8670 0x7f851c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 0x7f851c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c0b8ff0 con 0x7f851c0b4280 2020-07-16T20:30:30.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c0b3de0 con 0x7f851c0b8670 2020-07-16T20:30:30.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c09f700 con 0x7f851c09d720 2020-07-16T20:30:30.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f851c0b8670 0x7f851c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f851c0b8670 0x7f851c0b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38654/0 (socket says 172.21.15.22:38654) 2020-07-16T20:30:30.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 -- 172.21.15.22:0/3432084829 learned_addr learned my addr 172.21.15.22:0/3432084829 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:30.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8520905700 1 --2- 172.21.15.22:0/3432084829 >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 0x7f851c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 -- 172.21.15.22:0/3432084829 >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 msgr2=0x7f851c09dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:30.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 --2- 172.21.15.22:0/3432084829 >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 0x7f851c09dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 -- 172.21.15.22:0/3432084829 >> v1:172.21.15.116:6789/0 conn(0x7f851c0b4280 legacy=0x7f851c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 -- 172.21.15.22:0/3432084829 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0b56f0 con 0x7f851c0b8670 2020-07-16T20:30:30.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8520905700 1 --2- 172.21.15.22:0/3432084829 >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 0x7f851c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:30.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f8521106700 1 --2- 172.21.15.22:0/3432084829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0b8670 0x7f851c0b8a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f850c002f30 tx=0x7f850c006e90).ready entity=mon.0 client_cookie=a807db7717960ef2 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f850bfff700 1 -- 172.21.15.22:0/3432084829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c009bb0 con 0x7f851c0b8670 2020-07-16T20:30:30.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f850bfff700 1 -- 172.21.15.22:0/3432084829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c009d10 con 0x7f851c0b8670 2020-07-16T20:30:30.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f850bfff700 1 -- 172.21.15.22:0/3432084829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f850c010660 con 0x7f851c0b8670 2020-07-16T20:30:30.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 -- 172.21.15.22:0/3432084829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0b8670 msgr2=0x7f851c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.701+0000 7f852336a700 1 --2- 172.21.15.22:0/3432084829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0b8670 0x7f851c0b8a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f850c002f30 tx=0x7f850c006e90).stop 2020-07-16T20:30:30.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 -- 172.21.15.22:0/3432084829 shutdown_connections 2020-07-16T20:30:30.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 --2- 172.21.15.22:0/3432084829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f851c0b8670 0x7f851c0b8a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 --2- 172.21.15.22:0/3432084829 >> v2:172.21.15.116:3300/0 conn(0x7f851c09d720 0x7f851c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 -- 172.21.15.22:0/3432084829 >> 172.21.15.22:0/3432084829 conn(0x7f851c0b9660 msgr2=0x7f851c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:30.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 -- 172.21.15.22:0/3432084829 shutdown_connections 2020-07-16T20:30:30.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.702+0000 7f852336a700 1 -- 172.21.15.22:0/3432084829 wait complete. 2020-07-16T20:30:30.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.703+0000 7f852336a700 1 Processor -- start 2020-07-16T20:30:30.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.703+0000 7f852336a700 1 -- start start 2020-07-16T20:30:30.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f852336a700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 0x7f851c146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f852336a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 0x7f851c140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f852336a700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c15b250 con 0x7f851c09d720 2020-07-16T20:30:30.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f852336a700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c090eb0 con 0x7f851c15ad40 2020-07-16T20:30:30.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f852336a700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c158730 con 0x7f851c0b4280 2020-07-16T20:30:30.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8521106700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f851c09d720 0x7f851c066d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:41718/0 (socket says 172.21.15.22:41718) 2020-07-16T20:30:30.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8521106700 1 -- 172.21.15.22:0/3089705006 learned_addr learned my addr 172.21.15.22:0/3089705006 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:30.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8521907700 1 --2- 172.21.15.22:0/3089705006 >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 0x7f851c140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8520905700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 0x7f851c146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747228730 0 0) 0x7f851c15b250 con 0x7f851c09d720 2020-07-16T20:30:30.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003240 con 0x7f851c09d720 2020-07-16T20:30:30.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8520905700 1 -- 172.21.15.22:0/3089705006 >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 msgr2=0x7f851c140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8520905700 1 --2- 172.21.15.22:0/3089705006 >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 0x7f851c140920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8520905700 1 -- 172.21.15.22:0/3089705006 >> v1:172.21.15.116:6789/0 conn(0x7f851c09d720 legacy=0x7f851c066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8520905700 1 -- 172.21.15.22:0/3089705006 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c15b4f0 con 0x7f851c0b4280 2020-07-16T20:30:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.704+0000 7f8521907700 1 --2- 172.21.15.22:0/3089705006 >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 0x7f851c140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:30.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f8520905700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 0x7f851c146c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f851800a000 tx=0x7f8518008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85180118a0 con 0x7f851c0b4280 2020-07-16T20:30:30.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8518011a00 con 0x7f851c0b4280 2020-07-16T20:30:30.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c15b790 con 0x7f851c0b4280 2020-07-16T20:30:30.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8518011d60 con 0x7f851c0b4280 2020-07-16T20:30:30.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.705+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c144ae0 con 0x7f851c0b4280 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.706+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c15b920 con 0x7f851c0b4280 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.706+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f851801c460 con 0x7f851c0b4280 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.706+0000 7f85097fa700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 0x7f84f4052820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.706+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f85180680f0 con 0x7f851c0b4280 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.706+0000 7f8521106700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 0x7f84f4052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:30.719 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.707+0000 7f8521106700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 0x7f84f4052820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f850c006f90 tx=0x7f850c017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:30.720 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.710+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f85180407a0 con 0x7f851c0b4280 2020-07-16T20:30:30.924 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:30.923+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f851c05f320 con 0x7f851c0b4280 2020-07-16T20:30:31.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.596+0000 7f85097fa700 1 -- 172.21.15.22:0/3089705006 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8518043dc0 con 0x7f851c0b4280 2020-07-16T20:30:31.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 msgr2=0x7f84f4052820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 0x7f84f4052820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f850c006f90 tx=0x7f850c017000).stop 2020-07-16T20:30:31.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 msgr2=0x7f851c146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 0x7f851c146c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f851800a000 tx=0x7f8518008040).stop 2020-07-16T20:30:31.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 shutdown_connections 2020-07-16T20:30:31.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f84f4050360 0x7f84f4052820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 --2- 172.21.15.22:0/3089705006 >> v2:172.21.15.116:3300/0 conn(0x7f851c15ad40 0x7f851c140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 --2- 172.21.15.22:0/3089705006 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f851c0b4280 0x7f851c146c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 >> 172.21.15.22:0/3089705006 conn(0x7f851c0b9660 msgr2=0x7f851c141b40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 shutdown_connections 2020-07-16T20:30:31.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.598+0000 7f852336a700 1 -- 172.21.15.22:0/3089705006 wait complete. 2020-07-16T20:30:31.615 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:30:31.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.739+0000 7f213ff44700 1 Processor -- start 2020-07-16T20:30:31.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.739+0000 7f213ff44700 1 -- start start 2020-07-16T20:30:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f213809e050 0x7f2138144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2138144780 0x7f21380b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2138147ed0 con 0x7f213809dc70 2020-07-16T20:30:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2138148170 con 0x7f213809e050 2020-07-16T20:30:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213809cb10 con 0x7f2138144780 2020-07-16T20:30:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f213809e050 0x7f2138144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f213809e050 0x7f2138144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38670/0 (socket says 172.21.15.22:38670) 2020-07-16T20:30:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 -- 172.21.15.22:0/2682075585 learned_addr learned my addr 172.21.15.22:0/2682075585 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213e4e1700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2138144780 0x7f21380b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 -- 172.21.15.22:0/2682075585 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2138144780 msgr2=0x7f21380b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2138144780 0x7f21380b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 -- 172.21.15.22:0/2682075585 >> v1:172.21.15.116:6789/0 conn(0x7f213809dc70 legacy=0x7f21381475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 -- 172.21.15.22:0/2682075585 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213809cc80 con 0x7f213809e050 2020-07-16T20:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213d4df700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f213809e050 0x7f2138144290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f2128002f30 tx=0x7f2128006e90).ready entity=mon.0 client_cookie=6bbb9635a21882b7 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ccde700 1 -- 172.21.15.22:0/2682075585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2128009850 con 0x7f213809e050 2020-07-16T20:30:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ccde700 1 -- 172.21.15.22:0/2682075585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21280099b0 con 0x7f213809e050 2020-07-16T20:30:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ccde700 1 -- 172.21.15.22:0/2682075585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2128009d10 con 0x7f213809e050 2020-07-16T20:30:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 -- 172.21.15.22:0/2682075585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f213809e050 msgr2=0x7f2138144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.740+0000 7f213ff44700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f213809e050 0x7f2138144290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f2128002f30 tx=0x7f2128006e90).stop 2020-07-16T20:30:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 -- 172.21.15.22:0/2682075585 shutdown_connections 2020-07-16T20:30:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2138144780 0x7f21380b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 --2- 172.21.15.22:0/2682075585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f213809e050 0x7f2138144290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 -- 172.21.15.22:0/2682075585 >> 172.21.15.22:0/2682075585 conn(0x7f21380b9530 msgr2=0x7f21380b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 -- 172.21.15.22:0/2682075585 shutdown_connections 2020-07-16T20:30:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.741+0000 7f213ff44700 1 -- 172.21.15.22:0/2682075585 wait complete. 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.742+0000 7f213ff44700 1 Processor -- start 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.742+0000 7f213ff44700 1 -- start start 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213ff44700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 0x7f2138140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213ff44700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 0x7f213813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213ff44700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21380afb80 con 0x7f21380af710 2020-07-16T20:30:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213ff44700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2138140f80 con 0x7f2138144780 2020-07-16T20:30:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213ff44700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2138144cd0 con 0x7f213809dc70 2020-07-16T20:30:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213e4e1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f21380af710 0x7f2138066c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39386/0 (socket says 172.21.15.22:39386) 2020-07-16T20:30:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213e4e1700 1 -- 172.21.15.22:0/94804066 learned_addr learned my addr 172.21.15.22:0/94804066 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213d4df700 1 --2- 172.21.15.22:0/94804066 >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 0x7f213813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 0x7f2138140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633505618 0 0) 0x7f21380afb80 con 0x7f21380af710 2020-07-16T20:30:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110003240 con 0x7f21380af710 2020-07-16T20:30:31.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2972349071 0 0) 0x7f2110003240 con 0x7f21380af710 2020-07-16T20:30:31.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 -- 172.21.15.22:0/94804066 >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 msgr2=0x7f213813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 --2- 172.21.15.22:0/94804066 >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 0x7f213813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 -- 172.21.15.22:0/94804066 >> v1:172.21.15.22:6789/0 conn(0x7f21380af710 legacy=0x7f2138066c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 -- 172.21.15.22:0/94804066 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138141220 con 0x7f213809dc70 2020-07-16T20:30:31.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213d4df700 1 --2- 172.21.15.22:0/94804066 >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 0x7f213813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:31.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.743+0000 7f213dce0700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 0x7f2138140990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f21300019b0 tx=0x7f2134007b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:31.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.744+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2130001810 con 0x7f213809dc70 2020-07-16T20:30:31.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.744+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400ce00 con 0x7f213809dc70 2020-07-16T20:30:31.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.744+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2134007240 con 0x7f213809dc70 2020-07-16T20:30:31.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.744+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213813d270 con 0x7f213809dc70 2020-07-16T20:30:31.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.744+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213813d710 con 0x7f213809dc70 2020-07-16T20:30:31.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.745+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2134010070 con 0x7f213809dc70 2020-07-16T20:30:31.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.745+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213805f320 con 0x7f213809dc70 2020-07-16T20:30:31.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.745+0000 7f2125ffb700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 0x7f2110052840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:31.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.745+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2134066da0 con 0x7f213809dc70 2020-07-16T20:30:31.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.745+0000 7f213d4df700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 0x7f2110052840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:31.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.746+0000 7f213d4df700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 0x7f2110052840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f212801c000 tx=0x7f2128015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:31.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.749+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f213403f430 con 0x7f213809dc70 2020-07-16T20:30:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.957+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2138060640 con 0x7f213809dc70 2020-07-16T20:30:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.957+0000 7f2125ffb700 1 -- 172.21.15.22:0/94804066 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1416 (secure 0 0 0) 0x7f2134042a50 con 0x7f213809dc70 2020-07-16T20:30:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 msgr2=0x7f2110052840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 0x7f2110052840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f212801c000 tx=0x7f2128015000).stop 2020-07-16T20:30:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 msgr2=0x7f2138140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 0x7f2138140990 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f21300019b0 tx=0x7f2134007b30).stop 2020-07-16T20:30:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 shutdown_connections 2020-07-16T20:30:31.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2110050380 0x7f2110052840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 --2- 172.21.15.22:0/94804066 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f213809dc70 0x7f2138140990 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 --2- 172.21.15.22:0/94804066 >> v2:172.21.15.116:3300/0 conn(0x7f2138144780 0x7f213813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 >> 172.21.15.22:0/94804066 conn(0x7f21380b9530 msgr2=0x7f21380aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 shutdown_connections 2020-07-16T20:30:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:31.959+0000 7f213ff44700 1 -- 172.21.15.22:0/94804066 wait complete. 2020-07-16T20:30:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2020-07-16T20:30:31.968 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:31.968 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:29.955842+0000","modified":"2020-07-16T20:30:31.593847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:30:31.973 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:32.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.090+0000 7efe091fc700 1 Processor -- start 2020-07-16T20:30:32.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.090+0000 7efe091fc700 1 -- start start 2020-07-16T20:30:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe0409dc70 0x7efe041475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe04144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe04147ed0 con 0x7efe04144780 2020-07-16T20:30:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe04148170 con 0x7efe0409dc70 2020-07-16T20:30:32.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0409cb10 con 0x7efe0409e050 2020-07-16T20:30:32.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe0409dc70 0x7efe041475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe0409dc70 0x7efe041475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38682/0 (socket says 172.21.15.22:38682) 2020-07-16T20:30:32.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 -- 172.21.15.22:0/3677073683 learned_addr learned my addr 172.21.15.22:0/3677073683 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:32.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efdfbfff700 1 --2- 172.21.15.22:0/3677073683 >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe04144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 -- 172.21.15.22:0/3677073683 >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 msgr2=0x7efe04144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 --2- 172.21.15.22:0/3677073683 >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe04144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 -- 172.21.15.22:0/3677073683 >> v1:172.21.15.116:6789/0 conn(0x7efe04144780 legacy=0x7efe040b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 -- 172.21.15.22:0/3677073683 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0409cc80 con 0x7efe0409dc70 2020-07-16T20:30:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe02d9d700 1 --2- 172.21.15.22:0/3677073683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe0409dc70 0x7efe041475c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efe04062390 tx=0x7efdf4006e90).ready entity=mon.0 client_cookie=7e8bea062d34c36e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe0259c700 1 -- 172.21.15.22:0/3677073683 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf4009930 con 0x7efe0409dc70 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe0259c700 1 -- 172.21.15.22:0/3677073683 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf4009a90 con 0x7efe0409dc70 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe0259c700 1 -- 172.21.15.22:0/3677073683 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf4009e30 con 0x7efe0409dc70 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- 172.21.15.22:0/3677073683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe0409dc70 msgr2=0x7efe041475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 --2- 172.21.15.22:0/3677073683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe0409dc70 0x7efe041475c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7efe04062390 tx=0x7efdf4006e90).stop 2020-07-16T20:30:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- 172.21.15.22:0/3677073683 shutdown_connections 2020-07-16T20:30:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 --2- 172.21.15.22:0/3677073683 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe0409dc70 0x7efe041475c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 --2- 172.21.15.22:0/3677073683 >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe04144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- 172.21.15.22:0/3677073683 >> 172.21.15.22:0/3677073683 conn(0x7efe040b9530 msgr2=0x7efe040b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- 172.21.15.22:0/3677073683 shutdown_connections 2020-07-16T20:30:32.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.091+0000 7efe091fc700 1 -- 172.21.15.22:0/3677073683 wait complete. 2020-07-16T20:30:32.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.093+0000 7efe091fc700 1 Processor -- start 2020-07-16T20:30:32.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.093+0000 7efe091fc700 1 -- start start 2020-07-16T20:30:32.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.093+0000 7efe091fc700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe040b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.093+0000 7efe091fc700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 0x7efe0413f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe091fc700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040b0810 con 0x7efe04144780 2020-07-16T20:30:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe091fc700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0413e270 con 0x7efe0409e050 2020-07-16T20:30:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe091fc700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0413e460 con 0x7efe0413ee40 2020-07-16T20:30:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfbfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efe04144780 0x7efe0413fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39398/0 (socket says 172.21.15.22:39398) 2020-07-16T20:30:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfbfff700 1 -- 172.21.15.22:0/2052288243 learned_addr learned my addr 172.21.15.22:0/2052288243 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:32.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 --2- 172.21.15.22:0/2052288243 >> v2:172.21.15.116:3300/0 conn(0x7efe0409e050 0x7efe040b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe0359e700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 0x7efe0413f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184321447 0 0) 0x7efe040b0810 con 0x7efe04144780 2020-07-16T20:30:32.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde0003240 con 0x7efe04144780 2020-07-16T20:30:32.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1625304911 0 0) 0x7efde0003240 con 0x7efe04144780 2020-07-16T20:30:32.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe040b0810 con 0x7efe04144780 2020-07-16T20:30:32.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7efdec006e60 con 0x7efe04144780 2020-07-16T20:30:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 -- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 msgr2=0x7efe0413f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 0x7efe0413f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 -- 172.21.15.22:0/2052288243 >> v1:172.21.15.22:6789/0 conn(0x7efe04144780 legacy=0x7efe0413fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 -- 172.21.15.22:0/2052288243 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0413e700 con 0x7efe0409e050 2020-07-16T20:30:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe0359e700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 0x7efe0413f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efe02d9d700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0409e050 0x7efe040b0320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7efe04062390 tx=0x7efdf4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf4011d50 con 0x7efe0409e050 2020-07-16T20:30:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.094+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf401d3c0 con 0x7efe0409e050 2020-07-16T20:30:32.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.095+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0413e9a0 con 0x7efe0409e050 2020-07-16T20:30:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.095+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efdf401d720 con 0x7efe0409e050 2020-07-16T20:30:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.095+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040b7050 con 0x7efe0409e050 2020-07-16T20:30:32.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.095+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0413eb30 con 0x7efe0409e050 2020-07-16T20:30:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.096+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7efdf401a040 con 0x7efe0409e050 2020-07-16T20:30:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.096+0000 7efdfaffd700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 0x7efde0052a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.096+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efdf4068ce0 con 0x7efe0409e050 2020-07-16T20:30:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.096+0000 7efdfbfff700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 0x7efde0052a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.121 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.096+0000 7efdfbfff700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 0x7efde0052a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7efdec002f30 tx=0x7efdec0015b0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.100+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7efdf4041350 con 0x7efe0409e050 2020-07-16T20:30:32.261 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.260+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe0405f320 con 0x7efe0409e050 2020-07-16T20:30:32.263 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.261+0000 7efdfaffd700 1 -- 172.21.15.22:0/2052288243 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7efdf4024070 con 0x7efe0409e050 2020-07-16T20:30:32.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:32.264 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 msgr2=0x7efde0052a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 0x7efde0052a20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7efdec002f30 tx=0x7efdec0015b0).stop 2020-07-16T20:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0409e050 msgr2=0x7efe040b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0409e050 0x7efe040b0320 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7efe04062390 tx=0x7efdf4015000).stop 2020-07-16T20:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 shutdown_connections 2020-07-16T20:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efde0050560 0x7efde0052a20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efe0413ee40 0x7efe0413f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 --2- 172.21.15.22:0/2052288243 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe0409e050 0x7efe040b0320 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 >> 172.21.15.22:0/2052288243 conn(0x7efe040b9530 msgr2=0x7efe040b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 shutdown_connections 2020-07-16T20:30:32.272 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.263+0000 7efe091fc700 1 -- 172.21.15.22:0/2052288243 wait complete. 2020-07-16T20:30:32.279 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-07-16T20:30:32.281 INFO:tasks.ceph.mds.a:Restarting daemon 2020-07-16T20:30:32.281 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-07-16T20:30:32.284 INFO:tasks.ceph.mds.a:Started 2020-07-16T20:30:32.284 INFO:tasks.ceph.mds.b:Restarting daemon 2020-07-16T20:30:32.285 INFO:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-07-16T20:30:32.294 INFO:tasks.ceph.mds.b:Started 2020-07-16T20:30:32.295 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:32.296 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-07-16T20:30:32.365 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2020-07-16T20:30:32.376 INFO:tasks.ceph.mds.b.smithi116.stdout:starting mds.b at 2020-07-16T20:30:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.413+0000 7f59eb535700 1 Processor -- start 2020-07-16T20:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.413+0000 7f59eb535700 1 -- start start 2020-07-16T20:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59e40b4500 0x7f59e40af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59e4143410 0x7f59e41438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e40b6670 con 0x7f59e41474c0 2020-07-16T20:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e409e6b0 con 0x7f59e4143410 2020-07-16T20:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e40b4c10 con 0x7f59e40b4500 2020-07-16T20:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59e4143410 0x7f59e41438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f59e4143410 0x7f59e41438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38710/0 (socket says 172.21.15.22:38710) 2020-07-16T20:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 -- 172.21.15.22:0/3711061080 learned_addr learned my addr 172.21.15.22:0/3711061080 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e92d1700 1 --2- 172.21.15.22:0/3711061080 >> v2:172.21.15.116:3300/0 conn(0x7f59e40b4500 0x7f59e40af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 -- 172.21.15.22:0/3711061080 >> v2:172.21.15.116:3300/0 conn(0x7f59e40b4500 msgr2=0x7f59e40af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 --2- 172.21.15.22:0/3711061080 >> v2:172.21.15.116:3300/0 conn(0x7f59e40b4500 0x7f59e40af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 -- 172.21.15.22:0/3711061080 >> v1:172.21.15.116:6789/0 conn(0x7f59e41474c0 legacy=0x7f59e4147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 -- 172.21.15.22:0/3711061080 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40b4eb0 con 0x7f59e4143410 2020-07-16T20:30:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59e8ad0700 1 --2- 172.21.15.22:0/3711061080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59e4143410 0x7f59e41438a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f59d4002f30 tx=0x7f59d4006e90).ready entity=mon.0 client_cookie=70c1cd6fc4276e48 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59d3fff700 1 -- 172.21.15.22:0/3711061080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d40099c0 con 0x7f59e4143410 2020-07-16T20:30:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59d3fff700 1 -- 172.21.15.22:0/3711061080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4009b20 con 0x7f59e4143410 2020-07-16T20:30:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59d3fff700 1 -- 172.21.15.22:0/3711061080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d4009e80 con 0x7f59e4143410 2020-07-16T20:30:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 -- 172.21.15.22:0/3711061080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59e4143410 msgr2=0x7f59e41438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 --2- 172.21.15.22:0/3711061080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59e4143410 0x7f59e41438a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f59d4002f30 tx=0x7f59d4006e90).stop 2020-07-16T20:30:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.414+0000 7f59eb535700 1 -- 172.21.15.22:0/3711061080 shutdown_connections 2020-07-16T20:30:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.415+0000 7f59eb535700 1 --2- 172.21.15.22:0/3711061080 >> v2:172.21.15.116:3300/0 conn(0x7f59e40b4500 0x7f59e40af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.415+0000 7f59eb535700 1 --2- 172.21.15.22:0/3711061080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59e4143410 0x7f59e41438a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.415+0000 7f59eb535700 1 -- 172.21.15.22:0/3711061080 >> 172.21.15.22:0/3711061080 conn(0x7f59e40b73d0 msgr2=0x7f59e4063000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.415+0000 7f59eb535700 1 -- 172.21.15.22:0/3711061080 shutdown_connections 2020-07-16T20:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.415+0000 7f59eb535700 1 -- 172.21.15.22:0/3711061080 wait complete. 2020-07-16T20:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.416+0000 7f59eb535700 1 Processor -- start 2020-07-16T20:30:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.416+0000 7f59eb535700 1 -- start start 2020-07-16T20:30:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59eb535700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f59e41474c0 0x7f59e40642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59eb535700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e4146820 con 0x7f59e40664c0 2020-07-16T20:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59eb535700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e4146580 con 0x7f59e40b4500 2020-07-16T20:30:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59eb535700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e40b1ff0 con 0x7f59e41474c0 2020-07-16T20:30:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e9ad2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59e40664c0 0x7f59e4145990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39426/0 (socket says 172.21.15.22:39426) 2020-07-16T20:30:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e9ad2700 1 -- 172.21.15.22:0/2396554279 learned_addr learned my addr 172.21.15.22:0/2396554279 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e8ad0700 1 --2- 172.21.15.22:0/2396554279 >> v2:172.21.15.116:3300/0 conn(0x7f59e41474c0 0x7f59e40642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581811152 0 0) 0x7f59e4146820 con 0x7f59e40664c0 2020-07-16T20:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59bc003240 con 0x7f59e40664c0 2020-07-16T20:30:32.451 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325657718 0 0) 0x7f59e4146580 con 0x7f59e40b4500 2020-07-16T20:30:32.452 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e8ad0700 1 -- 172.21.15.22:0/2396554279 >> v1:172.21.15.116:6789/0 conn(0x7f59e40b4500 legacy=0x7f59e40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.452 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e8ad0700 1 -- 172.21.15.22:0/2396554279 >> v1:172.21.15.22:6789/0 conn(0x7f59e40664c0 legacy=0x7f59e4145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.453 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e8ad0700 1 -- 172.21.15.22:0/2396554279 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e413a200 con 0x7f59e41474c0 2020-07-16T20:30:32.453 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.417+0000 7f59e8ad0700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e41474c0 0x7f59e40642b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f59d4002f30 tx=0x7f59d4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.453 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.418+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d401d5d0 con 0x7f59e41474c0 2020-07-16T20:30:32.454 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.418+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d401d730 con 0x7f59e41474c0 2020-07-16T20:30:32.454 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.418+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e40b2ba0 con 0x7f59e41474c0 2020-07-16T20:30:32.454 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.418+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59d401da90 con 0x7f59e41474c0 2020-07-16T20:30:32.455 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.418+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e4146260 con 0x7f59e41474c0 2020-07-16T20:30:32.455 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4061960 con 0x7f59e41474c0 2020-07-16T20:30:32.455 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f59d4025030 con 0x7f59e41474c0 2020-07-16T20:30:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59d17fa700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 0x7f59bc052800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f59d4069300 con 0x7f59e41474c0 2020-07-16T20:30:32.456 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59e92d1700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 0x7f59bc052800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.419+0000 7f59e92d1700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 0x7f59bc052800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f59e0006920 tx=0x7f59e0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.457 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.423+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f59d4041b50 con 0x7f59e41474c0 2020-07-16T20:30:32.584 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.583+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e406b370 con 0x7f59e41474c0 2020-07-16T20:30:32.586 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.584+0000 7f59d17fa700 1 -- 172.21.15.22:0/2396554279 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f59d40450b0 con 0x7f59e41474c0 2020-07-16T20:30:32.587 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:32.587 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:32.589 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 msgr2=0x7f59bc052800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 0x7f59bc052800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f59e0006920 tx=0x7f59e0008040).stop 2020-07-16T20:30:32.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e41474c0 msgr2=0x7f59e40642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e41474c0 0x7f59e40642b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f59d4002f30 tx=0x7f59d4015000).stop 2020-07-16T20:30:32.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 shutdown_connections 2020-07-16T20:30:32.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f59bc050340 0x7f59bc052800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 --2- 172.21.15.22:0/2396554279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59e41474c0 0x7f59e40642b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 >> 172.21.15.22:0/2396554279 conn(0x7f59e40b73d0 msgr2=0x7f59e4062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 shutdown_connections 2020-07-16T20:30:32.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.585+0000 7f59eb535700 1 -- 172.21.15.22:0/2396554279 wait complete. 2020-07-16T20:30:32.600 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:11.371623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:21.693414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:25.164093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:27.610215+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:30:32.601 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:32.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.744+0000 7f1cefd51700 1 Processor -- start 2020-07-16T20:30:32.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.744+0000 7f1cefd51700 1 -- start start 2020-07-16T20:30:32.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1ce80b87b0 0x7f1ce80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 0x7f1ce80b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce809cea0 0x7f1ce809d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce809e030 con 0x7f1ce809cea0 2020-07-16T20:30:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce809daf0 con 0x7f1ce80b87b0 2020-07-16T20:30:32.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cefd51700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce809dd90 con 0x7f1ce80b7560 2020-07-16T20:30:32.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce809cea0 0x7f1ce809d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce809cea0 0x7f1ce809d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38722/0 (socket says 172.21.15.22:38722) 2020-07-16T20:30:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 -- 172.21.15.22:0/3586727529 learned_addr learned my addr 172.21.15.22:0/3586727529 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1ced2ec700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 0x7f1ce80b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cedaed700 1 --2- 172.21.15.22:0/3586727529 >> v2:172.21.15.116:3300/0 conn(0x7f1ce80b87b0 0x7f1ce80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 -- 172.21.15.22:0/3586727529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 msgr2=0x7f1ce80b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 0x7f1ce80b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 -- 172.21.15.22:0/3586727529 >> v2:172.21.15.116:3300/0 conn(0x7f1ce80b87b0 msgr2=0x7f1ce80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 --2- 172.21.15.22:0/3586727529 >> v2:172.21.15.116:3300/0 conn(0x7f1ce80b87b0 0x7f1ce80b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 -- 172.21.15.22:0/3586727529 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80b7eb0 con 0x7f1ce809cea0 2020-07-16T20:30:32.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1ced2ec700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 0x7f1ce80b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.745+0000 7f1cee2ee700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce809cea0 0x7f1ce809d2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1ce00032b0 tx=0x7f1ce0009270).ready entity=mon.0 client_cookie=34799534627fb7cd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cecaeb700 1 -- 172.21.15.22:0/3586727529 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce000bc00 con 0x7f1ce809cea0 2020-07-16T20:30:32.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cecaeb700 1 -- 172.21.15.22:0/3586727529 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000bd60 con 0x7f1ce809cea0 2020-07-16T20:30:32.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cecaeb700 1 -- 172.21.15.22:0/3586727529 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce0011400 con 0x7f1ce809cea0 2020-07-16T20:30:32.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 -- 172.21.15.22:0/3586727529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce809cea0 msgr2=0x7f1ce809d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce809cea0 0x7f1ce809d2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1ce00032b0 tx=0x7f1ce0009270).stop 2020-07-16T20:30:32.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 -- 172.21.15.22:0/3586727529 shutdown_connections 2020-07-16T20:30:32.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce809cea0 0x7f1ce809d2e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 --2- 172.21.15.22:0/3586727529 >> v2:172.21.15.116:3300/0 conn(0x7f1ce80b87b0 0x7f1ce80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 --2- 172.21.15.22:0/3586727529 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b7560 0x7f1ce80b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 -- 172.21.15.22:0/3586727529 >> 172.21.15.22:0/3586727529 conn(0x7f1ce80b9660 msgr2=0x7f1ce80b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 -- 172.21.15.22:0/3586727529 shutdown_connections 2020-07-16T20:30:32.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.746+0000 7f1cefd51700 1 -- 172.21.15.22:0/3586727529 wait complete. 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.747+0000 7f1cefd51700 1 Processor -- start 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.747+0000 7f1cefd51700 1 -- start start 2020-07-16T20:30:32.773 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cefd51700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b87b0 0x7f1ce8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cefd51700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce815a4b0 0x7f1ce80b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.776 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cefd51700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce8157940 con 0x7f1ce80b7560 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cefd51700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce8157760 con 0x7f1ce815a4b0 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cefd51700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8092780 con 0x7f1ce80b87b0 2020-07-16T20:30:32.777 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce815a4b0 0x7f1ce80b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ce815a4b0 0x7f1ce80b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38730/0 (socket says 172.21.15.22:38730) 2020-07-16T20:30:32.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 -- 172.21.15.22:0/281315658 learned_addr learned my addr 172.21.15.22:0/281315658 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:32.778 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1ced2ec700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b87b0 0x7f1ce8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 -- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b87b0 msgr2=0x7f1ce8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b87b0 0x7f1ce8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 -- 172.21.15.22:0/281315658 >> v1:172.21.15.116:6789/0 conn(0x7f1ce80b7560 legacy=0x7f1ce8066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 -- 172.21.15.22:0/281315658 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8157be0 con 0x7f1ce815a4b0 2020-07-16T20:30:32.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130836867 0 0) 0x7f1ce8157940 con 0x7f1ce80b7560 2020-07-16T20:30:32.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.748+0000 7f1cee2ee700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce815a4b0 0x7f1ce80b37e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1ce00032b0 tx=0x7f1ce0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.749+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce0010870 con 0x7f1ce815a4b0 2020-07-16T20:30:32.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.749+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce80b2300 con 0x7f1ce815a4b0 2020-07-16T20:30:32.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.749+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce00109d0 con 0x7f1ce815a4b0 2020-07-16T20:30:32.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.749+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce0010d30 con 0x7f1ce815a4b0 2020-07-16T20:30:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.749+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80b3cd0 con 0x7f1ce815a4b0 2020-07-16T20:30:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.750+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8157d70 con 0x7f1ce815a4b0 2020-07-16T20:30:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.750+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f1ce000f070 con 0x7f1ce815a4b0 2020-07-16T20:30:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.750+0000 7f1cd9ffb700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 0x7f1cc0052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:32.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.750+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1ce0069340 con 0x7f1ce815a4b0 2020-07-16T20:30:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.750+0000 7f1cedaed700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 0x7f1cc0052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.751+0000 7f1cedaed700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 0x7f1cc0052360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1cdc006920 tx=0x7f1cdc008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:32.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.754+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f1ce0041b80 con 0x7f1ce815a4b0 2020-07-16T20:30:32.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.911+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1ce805f320 con 0x7f1ce815a4b0 2020-07-16T20:30:32.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.911+0000 7f1cd9ffb700 1 -- 172.21.15.22:0/281315658 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ce0015020 con 0x7f1ce815a4b0 2020-07-16T20:30:32.915 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2020-07-16T20:30:32.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.912+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 msgr2=0x7f1cc0052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.912+0000 7f1cefd51700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 0x7f1cc0052360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f1cdc006920 tx=0x7f1cdc008040).stop 2020-07-16T20:30:32.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.912+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce815a4b0 msgr2=0x7f1ce80b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:32.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.912+0000 7f1cefd51700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce815a4b0 0x7f1ce80b37e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f1ce00032b0 tx=0x7f1ce0016000).stop 2020-07-16T20:30:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 shutdown_connections 2020-07-16T20:30:32.918 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cc004fea0 0x7f1cc0052360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ce815a4b0 0x7f1ce80b37e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 --2- 172.21.15.22:0/281315658 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1ce80b87b0 0x7f1ce8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:32.919 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 >> 172.21.15.22:0/281315658 conn(0x7f1ce80b9660 msgr2=0x7f1ce805f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 shutdown_connections 2020-07-16T20:30:32.920 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:32.913+0000 7f1cefd51700 1 -- 172.21.15.22:0/281315658 wait complete. 2020-07-16T20:30:32.926 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:33.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.067+0000 7f603986d700 1 Processor -- start 2020-07-16T20:30:33.086 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.067+0000 7f603986d700 1 -- start start 2020-07-16T20:30:33.088 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f603986d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f603414b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.088 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f603986d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603414a8d0 con 0x7f603414b630 2020-07-16T20:30:33.088 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f603986d700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340b7d30 con 0x7f60340b7890 2020-07-16T20:30:33.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f603986d700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60340b7fd0 con 0x7f603414ad00 2020-07-16T20:30:33.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f60337fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f603414b630 0x7f6034146510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39458/0 (socket says 172.21.15.22:39458) 2020-07-16T20:30:33.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f60337fe700 1 -- 172.21.15.22:0/1004043452 learned_addr learned my addr 172.21.15.22:0/1004043452 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:33.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f60327fc700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f603414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.068+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807402806 0 0) 0x7f603414a8d0 con 0x7f603414b630 2020-07-16T20:30:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6020003240 con 0x7f603414b630 2020-07-16T20:30:33.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332660476 0 0) 0x7f60340b7d30 con 0x7f60340b7890 2020-07-16T20:30:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603414a8d0 con 0x7f60340b7890 2020-07-16T20:30:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3188354496 0 0) 0x7f6020003240 con 0x7f603414b630 2020-07-16T20:30:33.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 msgr2=0x7f603414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f603414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 >> v1:172.21.15.116:6789/0 conn(0x7f60340b7890 legacy=0x7f60340b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60341481c0 con 0x7f603414b630 2020-07-16T20:30:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f602c0016d0 con 0x7f603414b630 2020-07-16T20:30:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 >> v1:172.21.15.22:6789/0 conn(0x7f603414b630 legacy=0x7f6034146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f60200038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6020003e30 0x7f60200044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60200049d0 0x7f6020004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60340b7fd0 con 0x7f60200049d0 2020-07-16T20:30:33.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602000b730 con 0x7f6020003e30 2020-07-16T20:30:33.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602000b870 con 0x7f603414ad00 2020-07-16T20:30:33.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60200049d0 0x7f6020004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60327fc700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6020003e30 0x7f60200044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.098 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6032ffd700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f60200038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.098 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 -- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 msgr2=0x7f60200038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.098 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f603414ad00 0x7f60200038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.099 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 -- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6020003e30 msgr2=0x7f60200044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.099 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6020003e30 0x7f60200044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.100 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 -- 172.21.15.22:0/1004043452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020003240 con 0x7f60200049d0 2020-07-16T20:30:33.100 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f60337fe700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60200049d0 0x7f6020004e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f602c0014a0 tx=0x7f602c007610).ready entity=mon.0 client_cookie=adaf956a8e396fa2 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.100 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f602c00cd50 con 0x7f60200049d0 2020-07-16T20:30:33.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.069+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c0070d0 con 0x7f60200049d0 2020-07-16T20:30:33.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f6031ffb700 1 -- 172.21.15.22:0/1004043452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f602c007430 con 0x7f60200049d0 2020-07-16T20:30:33.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 -- 172.21.15.22:0/1004043452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60200049d0 msgr2=0x7f6020004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 --2- 172.21.15.22:0/1004043452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60200049d0 0x7f6020004e50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f602c0014a0 tx=0x7f602c007610).stop 2020-07-16T20:30:33.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f60337fe700 1 -- 172.21.15.22:0/1004043452 reap_dead start 2020-07-16T20:30:33.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 -- 172.21.15.22:0/1004043452 shutdown_connections 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 -- 172.21.15.22:0/1004043452 >> 172.21.15.22:0/1004043452 conn(0x7f60340bc370 msgr2=0x7f60340b8340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 -- 172.21.15.22:0/1004043452 shutdown_connections 2020-07-16T20:30:33.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.070+0000 7f603986d700 1 -- 172.21.15.22:0/1004043452 wait complete. 2020-07-16T20:30:33.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.071+0000 7f603986d700 1 Processor -- start 2020-07-16T20:30:33.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.071+0000 7f603986d700 1 -- start start 2020-07-16T20:30:33.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f603986d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6034065960 0x7f6034061840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f603986d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 0x7f60341606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f603986d700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6034067040 con 0x7f6034066550 2020-07-16T20:30:33.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f603986d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6034142690 con 0x7f6034065960 2020-07-16T20:30:33.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f603986d700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603405fa80 con 0x7f6034060cb0 2020-07-16T20:30:33.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6034065960 0x7f6034061840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6034065960 0x7f6034061840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38760/0 (socket says 172.21.15.22:38760) 2020-07-16T20:30:33.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 -- 172.21.15.22:0/1355171059 learned_addr learned my addr 172.21.15.22:0/1355171059 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:33.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60337fe700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 0x7f60341606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 -- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 msgr2=0x7f60341606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 0x7f60341606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 -- 172.21.15.22:0/1355171059 >> v1:172.21.15.116:6789/0 conn(0x7f6034066550 legacy=0x7f6034066930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 -- 172.21.15.22:0/1355171059 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340611a0 con 0x7f6034065960 2020-07-16T20:30:33.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60337fe700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 0x7f60341606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:33.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.072+0000 7f60327fc700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6034065960 0x7f6034061840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6024006ae0 tx=0x7f60240091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.073+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f602400fc40 con 0x7f6034065960 2020-07-16T20:30:33.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.073+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602400fda0 con 0x7f6034065960 2020-07-16T20:30:33.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.073+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6034062350 con 0x7f6034065960 2020-07-16T20:30:33.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.073+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6024014630 con 0x7f6034065960 2020-07-16T20:30:33.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.073+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6034061ef0 con 0x7f6034065960 2020-07-16T20:30:33.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.074+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603405fec0 con 0x7f6034065960 2020-07-16T20:30:33.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.074+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6024024070 con 0x7f6034065960 2020-07-16T20:30:33.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.074+0000 7f601affd700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 0x7f6010052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.074+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6024068800 con 0x7f6034065960 2020-07-16T20:30:33.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.074+0000 7f6032ffd700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 0x7f6010052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.075+0000 7f6032ffd700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 0x7f6010052470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6034144260 tx=0x7f6028007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.078+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f6024040f90 con 0x7f6034065960 2020-07-16T20:30:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.233+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f603405fc80 con 0x7f6034065960 2020-07-16T20:30:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.233+0000 7f601affd700 1 -- 172.21.15.22:0/1355171059 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6024022020 con 0x7f6034065960 2020-07-16T20:30:33.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 msgr2=0x7f6010052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 0x7f6010052470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f6034144260 tx=0x7f6028007b70).stop 2020-07-16T20:30:33.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6034065960 msgr2=0x7f6034061840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6034065960 0x7f6034061840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f6024006ae0 tx=0x7f60240091d0).stop 2020-07-16T20:30:33.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 shutdown_connections 2020-07-16T20:30:33.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f601004ffb0 0x7f6010052470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6034060cb0 0x7f60341606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 --2- 172.21.15.22:0/1355171059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6034065960 0x7f6034061840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 >> 172.21.15.22:0/1355171059 conn(0x7f60340bc370 msgr2=0x7f6034146ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 shutdown_connections 2020-07-16T20:30:33.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.235+0000 7f603986d700 1 -- 172.21.15.22:0/1355171059 wait complete. 2020-07-16T20:30:33.244 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:33.247 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.365+0000 7f3caaa6c700 1 Processor -- start 2020-07-16T20:30:33.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.365+0000 7f3caaa6c700 1 -- start start 2020-07-16T20:30:33.373 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3caaa6c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3ca40b87b0 0x7f3ca40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3caaa6c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40b7560 0x7f3ca40b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3caaa6c700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca409e030 con 0x7f3ca405f5e0 2020-07-16T20:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3caaa6c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40b7ee0 con 0x7f3ca40b7560 2020-07-16T20:30:33.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3caaa6c700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca409daf0 con 0x7f3ca40b87b0 2020-07-16T20:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40b7560 0x7f3ca40b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca40b7560 0x7f3ca40b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38770/0 (socket says 172.21.15.22:38770) 2020-07-16T20:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 -- 172.21.15.22:0/3657475449 learned_addr learned my addr 172.21.15.22:0/3657475449 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca8808700 1 --2- 172.21.15.22:0/3657475449 >> v2:172.21.15.116:3300/0 conn(0x7f3ca40b87b0 0x7f3ca40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 -- 172.21.15.22:0/3657475449 >> v2:172.21.15.116:3300/0 conn(0x7f3ca40b87b0 msgr2=0x7f3ca40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 --2- 172.21.15.22:0/3657475449 >> v2:172.21.15.116:3300/0 conn(0x7f3ca40b87b0 0x7f3ca40b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.366+0000 7f3ca3fff700 1 -- 172.21.15.22:0/3657475449 >> v1:172.21.15.116:6789/0 conn(0x7f3ca405f5e0 legacy=0x7f3ca409cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3ca3fff700 1 -- 172.21.15.22:0/3657475449 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca409dd90 con 0x7f3ca40b7560 2020-07-16T20:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3ca3fff700 1 --2- 172.21.15.22:0/3657475449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40b7560 0x7f3ca40b79f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3c94002f30 tx=0x7f3c94006e90).ready entity=mon.0 client_cookie=a167294e71f78d4b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3ca37fe700 1 -- 172.21.15.22:0/3657475449 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c940099c0 con 0x7f3ca40b7560 2020-07-16T20:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3ca37fe700 1 -- 172.21.15.22:0/3657475449 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94009b20 con 0x7f3ca40b7560 2020-07-16T20:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3ca37fe700 1 -- 172.21.15.22:0/3657475449 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c94009e80 con 0x7f3ca40b7560 2020-07-16T20:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3657475449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40b7560 msgr2=0x7f3ca40b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3657475449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40b7560 0x7f3ca40b79f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3c94002f30 tx=0x7f3c94006e90).stop 2020-07-16T20:30:33.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3657475449 shutdown_connections 2020-07-16T20:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3657475449 >> v2:172.21.15.116:3300/0 conn(0x7f3ca40b87b0 0x7f3ca40b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3657475449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca40b7560 0x7f3ca40b79f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3657475449 >> 172.21.15.22:0/3657475449 conn(0x7f3ca40b9660 msgr2=0x7f3ca40b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3657475449 shutdown_connections 2020-07-16T20:30:33.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.367+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3657475449 wait complete. 2020-07-16T20:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.368+0000 7f3caaa6c700 1 Processor -- start 2020-07-16T20:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 -- start start 2020-07-16T20:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca405f5e0 0x7f3ca415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ca40b87b0 0x7f3ca409e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 0x7f3ca4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca415b890 con 0x7f3ca405f5e0 2020-07-16T20:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca41574b0 con 0x7f3ca4066240 2020-07-16T20:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3caaa6c700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca4157750 con 0x7f3ca40b87b0 2020-07-16T20:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3ca8808700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca405f5e0 0x7f3ca415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3ca8808700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3ca405f5e0 0x7f3ca415b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38772/0 (socket says 172.21.15.22:38772) 2020-07-16T20:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3ca8808700 1 -- 172.21.15.22:0/3083256946 learned_addr learned my addr 172.21.15.22:0/3083256946 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3ca9009700 1 --2- 172.21.15.22:0/3083256946 >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 0x7f3ca4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.369+0000 7f3ca3fff700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ca40b87b0 0x7f3ca409e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 -- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ca40b87b0 msgr2=0x7f3ca409e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ca40b87b0 0x7f3ca409e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 -- 172.21.15.22:0/3083256946 >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 msgr2=0x7f3ca4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 --2- 172.21.15.22:0/3083256946 >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 0x7f3ca4157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 -- 172.21.15.22:0/3083256946 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4066bc0 con 0x7f3ca405f5e0 2020-07-16T20:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca9009700 1 --2- 172.21.15.22:0/3083256946 >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 0x7f3ca4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:33.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca8808700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca405f5e0 0x7f3ca415b220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3c8c003070 tx=0x7f3c8c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c8c009980 con 0x7f3ca405f5e0 2020-07-16T20:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c009ae0 con 0x7f3ca405f5e0 2020-07-16T20:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c8c009e40 con 0x7f3ca405f5e0 2020-07-16T20:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca409e8e0 con 0x7f3ca405f5e0 2020-07-16T20:30:33.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.370+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca4158320 con 0x7f3ca405f5e0 2020-07-16T20:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.371+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca4157920 con 0x7f3ca405f5e0 2020-07-16T20:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.371+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f3c8c013480 con 0x7f3ca405f5e0 2020-07-16T20:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.371+0000 7f3ca0ff9700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 0x7f3c80052400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.371+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3c8c068400 con 0x7f3ca405f5e0 2020-07-16T20:30:33.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.372+0000 7f3ca3fff700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 0x7f3c80052400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.372+0000 7f3ca3fff700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 0x7f3c80052400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3c9401a000 tx=0x7f3c94015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.375+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f3c8c040b30 con 0x7f3ca405f5e0 2020-07-16T20:30:33.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.535+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ca405f320 con 0x7f3ca405f5e0 2020-07-16T20:30:33.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.535+0000 7f3ca0ff9700 1 -- 172.21.15.22:0/3083256946 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3c8c044150 con 0x7f3ca405f5e0 2020-07-16T20:30:33.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:33.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 msgr2=0x7f3c80052400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 0x7f3c80052400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3c9401a000 tx=0x7f3c94015000).stop 2020-07-16T20:30:33.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca405f5e0 msgr2=0x7f3ca415b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca405f5e0 0x7f3ca415b220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3c8c003070 tx=0x7f3c8c008040).stop 2020-07-16T20:30:33.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 shutdown_connections 2020-07-16T20:30:33.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f3c8004ff40 0x7f3c80052400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3ca405f5e0 0x7f3ca415b220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> v2:172.21.15.116:3300/0 conn(0x7f3ca4066240 0x7f3ca4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 --2- 172.21.15.22:0/3083256946 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3ca40b87b0 0x7f3ca409e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 >> 172.21.15.22:0/3083256946 conn(0x7f3ca40b9660 msgr2=0x7f3ca409ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 shutdown_connections 2020-07-16T20:30:33.542 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.536+0000 7f3caaa6c700 1 -- 172.21.15.22:0/3083256946 wait complete. 2020-07-16T20:30:33.548 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:30:33.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.666+0000 7f022b729700 1 Processor -- start 2020-07-16T20:30:33.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.666+0000 7f022b729700 1 -- start start 2020-07-16T20:30:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f022b729700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02240b8670 0x7f02240b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f022b729700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f022409d720 0x7f022409dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f022b729700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240b8ff0 con 0x7f02240b4280 2020-07-16T20:30:33.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f022b729700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02240b3de0 con 0x7f02240b8670 2020-07-16T20:30:33.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f022b729700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022409f700 con 0x7f022409d720 2020-07-16T20:30:33.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f02240b8670 0x7f02240b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0229cc6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f02240b4280 0x7f022405f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39492/0 (socket says 172.21.15.22:39492) 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0229cc6700 1 -- 172.21.15.22:0/3148495981 learned_addr learned my addr 172.21.15.22:0/3148495981 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0228cc4700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f022409d720 0x7f022409dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0217fff700 1 -- 172.21.15.22:0/3148495981 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237238624 0 0) 0x7f02240b8ff0 con 0x7f02240b4280 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0217fff700 1 -- 172.21.15.22:0/3148495981 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c003240 con 0x7f02240b4280 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 -- 172.21.15.22:0/3148495981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f022409d720 msgr2=0x7f022409dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f022409d720 0x7f022409dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 -- 172.21.15.22:0/3148495981 >> v1:172.21.15.22:6789/0 conn(0x7f02240b4280 legacy=0x7f022405f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 -- 172.21.15.22:0/3148495981 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240b56f0 con 0x7f02240b8670 2020-07-16T20:30:33.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f02294c5700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02240b8670 0x7f02240b8a50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0218002f30 tx=0x7f0218006dd0).ready entity=mon.0 client_cookie=f0445aadee2d08e3 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0217fff700 1 -- 172.21.15.22:0/3148495981 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02180096a0 con 0x7f02240b8670 2020-07-16T20:30:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0217fff700 1 -- 172.21.15.22:0/3148495981 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0218009800 con 0x7f02240b8670 2020-07-16T20:30:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.667+0000 7f0217fff700 1 -- 172.21.15.22:0/3148495981 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0218009b60 con 0x7f02240b8670 2020-07-16T20:30:33.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 -- 172.21.15.22:0/3148495981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02240b8670 msgr2=0x7f02240b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02240b8670 0x7f02240b8a50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0218002f30 tx=0x7f0218006dd0).stop 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 -- 172.21.15.22:0/3148495981 shutdown_connections 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02240b8670 0x7f02240b8a50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 --2- 172.21.15.22:0/3148495981 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f022409d720 0x7f022409dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 -- 172.21.15.22:0/3148495981 >> 172.21.15.22:0/3148495981 conn(0x7f02240b9660 msgr2=0x7f02240b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 -- 172.21.15.22:0/3148495981 shutdown_connections 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.668+0000 7f022b729700 1 -- 172.21.15.22:0/3148495981 wait complete. 2020-07-16T20:30:33.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.669+0000 7f022b729700 1 Processor -- start 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.669+0000 7f022b729700 1 -- start start 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f022b729700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f022409d720 0x7f022409b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f022b729700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 0x7f0224157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f022b729700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02241458a0 con 0x7f02240b4280 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f022b729700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0224142470 con 0x7f022409d720 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f022b729700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022409b5e0 con 0x7f0224066ba0 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f022409d720 0x7f022409b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f022409d720 0x7f022409b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38786/0 (socket says 172.21.15.22:38786) 2020-07-16T20:30:33.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 -- 172.21.15.22:0/1759202252 learned_addr learned my addr 172.21.15.22:0/1759202252 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f0229cc6700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 0x7f0224157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 -- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 msgr2=0x7f0224157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 0x7f0224157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 -- 172.21.15.22:0/1759202252 >> v1:172.21.15.116:6789/0 conn(0x7f02240b4280 legacy=0x7f0224145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.700 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f02294c5700 1 -- 172.21.15.22:0/1759202252 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022409b800 con 0x7f022409d720 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.670+0000 7f0229cc6700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 0x7f0224157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f02294c5700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f022409d720 0x7f022409b0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0218002f30 tx=0x7f0218015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021801e460 con 0x7f022409d720 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021801e5c0 con 0x7f022409d720 2020-07-16T20:30:33.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021801e920 con 0x7f022409d720 2020-07-16T20:30:33.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022409baa0 con 0x7f022409d720 2020-07-16T20:30:33.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.671+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0224067050 con 0x7f022409d720 2020-07-16T20:30:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.672+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022405f320 con 0x7f022409d720 2020-07-16T20:30:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.672+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0218025030 con 0x7f022409d720 2020-07-16T20:30:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.672+0000 7f02157fa700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 0x7f01fc052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.672+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f02180693d0 con 0x7f022409d720 2020-07-16T20:30:33.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.672+0000 7f0228cc4700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 0x7f01fc052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.673+0000 7f0228cc4700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 0x7f01fc052470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0224067910 tx=0x7f0220006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.676+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f0218041b60 con 0x7f022409d720 2020-07-16T20:30:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.833+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02240b5e40 con 0x7f022409d720 2020-07-16T20:30:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.833+0000 7f02157fa700 1 -- 172.21.15.22:0/1759202252 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0218045180 con 0x7f022409d720 2020-07-16T20:30:33.836 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:33.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 msgr2=0x7f01fc052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 0x7f01fc052470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f0224067910 tx=0x7f0220006dd0).stop 2020-07-16T20:30:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f022409d720 msgr2=0x7f022409b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f022409d720 0x7f022409b0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0218002f30 tx=0x7f0218015000).stop 2020-07-16T20:30:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 shutdown_connections 2020-07-16T20:30:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f01fc04ffb0 0x7f01fc052470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0224066ba0 0x7f0224157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 --2- 172.21.15.22:0/1759202252 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f022409d720 0x7f022409b0f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 >> 172.21.15.22:0/1759202252 conn(0x7f02240b9660 msgr2=0x7f0224142c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 shutdown_connections 2020-07-16T20:30:33.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.835+0000 7f022b729700 1 -- 172.21.15.22:0/1759202252 wait complete. 2020-07-16T20:30:33.846 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-07-16T20:30:33.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-07-16T20:30:33.848 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-07-16T20:30:33.908 INFO:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:33.911 INFO:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:30:33.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.963+0000 7fd3f2575700 1 Processor -- start 2020-07-16T20:30:33.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.963+0000 7fd3f2575700 1 -- start start 2020-07-16T20:30:33.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f2575700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eac0 0x7fd3ec060020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f2575700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3ec144b80 0x7fd3ec0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f2575700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec0af950 con 0x7fd3ec09eea0 2020-07-16T20:30:33.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f2575700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec0af740 con 0x7fd3ec144b80 2020-07-16T20:30:33.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f2575700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0afbf0 con 0x7fd3ec09eac0 2020-07-16T20:30:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f0b12700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3ec144b80 0x7fd3ec0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f0b12700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd3ec144b80 0x7fd3ec0b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38800/0 (socket says 172.21.15.22:38800) 2020-07-16T20:30:33.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3f0b12700 1 -- 172.21.15.22:0/3664820961 learned_addr learned my addr 172.21.15.22:0/3664820961 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.964+0000 7fd3ebfff700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eac0 0x7fd3ec060020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f0b12700 1 -- 172.21.15.22:0/3664820961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eac0 msgr2=0x7fd3ec060020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:33.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f0b12700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eac0 0x7fd3ec060020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f0b12700 1 -- 172.21.15.22:0/3664820961 >> v1:172.21.15.116:6789/0 conn(0x7fd3ec09eea0 legacy=0x7fd3ec144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f0b12700 1 -- 172.21.15.22:0/3664820961 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec0b55a0 con 0x7fd3ec144b80 2020-07-16T20:30:33.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f0b12700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3ec144b80 0x7fd3ec0b3b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd3e40032b0 tx=0x7fd3e4009270).ready entity=mon.0 client_cookie=ff1ad5def936c745 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3eaffd700 1 -- 172.21.15.22:0/3664820961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e4009e60 con 0x7fd3ec144b80 2020-07-16T20:30:33.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3eaffd700 1 -- 172.21.15.22:0/3664820961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e400bc00 con 0x7fd3ec144b80 2020-07-16T20:30:33.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3eaffd700 1 -- 172.21.15.22:0/3664820961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e400bd70 con 0x7fd3ec144b80 2020-07-16T20:30:33.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 -- 172.21.15.22:0/3664820961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3ec144b80 msgr2=0x7fd3ec0b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3ec144b80 0x7fd3ec0b3b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd3e40032b0 tx=0x7fd3e4009270).stop 2020-07-16T20:30:33.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 -- 172.21.15.22:0/3664820961 shutdown_connections 2020-07-16T20:30:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3ec144b80 0x7fd3ec0b3b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 --2- 172.21.15.22:0/3664820961 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eac0 0x7fd3ec060020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:33.985 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 -- 172.21.15.22:0/3664820961 >> 172.21.15.22:0/3664820961 conn(0x7fd3ec0b9530 msgr2=0x7fd3ec0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 -- 172.21.15.22:0/3664820961 shutdown_connections 2020-07-16T20:30:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.965+0000 7fd3f2575700 1 -- 172.21.15.22:0/3664820961 wait complete. 2020-07-16T20:30:33.986 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.966+0000 7fd3f2575700 1 Processor -- start 2020-07-16T20:30:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f2575700 1 -- start start 2020-07-16T20:30:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f2575700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 0x7fd3ec13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:33.987 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f2575700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec155b60 con 0x7fd3ec062670 2020-07-16T20:30:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f2575700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec140cb0 con 0x7fd3ec09eac0 2020-07-16T20:30:33.988 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f2575700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec140f50 con 0x7fd3ec09eea0 2020-07-16T20:30:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f0b12700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd3ec062670 0x7fd3ec0b8600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39512/0 (socket says 172.21.15.22:39512) 2020-07-16T20:30:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.967+0000 7fd3f0b12700 1 -- 172.21.15.22:0/2351531 learned_addr learned my addr 172.21.15.22:0/2351531 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:33.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3eb7fe700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 0x7fd3ec13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:33.995 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072781506 0 0) 0x7fd3ec155b60 con 0x7fd3ec062670 2020-07-16T20:30:33.996 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c4003240 con 0x7fd3ec062670 2020-07-16T20:30:33.996 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699527259 0 0) 0x7fd3ec140cb0 con 0x7fd3ec09eac0 2020-07-16T20:30:33.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec155b60 con 0x7fd3ec09eac0 2020-07-16T20:30:33.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3eb7fe700 1 -- 172.21.15.22:0/2351531 >> v1:172.21.15.116:6789/0 conn(0x7fd3ec09eac0 legacy=0x7fd3ec13a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3eb7fe700 1 -- 172.21.15.22:0/2351531 >> v1:172.21.15.22:6789/0 conn(0x7fd3ec062670 legacy=0x7fd3ec0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:33.998 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3eb7fe700 1 -- 172.21.15.22:0/2351531 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec1411f0 con 0x7fd3ec09eea0 2020-07-16T20:30:33.998 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3eb7fe700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 0x7fd3ec13e520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd3ec062390 tx=0x7fd3e0007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:33.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e0013410 con 0x7fd3ec09eea0 2020-07-16T20:30:33.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e0013570 con 0x7fd3ec09eea0 2020-07-16T20:30:33.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec0b8d10 con 0x7fd3ec09eea0 2020-07-16T20:30:34.000 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e00138d0 con 0x7fd3ec09eea0 2020-07-16T20:30:34.000 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.968+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec15f0e0 con 0x7fd3ec09eea0 2020-07-16T20:30:34.000 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.969+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec1413b0 con 0x7fd3ec09eea0 2020-07-16T20:30:34.001 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.969+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd3e0010030 con 0x7fd3ec09eea0 2020-07-16T20:30:34.001 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.969+0000 7fd3cbfff700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 0x7fd3c4052910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.001 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.970+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd3e0067580 con 0x7fd3ec09eea0 2020-07-16T20:30:34.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.970+0000 7fd3ebfff700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 0x7fd3c4052910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.970+0000 7fd3ebfff700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 0x7fd3c4052910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd3dc00a000 tx=0x7fd3dc006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:33.973+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fd3e003fc90 con 0x7fd3ec09eea0 2020-07-16T20:30:34.172 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.171+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd3ec05f320 con 0x7fd3ec09eea0 2020-07-16T20:30:34.179 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.173+0000 7fd3cbfff700 1 -- 172.21.15.22:0/2351531 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+124405 (secure 0 0 0) 0x7fd3e00432b0 con 0x7fd3ec09eea0 2020-07-16T20:30:34.180 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 msgr2=0x7fd3c4052910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.180 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 0x7fd3c4052910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd3dc00a000 tx=0x7fd3dc006dd0).stop 2020-07-16T20:30:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 msgr2=0x7fd3ec13e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 0x7fd3ec13e520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd3ec062390 tx=0x7fd3e0007b70).stop 2020-07-16T20:30:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 shutdown_connections 2020-07-16T20:30:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3c4050450 0x7fd3c4052910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 --2- 172.21.15.22:0/2351531 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd3ec09eea0 0x7fd3ec13e520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 >> 172.21.15.22:0/2351531 conn(0x7fd3ec0b9530 msgr2=0x7fd3ec0b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 shutdown_connections 2020-07-16T20:30:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.175+0000 7fd3f2575700 1 -- 172.21.15.22:0/2351531 wait complete. 2020-07-16T20:30:34.185 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:34.187 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":23155},{"type":"v1","addr":"172.21.15.116:6801","nonce":23155}]},"active_addr":"172.21.15.116:6801/23155","active_change":"2020-07-16T20:30:11.318041+0000","active_mgr_features":4540138292837744639,"available":true,"standbys":[{"gid":4102,"name":"y","mgr_features":4540138292837744639,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2120162614}]},{"addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2482598253}]},{"addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":2249360184}]}]}} 2020-07-16T20:30:34.196 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-07-16T20:30:34.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-07-16T20:30:34.198 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:34.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 Processor -- start 2020-07-16T20:30:34.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 -- start start 2020-07-16T20:30:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 0x7f44b41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b40b2f20 0x7f44b41443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b40b57f0 con 0x7f44b41476a0 2020-07-16T20:30:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40b5550 con 0x7f44b40b2f20 2020-07-16T20:30:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.341+0000 7f44ba8f1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b414a820 con 0x7f44b40b2b40 2020-07-16T20:30:34.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b40b2f20 0x7f44b41443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b40b2f20 0x7f44b41443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38814/0 (socket says 172.21.15.22:38814) 2020-07-16T20:30:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 -- 172.21.15.22:0/1289492408 learned_addr learned my addr 172.21.15.22:0/1289492408 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b3fff700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 0x7f44b41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 -- 172.21.15.22:0/1289492408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 msgr2=0x7f44b41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 0x7f44b41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 -- 172.21.15.22:0/1289492408 >> v1:172.21.15.116:6789/0 conn(0x7f44b41476a0 legacy=0x7f44b40b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 -- 172.21.15.22:0/1289492408 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4060320 con 0x7f44b40b2f20 2020-07-16T20:30:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b3fff700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 0x7f44b41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:34.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b37fe700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b40b2f20 0x7f44b41443d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f44b4062390 tx=0x7f44a8006e90).ready entity=mon.0 client_cookie=ba44f6c0a236e30c server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b2ffd700 1 -- 172.21.15.22:0/1289492408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a80098e0 con 0x7f44b40b2f20 2020-07-16T20:30:34.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b2ffd700 1 -- 172.21.15.22:0/1289492408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a8009a40 con 0x7f44b40b2f20 2020-07-16T20:30:34.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44b2ffd700 1 -- 172.21.15.22:0/1289492408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44a8009de0 con 0x7f44b40b2f20 2020-07-16T20:30:34.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 -- 172.21.15.22:0/1289492408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b40b2f20 msgr2=0x7f44b41443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b40b2f20 0x7f44b41443d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f44b4062390 tx=0x7f44a8006e90).stop 2020-07-16T20:30:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 -- 172.21.15.22:0/1289492408 shutdown_connections 2020-07-16T20:30:34.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b40b2b40 0x7f44b41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/1289492408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b40b2f20 0x7f44b41443d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 -- 172.21.15.22:0/1289492408 >> 172.21.15.22:0/1289492408 conn(0x7f44b40b9530 msgr2=0x7f44b40b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 -- 172.21.15.22:0/1289492408 shutdown_connections 2020-07-16T20:30:34.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.342+0000 7f44ba8f1700 1 -- 172.21.15.22:0/1289492408 wait complete. 2020-07-16T20:30:34.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.344+0000 7f44ba8f1700 1 Processor -- start 2020-07-16T20:30:34.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.344+0000 7f44ba8f1700 1 -- start start 2020-07-16T20:30:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b41476a0 0x7f44b41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b4146b50 0x7f44b4147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b4062c90 con 0x7f44b40b2b40 2020-07-16T20:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b4062a80 con 0x7f44b4146b50 2020-07-16T20:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b40b8820 con 0x7f44b41476a0 2020-07-16T20:30:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b4146b50 0x7f44b4147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44b4146b50 0x7f44b4147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38820/0 (socket says 172.21.15.22:38820) 2020-07-16T20:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 -- 172.21.15.22:0/4039969314 learned_addr learned my addr 172.21.15.22:0/4039969314 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:34.360 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b37fe700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b41476a0 0x7f44b41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.361 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 -- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b41476a0 msgr2=0x7f44b41575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.361 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b41476a0 0x7f44b41575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.361 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 -- 172.21.15.22:0/4039969314 >> v1:172.21.15.116:6789/0 conn(0x7f44b40b2b40 legacy=0x7f44b4154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.362 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 -- 172.21.15.22:0/4039969314 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4157ab0 con 0x7f44b4146b50 2020-07-16T20:30:34.362 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44b8e8e700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b4146b50 0x7f44b4147000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f44ac0022d0 tx=0x7f44ac007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.362 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac0023a0 con 0x7f44b4146b50 2020-07-16T20:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00a7b0 con 0x7f44b4146b50 2020-07-16T20:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f44ac00ab10 con 0x7f44b4146b50 2020-07-16T20:30:34.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b4145460 con 0x7f44b4146b50 2020-07-16T20:30:34.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.345+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40b8cc0 con 0x7f44b4146b50 2020-07-16T20:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.346+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b4062830 con 0x7f44b4146b50 2020-07-16T20:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.346+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f44ac019030 con 0x7f44b4146b50 2020-07-16T20:30:34.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.347+0000 7f4493fff700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 0x7f448c052380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.347+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f44ac067450 con 0x7f44b4146b50 2020-07-16T20:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.347+0000 7f44b3fff700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 0x7f448c052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.347+0000 7f44b3fff700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 0x7f448c052380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f44b4145c60 tx=0x7f44a4008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.350+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f44ac03fc90 con 0x7f44b4146b50 2020-07-16T20:30:34.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.509+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44b405f320 con 0x7f44b4146b50 2020-07-16T20:30:34.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.510+0000 7f4493fff700 1 -- 172.21.15.22:0/4039969314 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f44ac024ff0 con 0x7f44b4146b50 2020-07-16T20:30:34.512 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:34.513 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:34.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 msgr2=0x7f448c052380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 0x7f448c052380 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f44b4145c60 tx=0x7f44a4008040).stop 2020-07-16T20:30:34.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b4146b50 msgr2=0x7f44b4147000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b4146b50 0x7f44b4147000 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f44ac0022d0 tx=0x7f44ac007f00).stop 2020-07-16T20:30:34.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 shutdown_connections 2020-07-16T20:30:34.517 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f448c04fec0 0x7f448c052380 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.517 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44b4146b50 0x7f44b4147000 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.517 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 --2- 172.21.15.22:0/4039969314 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f44b41476a0 0x7f44b41575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 >> 172.21.15.22:0/4039969314 conn(0x7f44b40b9530 msgr2=0x7f44b41429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 shutdown_connections 2020-07-16T20:30:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.511+0000 7f44ba8f1700 1 -- 172.21.15.22:0/4039969314 wait complete. 2020-07-16T20:30:34.524 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-07-16T20:30:34.525 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:34.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.642+0000 7f20e01f6700 1 Processor -- start 2020-07-16T20:30:34.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.642+0000 7f20e01f6700 1 -- start start 2020-07-16T20:30:34.654 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20e01f6700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 0x7f20d8144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20e01f6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d8143e60 con 0x7f20d809dc70 2020-07-16T20:30:34.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20e01f6700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d8147ed0 con 0x7f20d8144780 2020-07-16T20:30:34.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20e01f6700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8148170 con 0x7f20d809e050 2020-07-16T20:30:34.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20ddf92700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f20d809dc70 0x7f20d81475c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39532/0 (socket says 172.21.15.22:39532) 2020-07-16T20:30:34.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20ddf92700 1 -- 172.21.15.22:0/3176575978 learned_addr learned my addr 172.21.15.22:0/3176575978 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:34.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20dd791700 1 --2- 172.21.15.22:0/3176575978 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 0x7f20d8144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487127165 0 0) 0x7f20d8143e60 con 0x7f20d809dc70 2020-07-16T20:30:34.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0003240 con 0x7f20d809dc70 2020-07-16T20:30:34.658 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064398948 0 0) 0x7f20d8147ed0 con 0x7f20d8144780 2020-07-16T20:30:34.658 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.643+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20d8143e60 con 0x7f20d8144780 2020-07-16T20:30:34.658 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dd791700 1 -- 172.21.15.22:0/3176575978 >> v1:172.21.15.116:6789/0 conn(0x7f20d8144780 legacy=0x7f20d80b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dd791700 1 -- 172.21.15.22:0/3176575978 >> v1:172.21.15.22:6789/0 conn(0x7f20d809dc70 legacy=0x7f20d81475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3853146882 0 0) 0x7f20c0003240 con 0x7f20d809dc70 2020-07-16T20:30:34.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dd791700 1 -- 172.21.15.22:0/3176575978 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d809cb10 con 0x7f20d809e050 2020-07-16T20:30:34.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dd791700 1 --2- 172.21.15.22:0/3176575978 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 0x7f20d8144290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20c80010d0 tx=0x7f20d4006dd0).ready entity=mon.2 client_cookie=eae5aaf66ce351d6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20c80016d0 con 0x7f20d809e050 2020-07-16T20:30:34.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d400d5c0 con 0x7f20d809e050 2020-07-16T20:30:34.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20dcf90700 1 -- 172.21.15.22:0/3176575978 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d400d730 con 0x7f20d809e050 2020-07-16T20:30:34.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 -- 172.21.15.22:0/3176575978 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 msgr2=0x7f20d8144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 --2- 172.21.15.22:0/3176575978 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 0x7f20d8144290 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f20c80010d0 tx=0x7f20d4006dd0).stop 2020-07-16T20:30:34.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 -- 172.21.15.22:0/3176575978 shutdown_connections 2020-07-16T20:30:34.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 --2- 172.21.15.22:0/3176575978 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809e050 0x7f20d8144290 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 -- 172.21.15.22:0/3176575978 >> 172.21.15.22:0/3176575978 conn(0x7f20d80b9530 msgr2=0x7f20d80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 -- 172.21.15.22:0/3176575978 shutdown_connections 2020-07-16T20:30:34.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.644+0000 7f20e01f6700 1 -- 172.21.15.22:0/3176575978 wait complete. 2020-07-16T20:30:34.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.645+0000 7f20e01f6700 1 Processor -- start 2020-07-16T20:30:34.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 -- start start 2020-07-16T20:30:34.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809dc70 0x7f20d81304e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f20d80b89a0 0x7f20d80b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d813b420 con 0x7f20d8144780 2020-07-16T20:30:34.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d813b240 con 0x7f20d80b89a0 2020-07-16T20:30:34.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20e01f6700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d813b6c0 con 0x7f20d809dc70 2020-07-16T20:30:34.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20dd791700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f20d8144780 0x7f20d812f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39540/0 (socket says 172.21.15.22:39540) 2020-07-16T20:30:34.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20dd791700 1 -- 172.21.15.22:0/1766266940 learned_addr learned my addr 172.21.15.22:0/1766266940 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:34.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809dc70 0x7f20d81304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20de793700 1 --2- 172.21.15.22:0/1766266940 >> v2:172.21.15.116:3300/0 conn(0x7f20d80b89a0 0x7f20d80b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.646+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252630233 0 0) 0x7f20d813b420 con 0x7f20d8144780 2020-07-16T20:30:34.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b0003240 con 0x7f20d8144780 2020-07-16T20:30:34.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3721405068 0 0) 0x7f20b0003240 con 0x7f20d8144780 2020-07-16T20:30:34.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f20d813b420 con 0x7f20d8144780 2020-07-16T20:30:34.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f20d400d730 con 0x7f20d8144780 2020-07-16T20:30:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809dc70 msgr2=0x7f20d81304e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809dc70 0x7f20d81304e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 >> v2:172.21.15.116:3300/0 conn(0x7f20d80b89a0 msgr2=0x7f20d80b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> v2:172.21.15.116:3300/0 conn(0x7f20d80b89a0 0x7f20d80b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 >> v1:172.21.15.22:6789/0 conn(0x7f20d8144780 legacy=0x7f20d812f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b0003800 0x7f20b0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20b00044e0 0x7f20b0004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20b0004e10 0x7f20b000b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d813b240 con 0x7f20b00044e0 2020-07-16T20:30:34.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d813b6c0 con 0x7f20b0003800 2020-07-16T20:30:34.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0005310 con 0x7f20b0004e10 2020-07-16T20:30:34.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20d809dc70 0x7f20d81304e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:34.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20b00044e0 0x7f20b0004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20de793700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20b0004e10 0x7f20b000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b0003800 0x7f20b0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 -- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20b0004e10 msgr2=0x7f20b000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f20b0004e10 0x7f20b000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 -- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b0003800 msgr2=0x7f20b0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b0003800 0x7f20b0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d813b960 con 0x7f20b00044e0 2020-07-16T20:30:34.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d813be00 con 0x7f20b00044e0 2020-07-16T20:30:34.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f20b0003800 0x7f20b0003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:34.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.647+0000 7f20dd791700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20b00044e0 0x7f20b0004920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f20b0004470 tx=0x7f20d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.648+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d813c7e0 con 0x7f20b00044e0 2020-07-16T20:30:34.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.648+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d4010c30 con 0x7f20b00044e0 2020-07-16T20:30:34.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.648+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4010d90 con 0x7f20b00044e0 2020-07-16T20:30:34.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.648+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d401e650 con 0x7f20b00044e0 2020-07-16T20:30:34.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f20d401a040 con 0x7f20b00044e0 2020-07-16T20:30:34.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d805f320 con 0x7f20b00044e0 2020-07-16T20:30:34.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20c5ffb700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f20b0058550 0x7f20b005aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f20d4069980 con 0x7f20b00044e0 2020-07-16T20:30:34.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f20b0058550 0x7f20b005aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.649+0000 7f20ddf92700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f20b0058550 0x7f20b005aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f20c8005000 tx=0x7f20c8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.652+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f20d4042090 con 0x7f20b00044e0 2020-07-16T20:30:34.811 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.809+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20d8149ca0 con 0x7f20b00044e0 2020-07-16T20:30:34.811 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.810+0000 7f20c5ffb700 1 -- 172.21.15.22:0/1766266940 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f20d4023020 con 0x7f20b00044e0 2020-07-16T20:30:34.812 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:34.813 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:34.813 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f20b0058550 msgr2=0x7f20b005aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.813 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f20b0058550 0x7f20b005aa10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f20c8005000 tx=0x7f20c8009040).stop 2020-07-16T20:30:34.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20b00044e0 msgr2=0x7f20b0004920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 --2- 172.21.15.22:0/1766266940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f20b00044e0 0x7f20b0004920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f20b0004470 tx=0x7f20d4015000).stop 2020-07-16T20:30:34.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20de793700 1 -- 172.21.15.22:0/1766266940 reap_dead start 2020-07-16T20:30:34.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20de793700 1 -- 172.21.15.22:0/1766266940 reap_dead start 2020-07-16T20:30:34.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 shutdown_connections 2020-07-16T20:30:34.815 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 >> 172.21.15.22:0/1766266940 conn(0x7f20d80b9530 msgr2=0x7f20d8066a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.815 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 shutdown_connections 2020-07-16T20:30:34.815 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.811+0000 7f20e01f6700 1 -- 172.21.15.22:0/1766266940 wait complete. 2020-07-16T20:30:34.823 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-07-16T20:30:34.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.939+0000 7f7a70a00700 1 Processor -- start 2020-07-16T20:30:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.939+0000 7f7a70a00700 1 -- start start 2020-07-16T20:30:34.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a70a00700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7a6c05f7a0 0x7f7a6c09ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a70a00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a70a00700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6c0b8040 con 0x7f7a6c09ca90 2020-07-16T20:30:34.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a70a00700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c0b82e0 con 0x7f7a6c05fb80 2020-07-16T20:30:34.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a70a00700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c09f440 con 0x7f7a6c05f7a0 2020-07-16T20:30:34.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38844/0 (socket says 172.21.15.22:38844) 2020-07-16T20:30:34.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 -- 172.21.15.22:0/2314692916 learned_addr learned my addr 172.21.15.22:0/2314692916 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:34.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6ad9d700 1 --2- 172.21.15.22:0/2314692916 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c05f7a0 0x7f7a6c09ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 -- 172.21.15.22:0/2314692916 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c05f7a0 msgr2=0x7f7a6c09ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:34.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 --2- 172.21.15.22:0/2314692916 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c05f7a0 0x7f7a6c09ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 -- 172.21.15.22:0/2314692916 >> v1:172.21.15.116:6789/0 conn(0x7f7a6c09ca90 legacy=0x7f7a6c0b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 -- 172.21.15.22:0/2314692916 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0b8e90 con 0x7f7a6c05fb80 2020-07-16T20:30:34.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.940+0000 7f7a6a59c700 1 --2- 172.21.15.22:0/2314692916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7a5c002f30 tx=0x7f7a5c006e90).ready entity=mon.0 client_cookie=159dd0c40172fc7b server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.956 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a69d9b700 1 -- 172.21.15.22:0/2314692916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5c009850 con 0x7f7a6c05fb80 2020-07-16T20:30:34.956 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a69d9b700 1 -- 172.21.15.22:0/2314692916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c0099b0 con 0x7f7a6c05fb80 2020-07-16T20:30:34.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a69d9b700 1 -- 172.21.15.22:0/2314692916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5c009d10 con 0x7f7a6c05fb80 2020-07-16T20:30:34.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 -- 172.21.15.22:0/2314692916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a6c05fb80 msgr2=0x7f7a6c09c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 --2- 172.21.15.22:0/2314692916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7a5c002f30 tx=0x7f7a5c006e90).stop 2020-07-16T20:30:34.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 -- 172.21.15.22:0/2314692916 shutdown_connections 2020-07-16T20:30:34.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 --2- 172.21.15.22:0/2314692916 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c05f7a0 0x7f7a6c09ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 --2- 172.21.15.22:0/2314692916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a6c05fb80 0x7f7a6c09c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 -- 172.21.15.22:0/2314692916 >> 172.21.15.22:0/2314692916 conn(0x7f7a6c0b9390 msgr2=0x7f7a6c0b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 -- 172.21.15.22:0/2314692916 shutdown_connections 2020-07-16T20:30:34.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.941+0000 7f7a70a00700 1 -- 172.21.15.22:0/2314692916 wait complete. 2020-07-16T20:30:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.942+0000 7f7a70a00700 1 Processor -- start 2020-07-16T20:30:34.960 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.942+0000 7f7a70a00700 1 -- start start 2020-07-16T20:30:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a70a00700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7a6c09ca90 0x7f7a6c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a70a00700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6c064170 con 0x7f7a6c065900 2020-07-16T20:30:34.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a70a00700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a6c063ed0 con 0x7f7a6c05f7a0 2020-07-16T20:30:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a70a00700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a6c156fd0 con 0x7f7a6c09ca90 2020-07-16T20:30:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a6b59e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7a6c065900 0x7f7a6c157470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39558/0 (socket says 172.21.15.22:39558) 2020-07-16T20:30:34.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a6b59e700 1 -- 172.21.15.22:0/4291244572 learned_addr learned my addr 172.21.15.22:0/4291244572 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a6a59c700 1 --2- 172.21.15.22:0/4291244572 >> v2:172.21.15.116:3300/0 conn(0x7f7a6c09ca90 0x7f7a6c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688756856 0 0) 0x7f7a6c064170 con 0x7f7a6c065900 2020-07-16T20:30:34.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.943+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a48003240 con 0x7f7a6c065900 2020-07-16T20:30:34.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 607163424 0 0) 0x7f7a48003240 con 0x7f7a6c065900 2020-07-16T20:30:34.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7a6c064170 con 0x7f7a6c065900 2020-07-16T20:30:34.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f7a64001bb0 con 0x7f7a6c065900 2020-07-16T20:30:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a6a59c700 1 -- 172.21.15.22:0/4291244572 >> v1:172.21.15.116:6789/0 conn(0x7f7a6c05f7a0 legacy=0x7f7a6c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a6a59c700 1 -- 172.21.15.22:0/4291244572 >> v1:172.21.15.22:6789/0 conn(0x7f7a6c065900 legacy=0x7f7a6c157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a6a59c700 1 -- 172.21.15.22:0/4291244572 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c0afcb0 con 0x7f7a6c09ca90 2020-07-16T20:30:34.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a6a59c700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c09ca90 0x7f7a6c15af10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7a6000a000 tx=0x7f7a5c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5c009850 con 0x7f7a6c09ca90 2020-07-16T20:30:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c063b50 con 0x7f7a6c09ca90 2020-07-16T20:30:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c009d70 con 0x7f7a6c09ca90 2020-07-16T20:30:34.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a5c01e460 con 0x7f7a6c09ca90 2020-07-16T20:30:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.944+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6c157b80 con 0x7f7a6c09ca90 2020-07-16T20:30:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a6c0b76f0 con 0x7f7a6c09ca90 2020-07-16T20:30:34.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7a5c025030 con 0x7f7a6c09ca90 2020-07-16T20:30:34.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7a48050560 0x7f7a48052a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7a5c068e50 con 0x7f7a6c09ca90 2020-07-16T20:30:34.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f7a48057fe0 0x7f7a4805a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 --> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a4805aa50 con 0x7f7a48057fe0 2020-07-16T20:30:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.945+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a5c06b450 con 0x7f7a6c09ca90 2020-07-16T20:30:34.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.946+0000 7f7a6ad9d700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7a48050560 0x7f7a48052a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.946+0000 7f7a6b59e700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f7a48057fe0 0x7f7a4805a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.946+0000 7f7a6ad9d700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7a48050560 0x7f7a48052a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7a60002f30 tx=0x7f7a60006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.946+0000 7f7a6b59e700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f7a48057fe0 0x7f7a4805a400 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:34.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.947+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== osd.0 v2:172.21.15.22:6808/23849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f7a4805aa50 con 0x7f7a48057fe0 2020-07-16T20:30:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 --> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a6c157d70 con 0x7f7a48057fe0 2020-07-16T20:30:34.974 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a52ffd700 1 -- 172.21.15.22:0/4291244572 <== osd.0 v2:172.21.15.22:6808/23849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a6c157d70 con 0x7f7a48057fe0 2020-07-16T20:30:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f7a48057fe0 msgr2=0x7f7a4805a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f7a48057fe0 0x7f7a4805a400 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.975 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7a48050560 msgr2=0x7f7a48052a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7a48050560 0x7f7a48052a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7a60002f30 tx=0x7f7a60006dd0).stop 2020-07-16T20:30:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c09ca90 msgr2=0x7f7a6c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:34.976 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c09ca90 0x7f7a6c15af10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f7a6000a000 tx=0x7f7a5c015000).stop 2020-07-16T20:30:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a6b59e700 1 -- 172.21.15.22:0/4291244572 reap_dead start 2020-07-16T20:30:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 shutdown_connections 2020-07-16T20:30:34.977 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 --2- 172.21.15.22:0/4291244572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a6c09ca90 0x7f7a6c15af10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:34.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.965+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 >> 172.21.15.22:0/4291244572 conn(0x7f7a6c0b9390 msgr2=0x7f7a6c146c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:34.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.966+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 shutdown_connections 2020-07-16T20:30:34.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:34.966+0000 7f7a70a00700 1 -- 172.21.15.22:0/4291244572 wait complete. 2020-07-16T20:30:34.980 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:34.981 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-07-16T20:30:35.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.095+0000 7f8cd032b700 1 Processor -- start 2020-07-16T20:30:35.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.095+0000 7f8cd032b700 1 -- start start 2020-07-16T20:30:35.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc8147030 0x7f8cc80627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc809e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc8144e80 con 0x7f8cc809cce0 2020-07-16T20:30:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc8144be0 con 0x7f8cc8147030 2020-07-16T20:30:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc809e430 con 0x7f8cc8062cb0 2020-07-16T20:30:35.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc8147030 0x7f8cc80627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cce0c7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8cc809cce0 0x7f8cc8146920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39566/0 (socket says 172.21.15.22:39566) 2020-07-16T20:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc8147030 0x7f8cc80627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38862/0 (socket says 172.21.15.22:38862) 2020-07-16T20:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cce0c7700 1 -- 172.21.15.22:0/1028694600 learned_addr learned my addr 172.21.15.22:0/1028694600 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cce8c8700 1 --2- 172.21.15.22:0/1028694600 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc809e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 -- 172.21.15.22:0/1028694600 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 msgr2=0x7f8cc809e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 --2- 172.21.15.22:0/1028694600 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc809e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 -- 172.21.15.22:0/1028694600 >> v1:172.21.15.22:6789/0 conn(0x7f8cc809cce0 legacy=0x7f8cc8146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd0c5700 1 -- 172.21.15.22:0/1028694600 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279709328 0 0) 0x7f8cc8144e80 con 0x7f8cc809cce0 2020-07-16T20:30:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 -- 172.21.15.22:0/1028694600 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8144900 con 0x7f8cc8147030 2020-07-16T20:30:35.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cce8c8700 1 --2- 172.21.15.22:0/1028694600 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc809e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd8c6700 1 --2- 172.21.15.22:0/1028694600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc8147030 0x7f8cc80627c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8cbc002f30 tx=0x7f8cbc006dd0).ready entity=mon.0 client_cookie=27ecaf35a813b237 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd0c5700 1 -- 172.21.15.22:0/1028694600 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cbc0097f0 con 0x7f8cc8147030 2020-07-16T20:30:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd0c5700 1 -- 172.21.15.22:0/1028694600 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc009950 con 0x7f8cc8147030 2020-07-16T20:30:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8ccd0c5700 1 -- 172.21.15.22:0/1028694600 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cbc009cb0 con 0x7f8cc8147030 2020-07-16T20:30:35.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 -- 172.21.15.22:0/1028694600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc8147030 msgr2=0x7f8cc80627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.096+0000 7f8cd032b700 1 --2- 172.21.15.22:0/1028694600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc8147030 0x7f8cc80627c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f8cbc002f30 tx=0x7f8cbc006dd0).stop 2020-07-16T20:30:35.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 -- 172.21.15.22:0/1028694600 shutdown_connections 2020-07-16T20:30:35.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 --2- 172.21.15.22:0/1028694600 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc809e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 --2- 172.21.15.22:0/1028694600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc8147030 0x7f8cc80627c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 -- 172.21.15.22:0/1028694600 >> 172.21.15.22:0/1028694600 conn(0x7f8cc80b9530 msgr2=0x7f8cc80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 -- 172.21.15.22:0/1028694600 shutdown_connections 2020-07-16T20:30:35.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.097+0000 7f8cd032b700 1 -- 172.21.15.22:0/1028694600 wait complete. 2020-07-16T20:30:35.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.098+0000 7f8cd032b700 1 Processor -- start 2020-07-16T20:30:35.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.098+0000 7f8cd032b700 1 -- start start 2020-07-16T20:30:35.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc80670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cc80650e0 0x7f8cc80638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc805f7a0 0x7f8cc8064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc813b2d0 con 0x7f8cc805f7a0 2020-07-16T20:30:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc8065710 con 0x7f8cc8062cb0 2020-07-16T20:30:35.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80659b0 con 0x7f8cc80650e0 2020-07-16T20:30:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc805f7a0 0x7f8cc8064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8cc805f7a0 0x7f8cc8064490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38868/0 (socket says 172.21.15.22:38868) 2020-07-16T20:30:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 -- 172.21.15.22:0/3702423146 learned_addr learned my addr 172.21.15.22:0/3702423146 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8ccd8c6700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cc80650e0 0x7f8cc80638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce0c7700 1 --2- 172.21.15.22:0/3702423146 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc80670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 -- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cc80650e0 msgr2=0x7f8cc80638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8cc80650e0 0x7f8cc80638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 -- 172.21.15.22:0/3702423146 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 msgr2=0x7f8cc80670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 --2- 172.21.15.22:0/3702423146 >> v2:172.21.15.116:3300/0 conn(0x7f8cc8062cb0 0x7f8cc80670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 -- 172.21.15.22:0/3702423146 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc8065c50 con 0x7f8cc805f7a0 2020-07-16T20:30:35.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cce8c8700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc805f7a0 0x7f8cc8064490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8cc4006920 tx=0x7f8cc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc4009730 con 0x7f8cc805f7a0 2020-07-16T20:30:35.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc4009890 con 0x7f8cc805f7a0 2020-07-16T20:30:35.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc805fc10 con 0x7f8cc805f7a0 2020-07-16T20:30:35.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cc4009bf0 con 0x7f8cc805f7a0 2020-07-16T20:30:35.122 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.099+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8064bc0 con 0x7f8cc805f7a0 2020-07-16T20:30:35.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.100+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8cc8065540 con 0x7f8cc805f7a0 2020-07-16T20:30:35.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8cc4013480 con 0x7f8cc805f7a0 2020-07-16T20:30:35.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca0050070 0x7f8ca0052530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8cc4068370 con 0x7f8cc805f7a0 2020-07-16T20:30:35.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f8ca0057c60 0x7f8ca005a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 --> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ca005a6d0 con 0x7f8ca0057c60 2020-07-16T20:30:35.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cc406a9e0 con 0x7f8cc805f7a0 2020-07-16T20:30:35.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cce0c7700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca0050070 0x7f8ca0052530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8ccd8c6700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f8ca0057c60 0x7f8ca005a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8cce0c7700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca0050070 0x7f8ca0052530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8cc000d000 tx=0x7f8cc00014e0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.101+0000 7f8ccd8c6700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f8ca0057c60 0x7f8ca005a080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.102+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== osd.1 v2:172.21.15.22:6800/23850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f8ca005a6d0 con 0x7f8ca0057c60 2020-07-16T20:30:35.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.120+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 --> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8cc805f320 con 0x7f8ca0057c60 2020-07-16T20:30:35.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.120+0000 7f8cba7fc700 1 -- 172.21.15.22:0/3702423146 <== osd.1 v2:172.21.15.22:6800/23850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8cc805f320 con 0x7f8ca0057c60 2020-07-16T20:30:35.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f8ca0057c60 msgr2=0x7f8ca005a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f8ca0057c60 0x7f8ca005a080 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca0050070 msgr2=0x7f8ca0052530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca0050070 0x7f8ca0052530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8cc000d000 tx=0x7f8cc00014e0).stop 2020-07-16T20:30:35.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc805f7a0 msgr2=0x7f8cc8064490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc805f7a0 0x7f8cc8064490 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f8cc4006920 tx=0x7f8cc4008040).stop 2020-07-16T20:30:35.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cce8c8700 1 -- 172.21.15.22:0/3702423146 reap_dead start 2020-07-16T20:30:35.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 shutdown_connections 2020-07-16T20:30:35.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 --2- 172.21.15.22:0/3702423146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cc805f7a0 0x7f8cc8064490 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 >> 172.21.15.22:0/3702423146 conn(0x7f8cc80b9530 msgr2=0x7f8cc8060060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 shutdown_connections 2020-07-16T20:30:35.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.121+0000 7f8cd032b700 1 -- 172.21.15.22:0/3702423146 wait complete. 2020-07-16T20:30:35.131 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:35.132 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-07-16T20:30:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.247+0000 7f57afd2e700 1 Processor -- start 2020-07-16T20:30:35.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.247+0000 7f57afd2e700 1 -- start start 2020-07-16T20:30:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57afd2e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57a80627c0 0x7f57a8146830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57afd2e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a809e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57afd2e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a8144a00 con 0x7f57a8063060 2020-07-16T20:30:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57afd2e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a8144ca0 con 0x7f57a80627c0 2020-07-16T20:30:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57afd2e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a809e190 con 0x7f57a8146d20 2020-07-16T20:30:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57a80627c0 0x7f57a8146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57adaca700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f57a8063060 0x7f57a809cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39582/0 (socket says 172.21.15.22:39582) 2020-07-16T20:30:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57adaca700 1 -- 172.21.15.22:0/770376828 learned_addr learned my addr 172.21.15.22:0/770376828 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ae2cb700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a809e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 -- 172.21.15.22:0/770376828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 msgr2=0x7f57a809e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a809e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 -- 172.21.15.22:0/770376828 >> v1:172.21.15.22:6789/0 conn(0x7f57a8063060 legacy=0x7f57a809cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.268 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57acac8700 1 -- 172.21.15.22:0/770376828 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196303023 0 0) 0x7f57a8144a00 con 0x7f57a8063060 2020-07-16T20:30:35.268 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 -- 172.21.15.22:0/770376828 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a81453f0 con 0x7f57a80627c0 2020-07-16T20:30:35.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.248+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a80627c0 0x7f57a8146830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f57a4002f30 tx=0x7f57a4006dd0).ready entity=mon.0 client_cookie=6f315b51e6011601 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57acac8700 1 -- 172.21.15.22:0/770376828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a40099e0 con 0x7f57a80627c0 2020-07-16T20:30:35.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57acac8700 1 -- 172.21.15.22:0/770376828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4009b40 con 0x7f57a80627c0 2020-07-16T20:30:35.269 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57acac8700 1 -- 172.21.15.22:0/770376828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57a4009ea0 con 0x7f57a80627c0 2020-07-16T20:30:35.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 -- 172.21.15.22:0/770376828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a80627c0 msgr2=0x7f57a8146830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a80627c0 0x7f57a8146830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f57a4002f30 tx=0x7f57a4006dd0).stop 2020-07-16T20:30:35.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 -- 172.21.15.22:0/770376828 shutdown_connections 2020-07-16T20:30:35.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a809e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 --2- 172.21.15.22:0/770376828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a80627c0 0x7f57a8146830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 -- 172.21.15.22:0/770376828 >> 172.21.15.22:0/770376828 conn(0x7f57a80b9490 msgr2=0x7f57a80b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.272 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 -- 172.21.15.22:0/770376828 shutdown_connections 2020-07-16T20:30:35.272 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.249+0000 7f57afd2e700 1 -- 172.21.15.22:0/770376828 wait complete. 2020-07-16T20:30:35.272 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.250+0000 7f57afd2e700 1 Processor -- start 2020-07-16T20:30:35.272 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.250+0000 7f57afd2e700 1 -- start start 2020-07-16T20:30:35.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57afd2e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57a8063060 0x7f57a813b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57afd2e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a81492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57afd2e700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a8066e30 con 0x7f57a80666b0 2020-07-16T20:30:35.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57afd2e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a8066b90 con 0x7f57a8063060 2020-07-16T20:30:35.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57afd2e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a813c3b0 con 0x7f57a8146d20 2020-07-16T20:30:35.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57a8063060 0x7f57a813b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f57a8063060 0x7f57a813b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38880/0 (socket says 172.21.15.22:38880) 2020-07-16T20:30:35.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 -- 172.21.15.22:0/1667466248 learned_addr learned my addr 172.21.15.22:0/1667466248 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:35.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a81492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 -- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 msgr2=0x7f57a81492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a81492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 -- 172.21.15.22:0/1667466248 >> v1:172.21.15.116:6789/0 conn(0x7f57a80666b0 legacy=0x7f57a813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 -- 172.21.15.22:0/1667466248 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80642f0 con 0x7f57a8063060 2020-07-16T20:30:35.279 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f57a8146d20 0x7f57a81492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.251+0000 7f57adaca700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a8063060 0x7f57a813b400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f57a814a030 tx=0x7f579c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.252+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579c0072e0 con 0x7f57a8063060 2020-07-16T20:30:35.280 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.252+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c007440 con 0x7f57a8063060 2020-07-16T20:30:35.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.252+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a813b8f0 con 0x7f57a8063060 2020-07-16T20:30:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.252+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579c0057e0 con 0x7f57a8063060 2020-07-16T20:30:35.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.252+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a8149960 con 0x7f57a8063060 2020-07-16T20:30:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57a805f320 con 0x7f57a8063060 2020-07-16T20:30:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f579c01a060 con 0x7f57a8063060 2020-07-16T20:30:35.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5780050000 0x7f57800524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f579c067540 con 0x7f57a8063060 2020-07-16T20:30:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7f5780057c70 0x7f578005a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 --> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f578005a6e0 con 0x7f5780057c70 2020-07-16T20:30:35.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579c069bb0 con 0x7f57a8063060 2020-07-16T20:30:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5780050000 0x7f57800524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.253+0000 7f57ae2cb700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7f5780057c70 0x7f578005a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.254+0000 7f57ad2c9700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5780050000 0x7f57800524c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f57a4019000 tx=0x7f57a4017000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.254+0000 7f57ae2cb700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7f5780057c70 0x7f578005a090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.254+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== osd.2 v2:172.21.15.22:6816/23851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f578005a6e0 con 0x7f5780057c70 2020-07-16T20:30:35.292 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 --> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f57a814a190 con 0x7f5780057c70 2020-07-16T20:30:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f5799ffb700 1 -- 172.21.15.22:0/1667466248 <== osd.2 v2:172.21.15.22:6816/23851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57a814a190 con 0x7f5780057c70 2020-07-16T20:30:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7f5780057c70 msgr2=0x7f578005a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.293 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7f5780057c70 0x7f578005a090 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.294 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5780050000 msgr2=0x7f57800524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f5780050000 0x7f57800524c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f57a4019000 tx=0x7f57a4017000).stop 2020-07-16T20:30:35.295 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a8063060 msgr2=0x7f57a813b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a8063060 0x7f57a813b400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f57a814a030 tx=0x7f579c007aa0).stop 2020-07-16T20:30:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57ae2cb700 1 -- 172.21.15.22:0/1667466248 reap_dead start 2020-07-16T20:30:35.296 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 shutdown_connections 2020-07-16T20:30:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 --2- 172.21.15.22:0/1667466248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a8063060 0x7f57a813b400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 >> 172.21.15.22:0/1667466248 conn(0x7f57a80b9490 msgr2=0x7f57a80b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.297 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 shutdown_connections 2020-07-16T20:30:35.298 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.273+0000 7f57afd2e700 1 -- 172.21.15.22:0/1667466248 wait complete. 2020-07-16T20:30:35.298 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:35.299 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-07-16T20:30:35.418 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.417+0000 7f64b7fff700 1 Processor -- start 2020-07-16T20:30:35.419 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.417+0000 7f64b7fff700 1 -- start start 2020-07-16T20:30:35.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.417+0000 7f64b7fff700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64b805fb80 0x7f64b809c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.417+0000 7f64b7fff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f64b809ca90 0x7f64b80b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.421 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.417+0000 7f64b7fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b80b8040 con 0x7f64b805f7a0 2020-07-16T20:30:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b7fff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b80b7e30 con 0x7f64b809ca90 2020-07-16T20:30:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b7fff700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b80b82e0 con 0x7f64b805fb80 2020-07-16T20:30:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f64b805f7a0 0x7f64b809ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39598/0 (socket says 172.21.15.22:39598) 2020-07-16T20:30:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b6ffd700 1 -- 172.21.15.22:0/1953376502 learned_addr learned my addr 172.21.15.22:0/1953376502 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.422 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b67fc700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64b805fb80 0x7f64b809c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 --2- 172.21.15.22:0/1953376502 >> v2:172.21.15.116:3300/0 conn(0x7f64b809ca90 0x7f64b80b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004037518 0 0) 0x7f64b80b8040 con 0x7f64b805f7a0 2020-07-16T20:30:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64a4003240 con 0x7f64b805f7a0 2020-07-16T20:30:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1842078725 0 0) 0x7f64a4003240 con 0x7f64b805f7a0 2020-07-16T20:30:35.423 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 -- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64b805fb80 msgr2=0x7f64b809c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64b805fb80 0x7f64b809c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 -- 172.21.15.22:0/1953376502 >> v1:172.21.15.22:6789/0 conn(0x7f64b805f7a0 legacy=0x7f64b809ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 -- 172.21.15.22:0/1953376502 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80b8c70 con 0x7f64b809ca90 2020-07-16T20:30:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b77fe700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b809ca90 0x7f64b80b8780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f64b0001bf0 tx=0x7f64a8006dd0).ready entity=mon.1 client_cookie=6f99634640253ef3 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.424 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.418+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b0001a50 con 0x7f64b809ca90 2020-07-16T20:30:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a800d570 con 0x7f64b809ca90 2020-07-16T20:30:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b5ffb700 1 -- 172.21.15.22:0/1953376502 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800d6e0 con 0x7f64b809ca90 2020-07-16T20:30:35.425 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 -- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b809ca90 msgr2=0x7f64b80b8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b809ca90 0x7f64b80b8780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f64b0001bf0 tx=0x7f64a8006dd0).stop 2020-07-16T20:30:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 -- 172.21.15.22:0/1953376502 shutdown_connections 2020-07-16T20:30:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f64b809ca90 0x7f64b80b8780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.426 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 --2- 172.21.15.22:0/1953376502 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f64b805fb80 0x7f64b809c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 -- 172.21.15.22:0/1953376502 >> 172.21.15.22:0/1953376502 conn(0x7f64b80b9390 msgr2=0x7f64b80b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 -- 172.21.15.22:0/1953376502 shutdown_connections 2020-07-16T20:30:35.427 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.419+0000 7f64b7fff700 1 -- 172.21.15.22:0/1953376502 wait complete. 2020-07-16T20:30:35.430 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.420+0000 7f64b7fff700 1 Processor -- start 2020-07-16T20:30:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.420+0000 7f64b7fff700 1 -- start start 2020-07-16T20:30:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64b8140290 0x7f64b813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b7fff700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8140ba0 con 0x7f64b805fb80 2020-07-16T20:30:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b7fff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b8140730 con 0x7f64b805f7a0 2020-07-16T20:30:35.431 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b7fff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b8140e00 con 0x7f64b8140290 2020-07-16T20:30:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f64b8140290 0x7f64b813f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b67fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f64b805fb80 0x7f64b80648d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39606/0 (socket says 172.21.15.22:39606) 2020-07-16T20:30:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b67fc700 1 -- 172.21.15.22:0/3496715485 learned_addr learned my addr 172.21.15.22:0/3496715485 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.432 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b77fe700 1 -- 172.21.15.22:0/3496715485 >> v1:172.21.15.116:6789/0 conn(0x7f64b805f7a0 legacy=0x7f64b8146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b77fe700 1 -- 172.21.15.22:0/3496715485 >> v1:172.21.15.22:6789/0 conn(0x7f64b805fb80 legacy=0x7f64b80648d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b77fe700 1 -- 172.21.15.22:0/3496715485 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80ae980 con 0x7f64b8140290 2020-07-16T20:30:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073706318 0 0) 0x7f64b8140ba0 con 0x7f64b805fb80 2020-07-16T20:30:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.421+0000 7f64b77fe700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b8140290 0x7f64b813f3a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f64b0001bf0 tx=0x7f64a8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.433 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a801e460 con 0x7f64b8140290 2020-07-16T20:30:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b8064fe0 con 0x7f64b8140290 2020-07-16T20:30:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a801e5c0 con 0x7f64b8140290 2020-07-16T20:30:35.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a801e920 con 0x7f64b8140290 2020-07-16T20:30:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b81426f0 con 0x7f64b8140290 2020-07-16T20:30:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.422+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64b8140930 con 0x7f64b8140290 2020-07-16T20:30:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f64a8025030 con 0x7f64b8140290 2020-07-16T20:30:35.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f649404fd90 0x7f6494052250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f64a80692d0 con 0x7f64b8140290 2020-07-16T20:30:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7f6494057880 0x7f6494059ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 --> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f649405a2f0 con 0x7f6494057880 2020-07-16T20:30:35.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f64b6ffd700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f649404fd90 0x7f6494052250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64a806b940 con 0x7f64b8140290 2020-07-16T20:30:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f64b67fc700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7f6494057880 0x7f6494059ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.423+0000 7f64b6ffd700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f649404fd90 0x7f6494052250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f64b81408c0 tx=0x7f64b0002180).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.424+0000 7f64b67fc700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7f6494057880 0x7f6494059ca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.424+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== osd.3 v2:172.21.15.22:6819/23870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f649405a2f0 con 0x7f6494057880 2020-07-16T20:30:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.442+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 --> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f64b8057490 con 0x7f6494057880 2020-07-16T20:30:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f649effd700 1 -- 172.21.15.22:0/3496715485 <== osd.3 v2:172.21.15.22:6819/23870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64b8057490 con 0x7f6494057880 2020-07-16T20:30:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7f6494057880 msgr2=0x7f6494059ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7f6494057880 0x7f6494059ca0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f649404fd90 msgr2=0x7f6494052250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f649404fd90 0x7f6494052250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f64b81408c0 tx=0x7f64b0002180).stop 2020-07-16T20:30:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b8140290 msgr2=0x7f64b813f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b8140290 0x7f64b813f3a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f64b0001bf0 tx=0x7f64a8015000).stop 2020-07-16T20:30:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b77fe700 1 -- 172.21.15.22:0/3496715485 reap_dead start 2020-07-16T20:30:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 shutdown_connections 2020-07-16T20:30:35.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 --2- 172.21.15.22:0/3496715485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f64b8140290 0x7f64b813f3a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 >> 172.21.15.22:0/3496715485 conn(0x7f64b80b9390 msgr2=0x7f64b8066a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 shutdown_connections 2020-07-16T20:30:35.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.443+0000 7f64b7fff700 1 -- 172.21.15.22:0/3496715485 wait complete. 2020-07-16T20:30:35.454 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:35.455 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-07-16T20:30:35.579 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.569+0000 7f3563965700 1 Processor -- start 2020-07-16T20:30:35.579 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.569+0000 7f3563965700 1 -- start start 2020-07-16T20:30:35.580 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f355c147030 0x7f355c0627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.580 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355c062cb0 0x7f355c09e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.580 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c144e80 con 0x7f355c09cce0 2020-07-16T20:30:35.581 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c144be0 con 0x7f355c147030 2020-07-16T20:30:35.581 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c09e430 con 0x7f355c062cb0 2020-07-16T20:30:35.581 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f355c147030 0x7f355c0627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.582 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f355c147030 0x7f355c0627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38908/0 (socket says 172.21.15.22:38908) 2020-07-16T20:30:35.582 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 -- 172.21.15.22:0/1275581533 learned_addr learned my addr 172.21.15.22:0/1275581533 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:35.583 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3561f02700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355c062cb0 0x7f355c09e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.583 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 -- 172.21.15.22:0/1275581533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355c062cb0 msgr2=0x7f355c09e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.583 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355c062cb0 0x7f355c09e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.584 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 -- 172.21.15.22:0/1275581533 >> v1:172.21.15.116:6789/0 conn(0x7f355c09cce0 legacy=0x7f355c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.584 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 -- 172.21.15.22:0/1275581533 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c144900 con 0x7f355c147030 2020-07-16T20:30:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3560f00700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c147030 0x7f355c0627c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f354c002f30 tx=0x7f354c006e90).ready entity=mon.0 client_cookie=d46634bdb28e73d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f354bfff700 1 -- 172.21.15.22:0/1275581533 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f354c009850 con 0x7f355c147030 2020-07-16T20:30:35.588 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f354bfff700 1 -- 172.21.15.22:0/1275581533 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0099b0 con 0x7f355c147030 2020-07-16T20:30:35.589 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f354bfff700 1 -- 172.21.15.22:0/1275581533 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f354c009d10 con 0x7f355c147030 2020-07-16T20:30:35.589 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 -- 172.21.15.22:0/1275581533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c147030 msgr2=0x7f355c0627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.570+0000 7f3563965700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c147030 0x7f355c0627c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f354c002f30 tx=0x7f354c006e90).stop 2020-07-16T20:30:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 -- 172.21.15.22:0/1275581533 shutdown_connections 2020-07-16T20:30:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f355c062cb0 0x7f355c09e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 --2- 172.21.15.22:0/1275581533 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c147030 0x7f355c0627c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 -- 172.21.15.22:0/1275581533 >> 172.21.15.22:0/1275581533 conn(0x7f355c0b9530 msgr2=0x7f355c0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 -- 172.21.15.22:0/1275581533 shutdown_connections 2020-07-16T20:30:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.571+0000 7f3563965700 1 -- 172.21.15.22:0/1275581533 wait complete. 2020-07-16T20:30:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.572+0000 7f3563965700 1 Processor -- start 2020-07-16T20:30:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.572+0000 7f3563965700 1 -- start start 2020-07-16T20:30:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3563965700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f355c062cb0 0x7f355c0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3563965700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f355c0b4b50 0x7f355c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.594 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3563965700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c157eb0 con 0x7f355c141190 2020-07-16T20:30:35.594 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3563965700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c13f720 con 0x7f355c062cb0 2020-07-16T20:30:35.594 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3563965700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c0b54d0 con 0x7f355c0b4b50 2020-07-16T20:30:35.594 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f355c062cb0 0x7f355c0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.595 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3560f00700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f355c141190 0x7f355c142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39622/0 (socket says 172.21.15.22:39622) 2020-07-16T20:30:35.595 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3560f00700 1 -- 172.21.15.22:0/1786895501 learned_addr learned my addr 172.21.15.22:0/1786895501 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.595 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561f02700 1 --2- 172.21.15.22:0/1786895501 >> v2:172.21.15.116:3300/0 conn(0x7f355c0b4b50 0x7f355c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 -- 172.21.15.22:0/1786895501 >> v2:172.21.15.116:3300/0 conn(0x7f355c0b4b50 msgr2=0x7f355c0b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 --2- 172.21.15.22:0/1786895501 >> v2:172.21.15.116:3300/0 conn(0x7f355c0b4b50 0x7f355c0b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 -- 172.21.15.22:0/1786895501 >> v1:172.21.15.22:6789/0 conn(0x7f355c141190 legacy=0x7f355c142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909523172 0 0) 0x7f355c157eb0 con 0x7f355c141190 2020-07-16T20:30:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 -- 172.21.15.22:0/1786895501 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c1433a0 con 0x7f355c062cb0 2020-07-16T20:30:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561f02700 1 --2- 172.21.15.22:0/1786895501 >> v2:172.21.15.116:3300/0 conn(0x7f355c0b4b50 0x7f355c0b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.573+0000 7f3561701700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c062cb0 0x7f355c0b3e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f355c0b9240 tx=0x7f3558007b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3558007360 con 0x7f355c062cb0 2020-07-16T20:30:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35580064f0 con 0x7f355c062cb0 2020-07-16T20:30:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c157ae0 con 0x7f355c062cb0 2020-07-16T20:30:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3558006850 con 0x7f355c062cb0 2020-07-16T20:30:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c0b45b0 con 0x7f355c062cb0 2020-07-16T20:30:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.574+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f355c05f320 con 0x7f355c062cb0 2020-07-16T20:30:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f3558010030 con 0x7f355c062cb0 2020-07-16T20:30:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f353404fea0 0x7f3534052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3558067a60 con 0x7f355c062cb0 2020-07-16T20:30:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7f3534057990 0x7f3534059db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 --> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f353405a400 con 0x7f3534057990 2020-07-16T20:30:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f355806c220 con 0x7f355c062cb0 2020-07-16T20:30:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.575+0000 7f3560f00700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f353404fea0 0x7f3534052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.576+0000 7f3561f02700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7f3534057990 0x7f3534059db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.576+0000 7f3560f00700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f353404fea0 0x7f3534052360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f354c000b80 tx=0x7f354c015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.576+0000 7f3561f02700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7f3534057990 0x7f3534059db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.577+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== osd.4 v2:172.21.15.116:6802/24113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f353405a400 con 0x7f3534057990 2020-07-16T20:30:35.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.595+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 --> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f355c13f920 con 0x7f3534057990 2020-07-16T20:30:35.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.595+0000 7f35497fa700 1 -- 172.21.15.22:0/1786895501 <== osd.4 v2:172.21.15.116:6802/24113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35540098d0 con 0x7f3534057990 2020-07-16T20:30:35.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7f3534057990 msgr2=0x7f3534059db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7f3534057990 0x7f3534059db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f353404fea0 msgr2=0x7f3534052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f353404fea0 0x7f3534052360 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f354c000b80 tx=0x7f354c015000).stop 2020-07-16T20:30:35.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c062cb0 msgr2=0x7f355c0b3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c062cb0 0x7f355c0b3e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f355c0b9240 tx=0x7f3558007b30).stop 2020-07-16T20:30:35.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3561f02700 1 -- 172.21.15.22:0/1786895501 reap_dead start 2020-07-16T20:30:35.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 shutdown_connections 2020-07-16T20:30:35.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 --2- 172.21.15.22:0/1786895501 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f355c062cb0 0x7f355c0b3e80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 >> 172.21.15.22:0/1786895501 conn(0x7f355c0b9530 msgr2=0x7f355c1454b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 shutdown_connections 2020-07-16T20:30:35.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.596+0000 7f3563965700 1 -- 172.21.15.22:0/1786895501 wait complete. 2020-07-16T20:30:35.607 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:35.608 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-07-16T20:30:35.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.721+0000 7f879279f700 1 Processor -- start 2020-07-16T20:30:35.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f879279f700 1 -- start start 2020-07-16T20:30:35.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f879279f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f878c1475e0 0x7f878c0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f879279f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c141760 con 0x7f878c147200 2020-07-16T20:30:35.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f879279f700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c05fe40 con 0x7f878c0b40b0 2020-07-16T20:30:35.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f879279f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c0600b0 con 0x7f878c1475e0 2020-07-16T20:30:35.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f878bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f878c147200 0x7f878c05f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39630/0 (socket says 172.21.15.22:39630) 2020-07-16T20:30:35.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.722+0000 7f878bfff700 1 -- 172.21.15.22:0/2008427935 learned_addr learned my addr 172.21.15.22:0/2008427935 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272273473 0 0) 0x7f878c141760 con 0x7f878c147200 2020-07-16T20:30:35.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2008427935 >> v2:172.21.15.116:3300/0 conn(0x7f878c1475e0 0x7f878c0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8778003240 con 0x7f878c147200 2020-07-16T20:30:35.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3551783128 0 0) 0x7f8778003240 con 0x7f878c147200 2020-07-16T20:30:35.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 >> v2:172.21.15.116:3300/0 conn(0x7f878c1475e0 msgr2=0x7f878c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 --2- 172.21.15.22:0/2008427935 >> v2:172.21.15.116:3300/0 conn(0x7f878c1475e0 0x7f878c0b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 >> v1:172.21.15.116:6789/0 conn(0x7f878c0b40b0 legacy=0x7f878c150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c060350 con 0x7f878c147200 2020-07-16T20:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f877c0016d0 con 0x7f878c147200 2020-07-16T20:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 >> v1:172.21.15.22:6789/0 conn(0x7f878c147200 legacy=0x7f878c05f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8778003730 0x7f8778003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 0x7f8778004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8778004e50 0x7f877800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0600b0 con 0x7f87780044e0 2020-07-16T20:30:35.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778004350 con 0x7f8778004e50 2020-07-16T20:30:35.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877800bc50 con 0x7f8778003730 2020-07-16T20:30:35.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 0x7f8778004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878bfff700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8778003730 0x7f8778003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f8790d3c700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8778004e50 0x7f877800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 -- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8778003730 msgr2=0x7f8778003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8778003730 0x7f8778003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 -- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8778004e50 msgr2=0x7f877800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8778004e50 0x7f877800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 -- 172.21.15.22:0/2008427935 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778003240 con 0x7f87780044e0 2020-07-16T20:30:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f8790d3c700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8778004e50 0x7f877800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:35.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f8790d3c700 1 -- 172.21.15.22:0/2008427935 reap_dead start 2020-07-16T20:30:35.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.723+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 0x7f8778004960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f878000c000 tx=0x7f8780008040).ready entity=mon.0 client_cookie=b9f2751e5207423e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f878000ebc0 con 0x7f87780044e0 2020-07-16T20:30:35.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878000ed20 con 0x7f87780044e0 2020-07-16T20:30:35.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f878affd700 1 -- 172.21.15.22:0/2008427935 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87800125e0 con 0x7f87780044e0 2020-07-16T20:30:35.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 -- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 msgr2=0x7f8778004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 0x7f8778004960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f878000c000 tx=0x7f8780008040).stop 2020-07-16T20:30:35.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 -- 172.21.15.22:0/2008427935 shutdown_connections 2020-07-16T20:30:35.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 --2- 172.21.15.22:0/2008427935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87780044e0 0x7f8778004960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 -- 172.21.15.22:0/2008427935 >> 172.21.15.22:0/2008427935 conn(0x7f878c0bd9a0 msgr2=0x7f878c0bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 -- 172.21.15.22:0/2008427935 shutdown_connections 2020-07-16T20:30:35.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.724+0000 7f879279f700 1 -- 172.21.15.22:0/2008427935 wait complete. 2020-07-16T20:30:35.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.725+0000 7f879279f700 1 Processor -- start 2020-07-16T20:30:35.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.725+0000 7f879279f700 1 -- start start 2020-07-16T20:30:35.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f879279f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f878c15a140 0x7f878c15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f879279f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f878c09e490 0x7f878c09e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f879279f700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c15ab30 con 0x7f878c0a0110 2020-07-16T20:30:35.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f879279f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c15add0 con 0x7f878c15a140 2020-07-16T20:30:35.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f879279f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c0b6a70 con 0x7f878c09e490 2020-07-16T20:30:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f878bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f878c15a140 0x7f878c15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f878bfff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f878c15a140 0x7f878c15a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:38048/0 (socket says 172.21.15.22:38048) 2020-07-16T20:30:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f8790d3c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f878c09e490 0x7f878c09e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f878bfff700 1 -- 172.21.15.22:0/2953062811 learned_addr learned my addr 172.21.15.22:0/2953062811 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:35.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.726+0000 7f878b7fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f878c0a0110 0x7f878c0a2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:41994/0 (socket says 172.21.15.22:41994) 2020-07-16T20:30:35.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f878bfff700 1 -- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f878c09e490 msgr2=0x7f878c09e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f878bfff700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f878c09e490 0x7f878c09e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f878bfff700 1 -- 172.21.15.22:0/2953062811 >> v1:172.21.15.116:6789/0 conn(0x7f878c0a0110 legacy=0x7f878c0a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f878bfff700 1 -- 172.21.15.22:0/2953062811 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0b7470 con 0x7f878c15a140 2020-07-16T20:30:35.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088809753 0 0) 0x7f878c15ab30 con 0x7f878c0a0110 2020-07-16T20:30:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f8790d3c700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f878c09e490 0x7f878c09e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f878bfff700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f878c15a140 0x7f878c15a520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f877c001190 tx=0x7f877c0076d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f877c00fa90 con 0x7f878c15a140 2020-07-16T20:30:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c004e90 con 0x7f878c15a140 2020-07-16T20:30:35.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c0a30a0 con 0x7f878c15a140 2020-07-16T20:30:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f877c00fde0 con 0x7f878c15a140 2020-07-16T20:30:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.727+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c0b70d0 con 0x7f878c15a140 2020-07-16T20:30:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f878c0bc9a0 con 0x7f878c15a140 2020-07-16T20:30:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f877c01b030 con 0x7f878c15a140 2020-07-16T20:30:35.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f876404fea0 0x7f8764052360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f877c0677c0 con 0x7f878c15a140 2020-07-16T20:30:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f8764057990 0x7f8764059db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 --> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f876405a400 con 0x7f8764057990 2020-07-16T20:30:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f877c06c220 con 0x7f878c15a140 2020-07-16T20:30:35.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.728+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f876404fea0 0x7f8764052360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.729+0000 7f8790d3c700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f8764057990 0x7f8764059db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.729+0000 7f878b7fe700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f876404fea0 0x7f8764052360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8780000b20 tx=0x7f8780019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.729+0000 7f8790d3c700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f8764057990 0x7f8764059db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.730+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== osd.5 v2:172.21.15.116:6810/24114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f876405a400 con 0x7f8764057990 2020-07-16T20:30:35.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.748+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 --> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f878c05f320 con 0x7f8764057990 2020-07-16T20:30:35.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f876bfff700 1 -- 172.21.15.22:0/2953062811 <== osd.5 v2:172.21.15.116:6810/24114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f878c05f320 con 0x7f8764057990 2020-07-16T20:30:35.779 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f8764057990 msgr2=0x7f8764059db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f8764057990 0x7f8764059db0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f876404fea0 msgr2=0x7f8764052360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f876404fea0 0x7f8764052360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8780000b20 tx=0x7f8780019000).stop 2020-07-16T20:30:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f878c15a140 msgr2=0x7f878c15a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.780 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f878c15a140 0x7f878c15a520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f877c001190 tx=0x7f877c0076d0).stop 2020-07-16T20:30:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f8790d3c700 1 -- 172.21.15.22:0/2953062811 reap_dead start 2020-07-16T20:30:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 shutdown_connections 2020-07-16T20:30:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 --2- 172.21.15.22:0/2953062811 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f878c15a140 0x7f878c15a520 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 >> 172.21.15.22:0/2953062811 conn(0x7f878c0bd9a0 msgr2=0x7f878c0bdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.781 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 shutdown_connections 2020-07-16T20:30:35.782 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.749+0000 7f879279f700 1 -- 172.21.15.22:0/2953062811 wait complete. 2020-07-16T20:30:35.782 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:35.782 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-07-16T20:30:35.899 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 Processor -- start 2020-07-16T20:30:35.900 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 -- start start 2020-07-16T20:30:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff99009cce0 0x7ff990146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.902 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 0x7ff99009e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff990144e80 con 0x7ff990146e10 2020-07-16T20:30:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9901472c0 con 0x7ff99009cce0 2020-07-16T20:30:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.898+0000 7ff99676b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff990144be0 con 0x7ff990062ed0 2020-07-16T20:30:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff99009cce0 0x7ff990146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff990146e10 0x7ff9900627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39652/0 (socket says 172.21.15.22:39652) 2020-07-16T20:30:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98f7fe700 1 -- 172.21.15.22:0/2173694973 learned_addr learned my addr 172.21.15.22:0/2173694973 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff994d08700 1 --2- 172.21.15.22:0/2173694973 >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 0x7ff99009e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 -- 172.21.15.22:0/2173694973 >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 msgr2=0x7ff99009e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 --2- 172.21.15.22:0/2173694973 >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 0x7ff99009e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 -- 172.21.15.22:0/2173694973 >> v1:172.21.15.22:6789/0 conn(0x7ff990146e10 legacy=0x7ff9900627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 -- 172.21.15.22:0/2173694973 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99009e430 con 0x7ff99009cce0 2020-07-16T20:30:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98effd700 1 -- 172.21.15.22:0/2173694973 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19384250 0 0) 0x7ff990144e80 con 0x7ff990146e10 2020-07-16T20:30:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff994d08700 1 --2- 172.21.15.22:0/2173694973 >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 0x7ff99009e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98ffff700 1 --2- 172.21.15.22:0/2173694973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff99009cce0 0x7ff990146920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980006dd0).ready entity=mon.0 client_cookie=4362d3b48ce7db65 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98effd700 1 -- 172.21.15.22:0/2173694973 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9800097f0 con 0x7ff99009cce0 2020-07-16T20:30:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98effd700 1 -- 172.21.15.22:0/2173694973 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980009950 con 0x7ff99009cce0 2020-07-16T20:30:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff98effd700 1 -- 172.21.15.22:0/2173694973 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff980009cb0 con 0x7ff99009cce0 2020-07-16T20:30:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 -- 172.21.15.22:0/2173694973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff99009cce0 msgr2=0x7ff990146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 --2- 172.21.15.22:0/2173694973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff99009cce0 0x7ff990146920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980006dd0).stop 2020-07-16T20:30:35.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 -- 172.21.15.22:0/2173694973 shutdown_connections 2020-07-16T20:30:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 --2- 172.21.15.22:0/2173694973 >> v2:172.21.15.116:3300/0 conn(0x7ff990062ed0 0x7ff99009e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 --2- 172.21.15.22:0/2173694973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff99009cce0 0x7ff990146920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 -- 172.21.15.22:0/2173694973 >> 172.21.15.22:0/2173694973 conn(0x7ff9900b9530 msgr2=0x7ff9900b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 -- 172.21.15.22:0/2173694973 shutdown_connections 2020-07-16T20:30:35.907 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.899+0000 7ff99676b700 1 -- 172.21.15.22:0/2173694973 wait complete. 2020-07-16T20:30:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.901+0000 7ff99676b700 1 Processor -- start 2020-07-16T20:30:35.908 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.901+0000 7ff99676b700 1 -- start start 2020-07-16T20:30:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff990062ed0 0x7ff990157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9900b0650 0x7ff99013c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.911 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99013ca00 con 0x7ff990146e10 2020-07-16T20:30:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9900afc70 con 0x7ff990062ed0 2020-07-16T20:30:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900aff10 con 0x7ff9900b0650 2020-07-16T20:30:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff990062ed0 0x7ff990157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff990146e10 0x7ff990140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39660/0 (socket says 172.21.15.22:39660) 2020-07-16T20:30:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98f7fe700 1 -- 172.21.15.22:0/3970513756 learned_addr learned my addr 172.21.15.22:0/3970513756 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff994d08700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9900b0650 0x7ff99013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 -- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9900b0650 msgr2=0x7ff99013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9900b0650 0x7ff99013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 -- 172.21.15.22:0/3970513756 >> v1:172.21.15.22:6789/0 conn(0x7ff990146e10 legacy=0x7ff990140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719772140 0 0) 0x7ff99013ca00 con 0x7ff990146e10 2020-07-16T20:30:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 -- 172.21.15.22:0/3970513756 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900b01b0 con 0x7ff990062ed0 2020-07-16T20:30:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff994d08700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff9900b0650 0x7ff99013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff98ffff700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff990062ed0 0x7ff990157a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff980011e30 con 0x7ff990062ed0 2020-07-16T20:30:35.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98001e770 con 0x7ff990062ed0 2020-07-16T20:30:35.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff990140e30 con 0x7ff990062ed0 2020-07-16T20:30:35.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff98001ead0 con 0x7ff990062ed0 2020-07-16T20:30:35.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.902+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9900afa40 con 0x7ff990062ed0 2020-07-16T20:30:35.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.903+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff99005f320 con 0x7ff990062ed0 2020-07-16T20:30:35.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.903+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff98001a040 con 0x7ff990062ed0 2020-07-16T20:30:35.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff96ffff700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff96804fef0 0x7ff9680523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff98006b840 con 0x7ff990062ed0 2020-07-16T20:30:35.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff96ffff700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7ff968057a60 0x7ff968059e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:35.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 --> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff96805a4d0 con 0x7ff968057a60 2020-07-16T20:30:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff980070220 con 0x7ff990062ed0 2020-07-16T20:30:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff98f7fe700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff96804fef0 0x7ff9680523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff994d08700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7ff968057a60 0x7ff968059e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff98f7fe700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff96804fef0 0x7ff9680523b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff984007650 tx=0x7ff984007850).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.904+0000 7ff994d08700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7ff968057a60 0x7ff968059e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:35.918 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.905+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== osd.6 v2:172.21.15.116:6818/24143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7ff96805a4d0 con 0x7ff968057a60 2020-07-16T20:30:35.925 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.923+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 --> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff9900b0340 con 0x7ff968057a60 2020-07-16T20:30:35.926 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.924+0000 7ff96ffff700 1 -- 172.21.15.22:0/3970513756 <== osd.6 v2:172.21.15.116:6818/24143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff9900b0340 con 0x7ff968057a60 2020-07-16T20:30:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.924+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7ff968057a60 msgr2=0x7ff968059e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.924+0000 7ff99676b700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7ff968057a60 0x7ff968059e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff96804fef0 msgr2=0x7ff9680523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff96804fef0 0x7ff9680523b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff984007650 tx=0x7ff984007850).stop 2020-07-16T20:30:35.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff990062ed0 msgr2=0x7ff990157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:35.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff990062ed0 0x7ff990157a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7ff980002f30 tx=0x7ff980015000).stop 2020-07-16T20:30:35.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff994d08700 1 -- 172.21.15.22:0/3970513756 reap_dead start 2020-07-16T20:30:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 shutdown_connections 2020-07-16T20:30:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 --2- 172.21.15.22:0/3970513756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff990062ed0 0x7ff990157a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 >> 172.21.15.22:0/3970513756 conn(0x7ff9900b9530 msgr2=0x7ff99013d660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 shutdown_connections 2020-07-16T20:30:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:35.925+0000 7ff99676b700 1 -- 172.21.15.22:0/3970513756 wait complete. 2020-07-16T20:30:35.944 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2020-07-16T20:30:35.945 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-07-16T20:30:36.061 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.060+0000 7f720a915700 1 Processor -- start 2020-07-16T20:30:36.062 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.060+0000 7f720a915700 1 -- start start 2020-07-16T20:30:36.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f720a915700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f720409cce0 0x7f7204146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f720a915700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7204144e80 con 0x7f7204146e10 2020-07-16T20:30:36.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f720a915700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7204144be0 con 0x7f7204062ed0 2020-07-16T20:30:36.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f720a915700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72041472c0 con 0x7f720409cce0 2020-07-16T20:30:36.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f72037fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7204146e10 0x7f72040627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39668/0 (socket says 172.21.15.22:39668) 2020-07-16T20:30:36.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f72037fe700 1 -- 172.21.15.22:0/2841101281 learned_addr learned my addr 172.21.15.22:0/2841101281 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7203fff700 1 --2- 172.21.15.22:0/2841101281 >> v2:172.21.15.116:3300/0 conn(0x7f720409cce0 0x7f7204146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177808452 0 0) 0x7f7204144e80 con 0x7f7204146e10 2020-07-16T20:30:36.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71f0003240 con 0x7f7204146e10 2020-07-16T20:30:36.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 330329528 0 0) 0x7f71f0003240 con 0x7f7204146e10 2020-07-16T20:30:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 >> v2:172.21.15.116:3300/0 conn(0x7f720409cce0 msgr2=0x7f7204146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 --2- 172.21.15.22:0/2841101281 >> v2:172.21.15.116:3300/0 conn(0x7f720409cce0 0x7f7204146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 >> v1:172.21.15.116:6789/0 conn(0x7f7204062ed0 legacy=0x7f720409e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720409e430 con 0x7f7204146e10 2020-07-16T20:30:36.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f71f80016d0 con 0x7f7204146e10 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.061+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 >> v1:172.21.15.22:6789/0 conn(0x7f7204146e10 legacy=0x7f72040627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71f0003730 0x7f71f0003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f71f00044e0 0x7f71f0004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 0x7f71f000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72041472c0 con 0x7f71f0004e50 2020-07-16T20:30:36.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00042c0 con 0x7f71f0003730 2020-07-16T20:30:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f000bc20 con 0x7f71f00044e0 2020-07-16T20:30:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 0x7f71f000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7203fff700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71f0003730 0x7f71f0003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f72037fe700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f71f00044e0 0x7f71f0004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 -- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f71f00044e0 msgr2=0x7f71f0004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f71f00044e0 0x7f71f0004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 -- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71f0003730 msgr2=0x7f71f0003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f71f0003730 0x7f71f0003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 -- 172.21.15.22:0/2841101281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0003240 con 0x7f71f0004e50 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 -- 172.21.15.22:0/2841101281 reap_dead start 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7208eb2700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 0x7f71f000b730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f71f0004450 tx=0x7f71fc007e40).ready entity=mon.0 client_cookie=d25c78652059e476 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71fc00cbc0 con 0x7f71f0004e50 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00cd20 con 0x7f71f0004e50 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f7202ffd700 1 -- 172.21.15.22:0/2841101281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71fc013600 con 0x7f71f0004e50 2020-07-16T20:30:36.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 -- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 msgr2=0x7f71f000b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 0x7f71f000b730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f71f0004450 tx=0x7f71fc007e40).stop 2020-07-16T20:30:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 -- 172.21.15.22:0/2841101281 shutdown_connections 2020-07-16T20:30:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 --2- 172.21.15.22:0/2841101281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71f0004e50 0x7f71f000b730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 -- 172.21.15.22:0/2841101281 >> 172.21.15.22:0/2841101281 conn(0x7f72040b9530 msgr2=0x7f72040b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 -- 172.21.15.22:0/2841101281 shutdown_connections 2020-07-16T20:30:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.062+0000 7f720a915700 1 -- 172.21.15.22:0/2841101281 wait complete. 2020-07-16T20:30:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.064+0000 7f720a915700 1 Processor -- start 2020-07-16T20:30:36.074 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.064+0000 7f720a915700 1 -- start start 2020-07-16T20:30:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f720405f5e0 0x7f720405f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.077 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72040b8230 0x7f7204066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7204065e40 con 0x7f7204066a70 2020-07-16T20:30:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72040660e0 con 0x7f720405f5e0 2020-07-16T20:30:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72040b7e70 con 0x7f72040b8230 2020-07-16T20:30:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7208eb2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7204066a70 0x7f72040b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39684/0 (socket says 172.21.15.22:39684) 2020-07-16T20:30:36.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7208eb2700 1 -- 172.21.15.22:0/564086858 learned_addr learned my addr 172.21.15.22:0/564086858 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 --2- 172.21.15.22:0/564086858 >> v2:172.21.15.116:3300/0 conn(0x7f720405f5e0 0x7f720405f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f72037fe700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72040b8230 0x7f7204066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114793119 0 0) 0x7f7204065e40 con 0x7f7204066a70 2020-07-16T20:30:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71dc003240 con 0x7f7204066a70 2020-07-16T20:30:36.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 -- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72040b8230 msgr2=0x7f7204066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72040b8230 0x7f7204066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 -- 172.21.15.22:0/564086858 >> v1:172.21.15.22:6789/0 conn(0x7f7204066a70 legacy=0x7f72040b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 -- 172.21.15.22:0/564086858 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040b6c70 con 0x7f720405f5e0 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f72037fe700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72040b8230 0x7f7204066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f7203fff700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f720405f5e0 0x7f720405f9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f71f4008000 tx=0x7f71f4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f4014770 con 0x7f720405f5e0 2020-07-16T20:30:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f40148d0 con 0x7f720405f5e0 2020-07-16T20:30:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72040af580 con 0x7f720405f5e0 2020-07-16T20:30:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.065+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71f4014a40 con 0x7f720405f5e0 2020-07-16T20:30:36.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.066+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72040afa50 con 0x7f720405f5e0 2020-07-16T20:30:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.066+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f720405f320 con 0x7f720405f5e0 2020-07-16T20:30:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f71f4014c40 con 0x7f720405f5e0 2020-07-16T20:30:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71dc050360 0x7f71dc052820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f71f4067ea0 con 0x7f720405f5e0 2020-07-16T20:30:36.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f71dc057d50 0x7f71dc05a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 --> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71dc05a7c0 con 0x7f71dc057d50 2020-07-16T20:30:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71f4068260 con 0x7f720405f5e0 2020-07-16T20:30:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f72037fe700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71dc050360 0x7f71dc052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f7208eb2700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f71dc057d50 0x7f71dc05a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.067+0000 7f72037fe700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71dc050360 0x7f71dc052820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f71f8005000 tx=0x7f71f8009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.068+0000 7f7208eb2700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f71dc057d50 0x7f71dc05a170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.069+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== osd.7 v2:172.21.15.116:6826/24152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f71dc05a7c0 con 0x7f71dc057d50 2020-07-16T20:30:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.087+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 --> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7204067ae0 con 0x7f71dc057d50 2020-07-16T20:30:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f71e3fff700 1 -- 172.21.15.22:0/564086858 <== osd.7 v2:172.21.15.116:6826/24152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7204067ae0 con 0x7f71dc057d50 2020-07-16T20:30:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f71dc057d50 msgr2=0x7f71dc05a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f71dc057d50 0x7f71dc05a170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71dc050360 msgr2=0x7f71dc052820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71dc050360 0x7f71dc052820 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f71f8005000 tx=0x7f71f8009040).stop 2020-07-16T20:30:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f720405f5e0 msgr2=0x7f720405f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f720405f5e0 0x7f720405f9c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f71f4008000 tx=0x7f71f4008040).stop 2020-07-16T20:30:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f7208eb2700 1 -- 172.21.15.22:0/564086858 reap_dead start 2020-07-16T20:30:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 shutdown_connections 2020-07-16T20:30:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 --2- 172.21.15.22:0/564086858 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f720405f5e0 0x7f720405f9c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 >> 172.21.15.22:0/564086858 conn(0x7f72040b9530 msgr2=0x7f720413dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 shutdown_connections 2020-07-16T20:30:36.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.088+0000 7f720a915700 1 -- 172.21.15.22:0/564086858 wait complete. 2020-07-16T20:30:36.100 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:36.101 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-07-16T20:30:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.216+0000 7fa797539700 1 Processor -- start 2020-07-16T20:30:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.216+0000 7fa797539700 1 -- start start 2020-07-16T20:30:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa790147200 0x7fa79005f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 0x7fa790150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa790141760 con 0x7fa79005fc20 2020-07-16T20:30:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7900600b0 con 0x7fa790147200 2020-07-16T20:30:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790060350 con 0x7fa7901475e0 2020-07-16T20:30:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa790147200 0x7fa79005f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa794ad4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa79005fc20 0x7fa7900b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39690/0 (socket says 172.21.15.22:39690) 2020-07-16T20:30:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa794ad4700 1 -- 172.21.15.22:0/1619189751 learned_addr learned my addr 172.21.15.22:0/1619189751 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa795ad6700 1 --2- 172.21.15.22:0/1619189751 >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 0x7fa790150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 -- 172.21.15.22:0/1619189751 >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 msgr2=0x7fa790150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 --2- 172.21.15.22:0/1619189751 >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 0x7fa790150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 -- 172.21.15.22:0/1619189751 >> v1:172.21.15.22:6789/0 conn(0x7fa79005fc20 legacy=0x7fa7900b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 -- 172.21.15.22:0/1619189751 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79014a7d0 con 0x7fa790147200 2020-07-16T20:30:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa795ad6700 1 --2- 172.21.15.22:0/1619189751 >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 0x7fa790150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa7952d5700 1 --2- 172.21.15.22:0/1619189751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790147200 0x7fa79005f730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa7880032b0 tx=0x7fa7880091d0).ready entity=mon.0 client_cookie=b566f87620eafb5f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa78ffff700 1 -- 172.21.15.22:0/1619189751 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78800ba50 con 0x7fa790147200 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa78ffff700 1 -- 172.21.15.22:0/1619189751 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800bbb0 con 0x7fa790147200 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa78ffff700 1 -- 172.21.15.22:0/1619189751 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78800bd20 con 0x7fa790147200 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- 172.21.15.22:0/1619189751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790147200 msgr2=0x7fa79005f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 --2- 172.21.15.22:0/1619189751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790147200 0x7fa79005f730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa7880032b0 tx=0x7fa7880091d0).stop 2020-07-16T20:30:36.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- 172.21.15.22:0/1619189751 shutdown_connections 2020-07-16T20:30:36.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 --2- 172.21.15.22:0/1619189751 >> v2:172.21.15.116:3300/0 conn(0x7fa7901475e0 0x7fa790150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 --2- 172.21.15.22:0/1619189751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790147200 0x7fa79005f730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.217+0000 7fa797539700 1 -- 172.21.15.22:0/1619189751 >> 172.21.15.22:0/1619189751 conn(0x7fa7900bd9a0 msgr2=0x7fa7900bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.218+0000 7fa797539700 1 -- 172.21.15.22:0/1619189751 shutdown_connections 2020-07-16T20:30:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.218+0000 7fa797539700 1 -- 172.21.15.22:0/1619189751 wait complete. 2020-07-16T20:30:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.219+0000 7fa797539700 1 Processor -- start 2020-07-16T20:30:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.219+0000 7fa797539700 1 -- start start 2020-07-16T20:30:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7901475e0 0x7fa79015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa790143cb0 0x7fa790142950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa790144110 0x7fa7901561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790143570 con 0x7fa790143cb0 2020-07-16T20:30:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa790143810 con 0x7fa790144110 2020-07-16T20:30:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa797539700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79015ad40 con 0x7fa7901475e0 2020-07-16T20:30:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa790143cb0 0x7fa790142950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa790143cb0 0x7fa790142950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38990/0 (socket says 172.21.15.22:38990) 2020-07-16T20:30:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 -- 172.21.15.22:0/499149633 learned_addr learned my addr 172.21.15.22:0/499149633 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa795ad6700 1 --2- 172.21.15.22:0/499149633 >> v2:172.21.15.116:3300/0 conn(0x7fa790144110 0x7fa7901561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa7952d5700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7901475e0 0x7fa79015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 -- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7901475e0 msgr2=0x7fa79015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7901475e0 0x7fa79015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 -- 172.21.15.22:0/499149633 >> v2:172.21.15.116:3300/0 conn(0x7fa790144110 msgr2=0x7fa7901561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 --2- 172.21.15.22:0/499149633 >> v2:172.21.15.116:3300/0 conn(0x7fa790144110 0x7fa7901561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 -- 172.21.15.22:0/499149633 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79015a870 con 0x7fa790143cb0 2020-07-16T20:30:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.220+0000 7fa794ad4700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790143cb0 0x7fa790142950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa7900bea00 tx=0x7fa784007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.221+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7840072e0 con 0x7fa790143cb0 2020-07-16T20:30:36.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.221+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa784007440 con 0x7fa790143cb0 2020-07-16T20:30:36.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.221+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa790142e40 con 0x7fa790143cb0 2020-07-16T20:30:36.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.221+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7840057e0 con 0x7fa790143cb0 2020-07-16T20:30:36.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.221+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa790156870 con 0x7fa790143cb0 2020-07-16T20:30:36.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.222+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79005f320 con 0x7fa790143cb0 2020-07-16T20:30:36.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.222+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa78401a060 con 0x7fa790143cb0 2020-07-16T20:30:36.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.222+0000 7fa78d7fa700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 0x7fa768052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.222+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa7840670b0 con 0x7fa790143cb0 2020-07-16T20:30:36.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.222+0000 7fa7952d5700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 0x7fa768052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.223+0000 7fa7952d5700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 0x7fa768052490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa78801a000 tx=0x7fa788016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.226+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa78403f840 con 0x7fa790143cb0 2020-07-16T20:30:36.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.381+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa790043fd0 con 0x7fa790143cb0 2020-07-16T20:30:36.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.381+0000 7fa78d7fa700 1 -- 172.21.15.22:0/499149633 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa784018020 con 0x7fa790143cb0 2020-07-16T20:30:36.383 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:36.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 msgr2=0x7fa768052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 0x7fa768052490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa78801a000 tx=0x7fa788016000).stop 2020-07-16T20:30:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790143cb0 msgr2=0x7fa790142950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790143cb0 0x7fa790142950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fa7900bea00 tx=0x7fa784007be0).stop 2020-07-16T20:30:36.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 shutdown_connections 2020-07-16T20:30:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa76804ffd0 0x7fa768052490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> v2:172.21.15.116:3300/0 conn(0x7fa790144110 0x7fa7901561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa7901475e0 0x7fa79015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 --2- 172.21.15.22:0/499149633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa790143cb0 0x7fa790142950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 >> 172.21.15.22:0/499149633 conn(0x7fa7900bd9a0 msgr2=0x7fa7900b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 shutdown_connections 2020-07-16T20:30:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.383+0000 7fa797539700 1 -- 172.21.15.22:0/499149633 wait complete. 2020-07-16T20:30:36.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2020-07-16T20:30:36.395 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-07-16T20:30:36.525 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.509+0000 7fa22624e700 1 Processor -- start 2020-07-16T20:30:36.525 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.509+0000 7fa22624e700 1 -- start start 2020-07-16T20:30:36.525 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa220063130 0x7fa220142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 0x7fa220147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2200b5370 con 0x7fa220063510 2020-07-16T20:30:36.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa220143560 con 0x7fa220063130 2020-07-16T20:30:36.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2200b5610 con 0x7fa220143040 2020-07-16T20:30:36.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa220063130 0x7fa220142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa220063510 0x7fa220146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39706/0 (socket says 172.21.15.22:39706) 2020-07-16T20:30:36.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21effd700 1 -- 172.21.15.22:0/512102257 learned_addr learned my addr 172.21.15.22:0/512102257 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21ffff700 1 --2- 172.21.15.22:0/512102257 >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 0x7fa220147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 -- 172.21.15.22:0/512102257 >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 msgr2=0x7fa220147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 --2- 172.21.15.22:0/512102257 >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 0x7fa220147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 -- 172.21.15.22:0/512102257 >> v1:172.21.15.22:6789/0 conn(0x7fa220063510 legacy=0x7fa220146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21e7fc700 1 -- 172.21.15.22:0/512102257 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416103149 0 0) 0x7fa2200b5370 con 0x7fa220063510 2020-07-16T20:30:36.530 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 -- 172.21.15.22:0/512102257 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2200b58b0 con 0x7fa220063130 2020-07-16T20:30:36.530 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21ffff700 1 --2- 172.21.15.22:0/512102257 >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 0x7fa220147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:36.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21f7fe700 1 --2- 172.21.15.22:0/512102257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa220063130 0x7fa220142b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa22009d8d0 tx=0x7fa210006dd0).ready entity=mon.0 client_cookie=5dfc5a4ecd29eed7 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21e7fc700 1 -- 172.21.15.22:0/512102257 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2100097b0 con 0x7fa220063130 2020-07-16T20:30:36.532 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21e7fc700 1 -- 172.21.15.22:0/512102257 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210009910 con 0x7fa220063130 2020-07-16T20:30:36.532 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa21e7fc700 1 -- 172.21.15.22:0/512102257 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210009c70 con 0x7fa220063130 2020-07-16T20:30:36.533 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- 172.21.15.22:0/512102257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa220063130 msgr2=0x7fa220142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.533 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 --2- 172.21.15.22:0/512102257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa220063130 0x7fa220142b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa22009d8d0 tx=0x7fa210006dd0).stop 2020-07-16T20:30:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- 172.21.15.22:0/512102257 shutdown_connections 2020-07-16T20:30:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 --2- 172.21.15.22:0/512102257 >> v2:172.21.15.116:3300/0 conn(0x7fa220143040 0x7fa220147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 --2- 172.21.15.22:0/512102257 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa220063130 0x7fa220142b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- 172.21.15.22:0/512102257 >> 172.21.15.22:0/512102257 conn(0x7fa2200b9530 msgr2=0x7fa2200b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.510+0000 7fa22624e700 1 -- 172.21.15.22:0/512102257 shutdown_connections 2020-07-16T20:30:36.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.511+0000 7fa22624e700 1 -- 172.21.15.22:0/512102257 wait complete. 2020-07-16T20:30:36.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.512+0000 7fa22624e700 1 Processor -- start 2020-07-16T20:30:36.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.512+0000 7fa22624e700 1 -- start start 2020-07-16T20:30:36.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa22624e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa220143040 0x7fa22013a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa22624e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2200af880 0x7fa22013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa22624e700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2201458c0 con 0x7fa220063510 2020-07-16T20:30:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa22624e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa220145690 con 0x7fa2200af880 2020-07-16T20:30:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa22624e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa220142310 con 0x7fa220143040 2020-07-16T20:30:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2200af880 0x7fa22013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2200af880 0x7fa22013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39006/0 (socket says 172.21.15.22:39006) 2020-07-16T20:30:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 -- 172.21.15.22:0/2928430639 learned_addr learned my addr 172.21.15.22:0/2928430639 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:36.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21effd700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa220143040 0x7fa22013a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 -- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa220143040 msgr2=0x7fa22013a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa220143040 0x7fa22013a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 -- 172.21.15.22:0/2928430639 >> v1:172.21.15.116:6789/0 conn(0x7fa220063510 legacy=0x7fa2200af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 -- 172.21.15.22:0/2928430639 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa220142480 con 0x7fa2200af880 2020-07-16T20:30:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa21ffff700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2200af880 0x7fa22013a820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa218007000 tx=0x7fa218008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.513+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa218015070 con 0x7fa2200af880 2020-07-16T20:30:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.514+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218007820 con 0x7fa2200af880 2020-07-16T20:30:36.542 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.514+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22013ad10 con 0x7fa2200af880 2020-07-16T20:30:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.514+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa218007b80 con 0x7fa2200af880 2020-07-16T20:30:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.514+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22009c1f0 con 0x7fa2200af880 2020-07-16T20:30:36.543 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.514+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa220145a50 con 0x7fa2200af880 2020-07-16T20:30:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.515+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa21801a410 con 0x7fa2200af880 2020-07-16T20:30:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.515+0000 7fa1ff7fe700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 0x7fa1f8052500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.515+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa218067ed0 con 0x7fa2200af880 2020-07-16T20:30:36.544 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.515+0000 7fa21f7fe700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 0x7fa1f8052500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.515+0000 7fa21f7fe700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 0x7fa1f8052500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa220146490 tx=0x7fa210015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.545 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.518+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa218040600 con 0x7fa2200af880 2020-07-16T20:30:36.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.676+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa22005f320 con 0x7fa2200af880 2020-07-16T20:30:36.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.676+0000 7fa1ff7fe700 1 -- 172.21.15.22:0/2928430639 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa218043c20 con 0x7fa2200af880 2020-07-16T20:30:36.679 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:36.684 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 msgr2=0x7fa1f8052500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 0x7fa1f8052500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fa220146490 tx=0x7fa210015000).stop 2020-07-16T20:30:36.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2200af880 msgr2=0x7fa22013a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2200af880 0x7fa22013a820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa218007000 tx=0x7fa218008040).stop 2020-07-16T20:30:36.692 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 shutdown_connections 2020-07-16T20:30:36.692 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa1f8050040 0x7fa1f8052500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.693 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2200af880 0x7fa22013a820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.693 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 --2- 172.21.15.22:0/2928430639 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa220143040 0x7fa22013a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 >> 172.21.15.22:0/2928430639 conn(0x7fa2200b9530 msgr2=0x7fa22005f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 shutdown_connections 2020-07-16T20:30:36.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.678+0000 7fa22624e700 1 -- 172.21.15.22:0/2928430639 wait complete. 2020-07-16T20:30:36.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2020-07-16T20:30:36.700 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-07-16T20:30:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.820+0000 7fb7bb9e3700 1 Processor -- start 2020-07-16T20:30:36.822 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.820+0000 7fb7bb9e3700 1 -- start start 2020-07-16T20:30:36.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7bb9e3700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb7b4142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7bb9e3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40b5370 con 0x7fb7b4063510 2020-07-16T20:30:36.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7bb9e3700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b40b5610 con 0x7fb7b4143040 2020-07-16T20:30:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7bb9e3700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4147ac0 con 0x7fb7b4063130 2020-07-16T20:30:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7b8f7e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb7b4063510 0x7fb7b4146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39718/0 (socket says 172.21.15.22:39718) 2020-07-16T20:30:36.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7b8f7e700 1 -- 172.21.15.22:0/2511600033 learned_addr learned my addr 172.21.15.22:0/2511600033 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7b977f700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb7b4142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684767946 0 0) 0x7fb7b40b5370 con 0x7fb7b4063510 2020-07-16T20:30:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb79c003240 con 0x7fb7b4063510 2020-07-16T20:30:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 954467250 0 0) 0x7fb79c003240 con 0x7fb7b4063510 2020-07-16T20:30:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 msgr2=0x7fb7b4142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb7b4142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 >> v1:172.21.15.116:6789/0 conn(0x7fb7b4143040 legacy=0x7fb7b4147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40b58b0 con 0x7fb7b4063510 2020-07-16T20:30:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.821+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fb7b0001a50 con 0x7fb7b4063510 2020-07-16T20:30:36.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 >> v1:172.21.15.22:6789/0 conn(0x7fb7b4063510 legacy=0x7fb7b4146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c003760 0x7fb79c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb79c0040a0 0x7fb79c004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb79c004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b4147ac0 con 0x7fb79c003760 2020-07-16T20:30:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c005120 con 0x7fb79c0040a0 2020-07-16T20:30:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c0052e0 con 0x7fb7b4063130 2020-07-16T20:30:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c003760 0x7fb79c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b8f7e700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb79c0040a0 0x7fb79c004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b9f80700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb79c004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 -- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 msgr2=0x7fb79c004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7b4063130 0x7fb79c004be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 -- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb79c0040a0 msgr2=0x7fb79c004580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:36.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb79c0040a0 0x7fb79c004580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 -- 172.21.15.22:0/2511600033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c003240 con 0x7fb79c003760 2020-07-16T20:30:36.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b977f700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c003760 0x7fb79c003b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb7a400c000 tx=0x7fb7a4008040).ready entity=mon.0 client_cookie=8b3870ce200c5fe5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a400ea90 con 0x7fb79c003760 2020-07-16T20:30:36.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a400ebf0 con 0x7fb79c003760 2020-07-16T20:30:36.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7a3fff700 1 -- 172.21.15.22:0/2511600033 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a401a470 con 0x7fb79c003760 2020-07-16T20:30:36.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/2511600033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c003760 msgr2=0x7fb79c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 --2- 172.21.15.22:0/2511600033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb79c003760 0x7fb79c003b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb7a400c000 tx=0x7fb7a4008040).stop 2020-07-16T20:30:36.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7b9f80700 1 -- 172.21.15.22:0/2511600033 reap_dead start 2020-07-16T20:30:36.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/2511600033 shutdown_connections 2020-07-16T20:30:36.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/2511600033 >> 172.21.15.22:0/2511600033 conn(0x7fb7b40b9530 msgr2=0x7fb7b40b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/2511600033 shutdown_connections 2020-07-16T20:30:36.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.822+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/2511600033 wait complete. 2020-07-16T20:30:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.824+0000 7fb7bb9e3700 1 Processor -- start 2020-07-16T20:30:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.824+0000 7fb7bb9e3700 1 -- start start 2020-07-16T20:30:36.857 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7bb9e3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7b41417f0 0x7fb7b4144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7bb9e3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b4141e60 con 0x7fb7b4146d20 2020-07-16T20:30:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7bb9e3700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7b4144420 con 0x7fb7b413f230 2020-07-16T20:30:36.858 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7bb9e3700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7b41465e0 con 0x7fb7b41417f0 2020-07-16T20:30:36.859 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b977f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb7b4146d20 0x7fb7b4145ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39730/0 (socket says 172.21.15.22:39730) 2020-07-16T20:30:36.859 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b977f700 1 -- 172.21.15.22:0/3310232770 learned_addr learned my addr 172.21.15.22:0/3310232770 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:36.859 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b9f80700 1 --2- 172.21.15.22:0/3310232770 >> v2:172.21.15.22:3300/0 conn(0x7fb7b41417f0 0x7fb7b4144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143355776 0 0) 0x7fb7b4141e60 con 0x7fb7b4146d20 2020-07-16T20:30:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003240 con 0x7fb7b4146d20 2020-07-16T20:30:36.860 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312283774 0 0) 0x7fb7b4144420 con 0x7fb7b413f230 2020-07-16T20:30:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b4141e60 con 0x7fb7b413f230 2020-07-16T20:30:36.861 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b9f80700 1 -- 172.21.15.22:0/3310232770 >> v1:172.21.15.116:6789/0 conn(0x7fb7b413f230 legacy=0x7fb7b40b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.870 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b9f80700 1 -- 172.21.15.22:0/3310232770 >> v1:172.21.15.22:6789/0 conn(0x7fb7b4146d20 legacy=0x7fb7b4145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b9f80700 1 -- 172.21.15.22:0/3310232770 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b41446c0 con 0x7fb7b41417f0 2020-07-16T20:30:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7b9f80700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7b41417f0 0x7fb7b4144b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb7ac000e50 tx=0x7fb7ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac001670 con 0x7fb7b41417f0 2020-07-16T20:30:36.872 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0017d0 con 0x7fb7b41417f0 2020-07-16T20:30:36.872 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.825+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b40b3090 con 0x7fb7b41417f0 2020-07-16T20:30:36.872 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.826+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7ac001b30 con 0x7fb7b41417f0 2020-07-16T20:30:36.873 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.826+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7b41472c0 con 0x7fb7b41417f0 2020-07-16T20:30:36.873 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.826+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7b4141c80 con 0x7fb7b41417f0 2020-07-16T20:30:36.874 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.827+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb7ac01a020 con 0x7fb7b41417f0 2020-07-16T20:30:36.874 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.827+0000 7fb7a17fa700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 0x7fb78c0529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:36.874 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.827+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb7ac0673c0 con 0x7fb7b41417f0 2020-07-16T20:30:36.875 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.827+0000 7fb7b977f700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 0x7fb78c0529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:36.875 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.827+0000 7fb7b977f700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 0x7fb78c0529b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb7a4003070 tx=0x7fb7a401a000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:36.875 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.830+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb7ac03fb50 con 0x7fb7b41417f0 2020-07-16T20:30:36.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.985+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7b405f320 con 0x7fb7b41417f0 2020-07-16T20:30:36.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.985+0000 7fb7a17fa700 1 -- 172.21.15.22:0/3310232770 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb7ac043170 con 0x7fb7b41417f0 2020-07-16T20:30:36.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 msgr2=0x7fb78c0529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 0x7fb78c0529b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb7a4003070 tx=0x7fb7a401a000).stop 2020-07-16T20:30:36.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7b41417f0 msgr2=0x7fb7b4144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:36.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7b41417f0 0x7fb7b4144b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb7ac000e50 tx=0x7fb7ac009040).stop 2020-07-16T20:30:36.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 shutdown_connections 2020-07-16T20:30:36.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb78c0504f0 0x7fb78c0529b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 --2- 172.21.15.22:0/3310232770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7b41417f0 0x7fb7b4144b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:36.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 >> 172.21.15.22:0/3310232770 conn(0x7fb7b40b9530 msgr2=0x7fb7b40b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:36.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 shutdown_connections 2020-07-16T20:30:36.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:36.987+0000 7fb7bb9e3700 1 -- 172.21.15.22:0/3310232770 wait complete. 2020-07-16T20:30:36.992 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:36.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2020-07-16T20:30:36.999 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-07-16T20:30:37.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.113+0000 7f1a83425700 1 Processor -- start 2020-07-16T20:30:37.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.113+0000 7f1a83425700 1 -- start start 2020-07-16T20:30:37.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a83425700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 0x7f1a7c142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:37.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a83425700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c143040 0x7f1a7c147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:37.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a83425700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c0b5610 con 0x7f1a7c063510 2020-07-16T20:30:37.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a83425700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b5400 con 0x7f1a7c143040 2020-07-16T20:30:37.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a83425700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b58b0 con 0x7f1a7c063130 2020-07-16T20:30:37.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c143040 0x7f1a7c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:37.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c143040 0x7f1a7c147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39032/0 (socket says 172.21.15.22:39032) 2020-07-16T20:30:37.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 -- 172.21.15.22:0/3187425142 learned_addr learned my addr 172.21.15.22:0/3187425142 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:37.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a811c1700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 0x7f1a7c142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:37.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 -- 172.21.15.22:0/3187425142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 msgr2=0x7f1a7c142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:37.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 0x7f1a7c142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 -- 172.21.15.22:0/3187425142 >> v1:172.21.15.116:6789/0 conn(0x7f1a7c063510 legacy=0x7f1a7c146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a819c2700 1 -- 172.21.15.22:0/3187425142 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0b5d50 con 0x7f1a7c143040 2020-07-16T20:30:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.114+0000 7f1a811c1700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 0x7f1a7c142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a819c2700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c143040 0x7f1a7c147320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1a7c0b9150 tx=0x7f1a74009270).ready entity=mon.0 client_cookie=73207d22676e91cf server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:37.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a6bfff700 1 -- 172.21.15.22:0/3187425142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a7400bbc0 con 0x7f1a7c143040 2020-07-16T20:30:37.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a6bfff700 1 -- 172.21.15.22:0/3187425142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400bd20 con 0x7f1a7c143040 2020-07-16T20:30:37.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a6bfff700 1 -- 172.21.15.22:0/3187425142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a74011400 con 0x7f1a7c143040 2020-07-16T20:30:37.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 -- 172.21.15.22:0/3187425142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c143040 msgr2=0x7f1a7c147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:37.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c143040 0x7f1a7c147320 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f1a7c0b9150 tx=0x7f1a74009270).stop 2020-07-16T20:30:37.129 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 -- 172.21.15.22:0/3187425142 shutdown_connections 2020-07-16T20:30:37.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c143040 0x7f1a7c147320 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 --2- 172.21.15.22:0/3187425142 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1a7c063130 0x7f1a7c142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 -- 172.21.15.22:0/3187425142 >> 172.21.15.22:0/3187425142 conn(0x7f1a7c0b9530 msgr2=0x7f1a7c0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:37.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 -- 172.21.15.22:0/3187425142 shutdown_connections 2020-07-16T20:30:37.130 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.115+0000 7f1a83425700 1 -- 172.21.15.22:0/3187425142 wait complete. 2020-07-16T20:30:37.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.116+0000 7f1a83425700 1 Processor -- start 2020-07-16T20:30:37.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.116+0000 7f1a83425700 1 -- start start 2020-07-16T20:30:37.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a83425700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1a7c063510 0x7f1a7c066b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:37.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a83425700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:37.131 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a83425700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c067000 con 0x7f1a7c063130 2020-07-16T20:30:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a83425700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c067290 con 0x7f1a7c0aea70 2020-07-16T20:30:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a83425700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c067530 con 0x7f1a7c063510 2020-07-16T20:30:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a819c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a819c2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39040/0 (socket says 172.21.15.22:39040) 2020-07-16T20:30:37.132 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a819c2700 1 -- 172.21.15.22:0/2323149950 learned_addr learned my addr 172.21.15.22:0/2323149950 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.117+0000 7f1a809c0700 1 --2- 172.21.15.22:0/2323149950 >> v2:172.21.15.116:3300/0 conn(0x7f1a7c063510 0x7f1a7c066b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a819c2700 1 -- 172.21.15.22:0/2323149950 >> v2:172.21.15.116:3300/0 conn(0x7f1a7c063510 msgr2=0x7f1a7c066b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a819c2700 1 --2- 172.21.15.22:0/2323149950 >> v2:172.21.15.116:3300/0 conn(0x7f1a7c063510 0x7f1a7c066b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.133 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a819c2700 1 -- 172.21.15.22:0/2323149950 >> v1:172.21.15.116:6789/0 conn(0x7f1a7c063130 legacy=0x7f1a7c09e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a819c2700 1 -- 172.21.15.22:0/2323149950 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0affb0 con 0x7f1a7c0aea70 2020-07-16T20:30:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a819c2700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1a7c0b9150 tx=0x7f1a74016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a74010910 con 0x7f1a7c0aea70 2020-07-16T20:30:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74010a70 con 0x7f1a7c0aea70 2020-07-16T20:30:37.134 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c13aab0 con 0x7f1a7c0aea70 2020-07-16T20:30:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a74010dd0 con 0x7f1a7c0aea70 2020-07-16T20:30:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.118+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c14edb0 con 0x7f1a7c0aea70 2020-07-16T20:30:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.119+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c0b0140 con 0x7f1a7c0aea70 2020-07-16T20:30:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.119+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f1a74027020 con 0x7f1a7c0aea70 2020-07-16T20:30:37.135 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.119+0000 7f1a697fa700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 0x7f1a54052470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.119+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1a74069460 con 0x7f1a7c0aea70 2020-07-16T20:30:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.119+0000 7f1a811c1700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 0x7f1a54052470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.120+0000 7f1a811c1700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 0x7f1a54052470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1a7c064b60 tx=0x7f1a6c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:37.136 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.123+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f1a74045620 con 0x7f1a7c0aea70 2020-07-16T20:30:37.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.283+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a7c05f320 con 0x7f1a7c0aea70 2020-07-16T20:30:37.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.283+0000 7f1a697fa700 1 -- 172.21.15.22:0/2323149950 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a74045210 con 0x7f1a7c0aea70 2020-07-16T20:30:37.285 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2020-07-16T20:30:37.286 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.284+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 msgr2=0x7f1a54052470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.284+0000 7f1a83425700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 0x7f1a54052470 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f1a7c064b60 tx=0x7f1a6c008040).stop 2020-07-16T20:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.284+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c0aea70 msgr2=0x7f1a7c13a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.284+0000 7f1a83425700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f1a7c0b9150 tx=0x7f1a74016000).stop 2020-07-16T20:30:37.287 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 shutdown_connections 2020-07-16T20:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a5404ffb0 0x7f1a54052470 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 --2- 172.21.15.22:0/2323149950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a7c0aea70 0x7f1a7c13a5c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 --2- 172.21.15.22:0/2323149950 >> v2:172.21.15.116:3300/0 conn(0x7f1a7c063510 0x7f1a7c066b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 >> 172.21.15.22:0/2323149950 conn(0x7f1a7c0b9530 msgr2=0x7f1a7c146f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 shutdown_connections 2020-07-16T20:30:37.289 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:37.285+0000 7f1a83425700 1 -- 172.21.15.22:0/2323149950 wait complete. 2020-07-16T20:30:37.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2020-07-16T20:30:38.297 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-07-16T20:30:38.427 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.425+0000 7fe8f71c8700 1 Processor -- start 2020-07-16T20:30:38.427 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 -- start start 2020-07-16T20:30:38.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe8f009cce0 0x7fe8f0146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.434 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f009e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f0144e80 con 0x7fe8f0146e10 2020-07-16T20:30:38.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f01472c0 con 0x7fe8f009cce0 2020-07-16T20:30:38.435 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f71c8700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0144be0 con 0x7fe8f0062ed0 2020-07-16T20:30:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8f4f64700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe8f009cce0 0x7fe8f0146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8effff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe8f0146e10 0x7fe8f00627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39752/0 (socket says 172.21.15.22:39752) 2020-07-16T20:30:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.426+0000 7fe8effff700 1 -- 172.21.15.22:0/4159254773 learned_addr learned my addr 172.21.15.22:0/4159254773 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:38.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f5765700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f009e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f4f64700 1 -- 172.21.15.22:0/4159254773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 msgr2=0x7fe8f009e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:38.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f4f64700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f009e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f4f64700 1 -- 172.21.15.22:0/4159254773 >> v1:172.21.15.22:6789/0 conn(0x7fe8f0146e10 legacy=0x7fe8f00627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f4f64700 1 -- 172.21.15.22:0/4159254773 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f009e430 con 0x7fe8f009cce0 2020-07-16T20:30:38.438 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8ef7fe700 1 -- 172.21.15.22:0/4159254773 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079221124 0 0) 0x7fe8f0144e80 con 0x7fe8f0146e10 2020-07-16T20:30:38.438 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f4f64700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8f009cce0 0x7fe8f0146920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe8e4002f30 tx=0x7fe8e4006dd0).ready entity=mon.0 client_cookie=ac06c980b315be4a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.438 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8ef7fe700 1 -- 172.21.15.22:0/4159254773 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e40097f0 con 0x7fe8f009cce0 2020-07-16T20:30:38.438 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8ef7fe700 1 -- 172.21.15.22:0/4159254773 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e4009950 con 0x7fe8f009cce0 2020-07-16T20:30:38.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8ef7fe700 1 -- 172.21.15.22:0/4159254773 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e4009cb0 con 0x7fe8f009cce0 2020-07-16T20:30:38.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 -- 172.21.15.22:0/4159254773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8f009cce0 msgr2=0x7fe8f0146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8f009cce0 0x7fe8f0146920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fe8e4002f30 tx=0x7fe8e4006dd0).stop 2020-07-16T20:30:38.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 -- 172.21.15.22:0/4159254773 shutdown_connections 2020-07-16T20:30:38.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f009e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/4159254773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe8f009cce0 0x7fe8f0146920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 -- 172.21.15.22:0/4159254773 >> 172.21.15.22:0/4159254773 conn(0x7fe8f00b9530 msgr2=0x7fe8f00b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:38.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 -- 172.21.15.22:0/4159254773 shutdown_connections 2020-07-16T20:30:38.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.427+0000 7fe8f71c8700 1 -- 172.21.15.22:0/4159254773 wait complete. 2020-07-16T20:30:38.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.429+0000 7fe8f71c8700 1 Processor -- start 2020-07-16T20:30:38.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.429+0000 7fe8f71c8700 1 -- start start 2020-07-16T20:30:38.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f71c8700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f005f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f71c8700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fe8f005fad0 0x7fe8f0063e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f71c8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00b6da0 con 0x7fe8f0146e10 2020-07-16T20:30:38.443 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f71c8700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f00b6b00 con 0x7fe8f005fad0 2020-07-16T20:30:38.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f71c8700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00639b0 con 0x7fe8f0062ed0 2020-07-16T20:30:38.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8effff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe8f0146e10 0x7fe8f00b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39758/0 (socket says 172.21.15.22:39758) 2020-07-16T20:30:38.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8effff700 1 -- 172.21.15.22:0/3242302931 learned_addr learned my addr 172.21.15.22:0/3242302931 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:38.444 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f005f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f5765700 1 --2- 172.21.15.22:0/3242302931 >> v2:172.21.15.116:3300/0 conn(0x7fe8f005fad0 0x7fe8f0063e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589630833 0 0) 0x7fe8f00b6da0 con 0x7fe8f0146e10 2020-07-16T20:30:38.445 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c8003240 con 0x7fe8f0146e10 2020-07-16T20:30:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 -- 172.21.15.22:0/3242302931 >> v2:172.21.15.116:3300/0 conn(0x7fe8f005fad0 msgr2=0x7fe8f0063e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 --2- 172.21.15.22:0/3242302931 >> v2:172.21.15.116:3300/0 conn(0x7fe8f005fad0 0x7fe8f0063e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 -- 172.21.15.22:0/3242302931 >> v1:172.21.15.22:6789/0 conn(0x7fe8f0146e10 legacy=0x7fe8f00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.446 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 -- 172.21.15.22:0/3242302931 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00b58c0 con 0x7fe8f0062ed0 2020-07-16T20:30:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.430+0000 7fe8f4f64700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f005f5e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe8e4002f30 tx=0x7fe8e4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e40097f0 con 0x7fe8f0062ed0 2020-07-16T20:30:38.447 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f00b6780 con 0x7fe8f0062ed0 2020-07-16T20:30:38.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e401e460 con 0x7fe8f0062ed0 2020-07-16T20:30:38.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e401e7c0 con 0x7fe8f0062ed0 2020-07-16T20:30:38.448 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f0064340 con 0x7fe8f0062ed0 2020-07-16T20:30:38.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.431+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f00b6910 con 0x7fe8f0062ed0 2020-07-16T20:30:38.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.432+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fe8e4025030 con 0x7fe8f0062ed0 2020-07-16T20:30:38.449 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.432+0000 7fe8ecff9700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 0x7fe8c80527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.432+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe8e4069430 con 0x7fe8f0062ed0 2020-07-16T20:30:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.432+0000 7fe8effff700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 0x7fe8c80527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.450 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.433+0000 7fe8effff700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 0x7fe8c80527a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe8dc0010c0 tx=0x7fe8dc007830).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.451 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.436+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fe8e4041b40 con 0x7fe8f0062ed0 2020-07-16T20:30:38.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.596+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8f005f320 con 0x7fe8f0062ed0 2020-07-16T20:30:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.596+0000 7fe8ecff9700 1 -- 172.21.15.22:0/3242302931 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8e4045160 con 0x7fe8f0062ed0 2020-07-16T20:30:38.598 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 msgr2=0x7fe8c80527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 0x7fe8c80527a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe8dc0010c0 tx=0x7fe8dc007830).stop 2020-07-16T20:30:38.600 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 msgr2=0x7fe8f005f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f005f5e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe8e4002f30 tx=0x7fe8e4015000).stop 2020-07-16T20:30:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 shutdown_connections 2020-07-16T20:30:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fe8c80502e0 0x7fe8c80527a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/3242302931 >> v2:172.21.15.116:3300/0 conn(0x7fe8f005fad0 0x7fe8f0063e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.601 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 --2- 172.21.15.22:0/3242302931 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe8f0062ed0 0x7fe8f005f5e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 >> 172.21.15.22:0/3242302931 conn(0x7fe8f00b9530 msgr2=0x7fe8f009e630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:38.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 shutdown_connections 2020-07-16T20:30:38.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.598+0000 7fe8f71c8700 1 -- 172.21.15.22:0/3242302931 wait complete. 2020-07-16T20:30:38.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2020-07-16T20:30:38.611 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-07-16T20:30:38.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.724+0000 7fb9d2eca700 1 Processor -- start 2020-07-16T20:30:38.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.724+0000 7fb9d2eca700 1 -- start start 2020-07-16T20:30:38.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d2eca700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc09cce0 0x7fb9cc146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d2eca700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9cc062ed0 0x7fb9cc09e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d2eca700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc147290 con 0x7fb9cc146e10 2020-07-16T20:30:38.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d2eca700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc144e80 con 0x7fb9cc062ed0 2020-07-16T20:30:38.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d2eca700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc144be0 con 0x7fb9cc09cce0 2020-07-16T20:30:38.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9cbfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb9cc146e10 0x7fb9cc0627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39766/0 (socket says 172.21.15.22:39766) 2020-07-16T20:30:38.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9cbfff700 1 -- 172.21.15.22:0/3814379383 learned_addr learned my addr 172.21.15.22:0/3814379383 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:38.746 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> v2:172.21.15.116:3300/0 conn(0x7fb9cc062ed0 0x7fb9cc09e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9d0c66700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc09cce0 0x7fb9cc146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436576112 0 0) 0x7fb9cc147290 con 0x7fb9cc146e10 2020-07-16T20:30:38.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.725+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b8003240 con 0x7fb9cc146e10 2020-07-16T20:30:38.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1173642429 0 0) 0x7fb9b8003240 con 0x7fb9cc146e10 2020-07-16T20:30:38.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc09cce0 msgr2=0x7fb9cc146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:38.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc09cce0 0x7fb9cc146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 >> v2:172.21.15.116:3300/0 conn(0x7fb9cc062ed0 msgr2=0x7fb9cc09e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:38.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/3814379383 >> v2:172.21.15.116:3300/0 conn(0x7fb9cc062ed0 0x7fb9cc09e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc09e430 con 0x7fb9cc146e10 2020-07-16T20:30:38.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fb9c00016d0 con 0x7fb9cc146e10 2020-07-16T20:30:38.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> v2:172.21.15.116:3300/0 conn(0x7fb9cc062ed0 0x7fb9cc09e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:38.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d0c66700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc09cce0 0x7fb9cc146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:38.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 >> v1:172.21.15.22:6789/0 conn(0x7fb9cc146e10 legacy=0x7fb9cc0627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9b8003730 0x7fb9b8003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9b8004000 0x7fb9b80044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9b8004ae0 0x7fb9b8004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc144e80 con 0x7fb9b8004ae0 2020-07-16T20:30:38.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc144be0 con 0x7fb9b8004000 2020-07-16T20:30:38.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b800b860 con 0x7fb9b8003730 2020-07-16T20:30:38.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9b8004ae0 0x7fb9b8004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cbfff700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9b8004000 0x7fb9b80044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d0c66700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9b8003730 0x7fb9b8003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 -- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9b8003730 msgr2=0x7fb9b8003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:38.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9b8003730 0x7fb9b8003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 -- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9b8004000 msgr2=0x7fb9b80044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9b8004000 0x7fb9b80044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 -- 172.21.15.22:0/3814379383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8003240 con 0x7fb9b8004ae0 2020-07-16T20:30:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cbfff700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9b8004000 0x7fb9b80044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:38.762 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9b8004ae0 0x7fb9b8004f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb9c400c000 tx=0x7fb9c40091d0).ready entity=mon.0 client_cookie=4fd9fc4fa120f5fc server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.763 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c400ee30 con 0x7fb9b8004ae0 2020-07-16T20:30:38.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c40123f0 con 0x7fb9b8004ae0 2020-07-16T20:30:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9cb7fe700 1 -- 172.21.15.22:0/3814379383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9c4012750 con 0x7fb9b8004ae0 2020-07-16T20:30:38.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d2eca700 1 -- 172.21.15.22:0/3814379383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9b8004ae0 msgr2=0x7fb9b8004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/3814379383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9b8004ae0 0x7fb9b8004f60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb9c400c000 tx=0x7fb9c40091d0).stop 2020-07-16T20:30:38.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d1467700 1 -- 172.21.15.22:0/3814379383 reap_dead start 2020-07-16T20:30:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d2eca700 1 -- 172.21.15.22:0/3814379383 shutdown_connections 2020-07-16T20:30:38.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.726+0000 7fb9d2eca700 1 -- 172.21.15.22:0/3814379383 >> 172.21.15.22:0/3814379383 conn(0x7fb9cc0b9530 msgr2=0x7fb9cc0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.727+0000 7fb9d2eca700 1 -- 172.21.15.22:0/3814379383 shutdown_connections 2020-07-16T20:30:38.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.727+0000 7fb9d2eca700 1 -- 172.21.15.22:0/3814379383 wait complete. 2020-07-16T20:30:38.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.728+0000 7fb9d2eca700 1 Processor -- start 2020-07-16T20:30:38.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.728+0000 7fb9d2eca700 1 -- start start 2020-07-16T20:30:38.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9cc1408c0 0x7fb9cc065270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc140ca0 0x7fb9cc13c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc0b3ef0 con 0x7fb9cc159c80 2020-07-16T20:30:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc067610 con 0x7fb9cc1408c0 2020-07-16T20:30:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc065860 con 0x7fb9cc140ca0 2020-07-16T20:30:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9cc1408c0 0x7fb9cc065270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9cc1408c0 0x7fb9cc065270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39070/0 (socket says 172.21.15.22:39070) 2020-07-16T20:30:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 -- 172.21.15.22:0/2383178202 learned_addr learned my addr 172.21.15.22:0/2383178202 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9cbfff700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc140ca0 0x7fb9cc13c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 -- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc140ca0 msgr2=0x7fb9cc13c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc140ca0 0x7fb9cc13c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 -- 172.21.15.22:0/2383178202 >> v1:172.21.15.116:6789/0 conn(0x7fb9cc159c80 legacy=0x7fb9cc13ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 -- 172.21.15.22:0/2383178202 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc065b00 con 0x7fb9cc1408c0 2020-07-16T20:30:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d0c66700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9cc1408c0 0x7fb9cc065270 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb9bc008000 tx=0x7fb9bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9bc00f910 con 0x7fb9cc1408c0 2020-07-16T20:30:38.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc00fa70 con 0x7fb9cc1408c0 2020-07-16T20:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.729+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc065da0 con 0x7fb9cc1408c0 2020-07-16T20:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.730+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9bc00fbe0 con 0x7fb9cc1408c0 2020-07-16T20:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.730+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc066600 con 0x7fb9cc1408c0 2020-07-16T20:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.730+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc065f30 con 0x7fb9cc1408c0 2020-07-16T20:30:38.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.731+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb9bc014440 con 0x7fb9cc1408c0 2020-07-16T20:30:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.731+0000 7fb9c8ff9700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 0x7fb9a4052480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.731+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb9bc068a10 con 0x7fb9cc1408c0 2020-07-16T20:30:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.732+0000 7fb9cbfff700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 0x7fb9a4052480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.732+0000 7fb9cbfff700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 0x7fb9a4052480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb9c000d000 tx=0x7fb9c000c040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:38.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.734+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb9bc0410a0 con 0x7fb9cc1408c0 2020-07-16T20:30:38.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.891+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb9cc05f320 con 0x7fb9cc1408c0 2020-07-16T20:30:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.892+0000 7fb9c8ff9700 1 -- 172.21.15.22:0/2383178202 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9bc0446c0 con 0x7fb9cc1408c0 2020-07-16T20:30:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 msgr2=0x7fb9a4052480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 0x7fb9a4052480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb9c000d000 tx=0x7fb9c000c040).stop 2020-07-16T20:30:38.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9cc1408c0 msgr2=0x7fb9cc065270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:38.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9cc1408c0 0x7fb9cc065270 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb9bc008000 tx=0x7fb9bc008040).stop 2020-07-16T20:30:38.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 shutdown_connections 2020-07-16T20:30:38.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb9a404ffc0 0x7fb9a4052480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9cc1408c0 0x7fb9cc065270 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 --2- 172.21.15.22:0/2383178202 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9cc140ca0 0x7fb9cc13c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:38.897 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 >> 172.21.15.22:0/2383178202 conn(0x7fb9cc0b9530 msgr2=0x7fb9cc0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:38.897 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 shutdown_connections 2020-07-16T20:30:38.897 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:38.893+0000 7fb9d2eca700 1 -- 172.21.15.22:0/2383178202 wait complete. 2020-07-16T20:30:38.899 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:38.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2020-07-16T20:30:38.907 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-07-16T20:30:39.025 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 Processor -- start 2020-07-16T20:30:39.026 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 -- start start 2020-07-16T20:30:39.032 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03f8147200 0x7f03f805f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.032 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03f805fc20 0x7f03f80b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f8141760 con 0x7f03f80b40b0 2020-07-16T20:30:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80600b0 con 0x7f03f8147200 2020-07-16T20:30:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03fdbcb700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8060350 con 0x7f03f805fc20 2020-07-16T20:30:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03f77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03f8147200 0x7f03f805f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03f77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03f8147200 0x7f03f805f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39076/0 (socket says 172.21.15.22:39076) 2020-07-16T20:30:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.024+0000 7f03f77fe700 1 -- 172.21.15.22:0/2801081789 learned_addr learned my addr 172.21.15.22:0/2801081789 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03effff700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03f805fc20 0x7f03f80b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f77fe700 1 -- 172.21.15.22:0/2801081789 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03f805fc20 msgr2=0x7f03f80b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f77fe700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03f805fc20 0x7f03f80b3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f77fe700 1 -- 172.21.15.22:0/2801081789 >> v1:172.21.15.116:6789/0 conn(0x7f03f80b40b0 legacy=0x7f03f80b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f77fe700 1 -- 172.21.15.22:0/2801081789 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f814a7d0 con 0x7f03f8147200 2020-07-16T20:30:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f77fe700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03f8147200 0x7f03f805f730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8006e90).ready entity=mon.0 client_cookie=bb5648b0ce266384 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f6ffd700 1 -- 172.21.15.22:0/2801081789 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8009850 con 0x7f03f8147200 2020-07-16T20:30:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f6ffd700 1 -- 172.21.15.22:0/2801081789 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80099b0 con 0x7f03f8147200 2020-07-16T20:30:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03f6ffd700 1 -- 172.21.15.22:0/2801081789 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8009d10 con 0x7f03f8147200 2020-07-16T20:30:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 -- 172.21.15.22:0/2801081789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03f8147200 msgr2=0x7f03f805f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03f8147200 0x7f03f805f730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8006e90).stop 2020-07-16T20:30:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 -- 172.21.15.22:0/2801081789 shutdown_connections 2020-07-16T20:30:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03f8147200 0x7f03f805f730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/2801081789 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f03f805fc20 0x7f03f80b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 -- 172.21.15.22:0/2801081789 >> 172.21.15.22:0/2801081789 conn(0x7f03f80bd9a0 msgr2=0x7f03f80bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 -- 172.21.15.22:0/2801081789 shutdown_connections 2020-07-16T20:30:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.025+0000 7f03fdbcb700 1 -- 172.21.15.22:0/2801081789 wait complete. 2020-07-16T20:30:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 Processor -- start 2020-07-16T20:30:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 -- start start 2020-07-16T20:30:39.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f03f80b40b0 0x7f03f8143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f809f3e0 con 0x7f03f80b59f0 2020-07-16T20:30:39.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f809f680 con 0x7f03f80a0320 2020-07-16T20:30:39.040 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03fdbcb700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f809f100 con 0x7f03f80b40b0 2020-07-16T20:30:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03f7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f03f80b59f0 0x7f03f8142a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39794/0 (socket says 172.21.15.22:39794) 2020-07-16T20:30:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.027+0000 7f03f7fff700 1 -- 172.21.15.22:0/821944705 learned_addr learned my addr 172.21.15.22:0/821944705 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:39.041 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03f77fe700 1 --2- 172.21.15.22:0/821944705 >> v2:172.21.15.116:3300/0 conn(0x7f03f80b40b0 0x7f03f8143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417673283 0 0) 0x7f03f809f3e0 con 0x7f03f80b59f0 2020-07-16T20:30:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d4003240 con 0x7f03f80b59f0 2020-07-16T20:30:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03f77fe700 1 -- 172.21.15.22:0/821944705 >> v1:172.21.15.116:6789/0 conn(0x7f03f80a0320 legacy=0x7f03f813fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.042 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03f77fe700 1 -- 172.21.15.22:0/821944705 >> v1:172.21.15.22:6789/0 conn(0x7f03f80b59f0 legacy=0x7f03f8142a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03f77fe700 1 -- 172.21.15.22:0/821944705 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f81441a0 con 0x7f03f80b40b0 2020-07-16T20:30:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03f77fe700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03f80b40b0 0x7f03f8143cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8009850 con 0x7f03f80b40b0 2020-07-16T20:30:39.043 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8011e80 con 0x7f03f80b40b0 2020-07-16T20:30:39.044 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f8140490 con 0x7f03f80b40b0 2020-07-16T20:30:39.044 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e801d7c0 con 0x7f03f80b40b0 2020-07-16T20:30:39.044 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.028+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f8141dc0 con 0x7f03f80b40b0 2020-07-16T20:30:39.045 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.029+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f809f240 con 0x7f03f80b40b0 2020-07-16T20:30:39.045 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.029+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f03e8025030 con 0x7f03f80b40b0 2020-07-16T20:30:39.045 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.029+0000 7f03ef7fe700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 0x7f03d40527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.030+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f03e8069430 con 0x7f03f80b40b0 2020-07-16T20:30:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.030+0000 7f03effff700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 0x7f03d40527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.046 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.030+0000 7f03effff700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 0x7f03d40527a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f03f809d7d0 tx=0x7f03e0006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.047 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.033+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f03f809f240 con 0x7f03f80b40b0 2020-07-16T20:30:39.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.191+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f03f809f240 con 0x7f03f80b40b0 2020-07-16T20:30:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.192+0000 7f03ef7fe700 1 -- 172.21.15.22:0/821944705 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03f809f240 con 0x7f03f80b40b0 2020-07-16T20:30:39.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 msgr2=0x7f03d40527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.196 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 0x7f03d40527a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f03f809d7d0 tx=0x7f03e0006dd0).stop 2020-07-16T20:30:39.196 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03f80b40b0 msgr2=0x7f03f8143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.196 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03f80b40b0 0x7f03f8143cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8015000).stop 2020-07-16T20:30:39.197 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 shutdown_connections 2020-07-16T20:30:39.197 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f03d40502e0 0x7f03d40527a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.197 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 --2- 172.21.15.22:0/821944705 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f03f80b40b0 0x7f03f8143cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 >> 172.21.15.22:0/821944705 conn(0x7f03f80bd9a0 msgr2=0x7f03f80b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 shutdown_connections 2020-07-16T20:30:39.198 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.193+0000 7f03fdbcb700 1 -- 172.21.15.22:0/821944705 wait complete. 2020-07-16T20:30:39.199 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2020-07-16T20:30:39.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2020-07-16T20:30:39.218 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-07-16T20:30:39.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.332+0000 7f15bce2b700 1 Processor -- start 2020-07-16T20:30:39.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.332+0000 7f15bce2b700 1 -- start start 2020-07-16T20:30:39.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15bce2b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f15b8063130 0x7f15b8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15bce2b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b8147a30 con 0x7f15b8063510 2020-07-16T20:30:39.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15bce2b700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b80b5370 con 0x7f15b8143040 2020-07-16T20:30:39.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15bce2b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b8143560 con 0x7f15b8063130 2020-07-16T20:30:39.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b5d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f15b8063510 0x7f15b8146c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39798/0 (socket says 172.21.15.22:39798) 2020-07-16T20:30:39.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b5d9b700 1 -- 172.21.15.22:0/3638006286 learned_addr learned my addr 172.21.15.22:0/3638006286 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:39.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824432207 0 0) 0x7f15b8147a30 con 0x7f15b8063510 2020-07-16T20:30:39.362 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b659c700 1 --2- 172.21.15.22:0/3638006286 >> v2:172.21.15.116:3300/0 conn(0x7f15b8063130 0x7f15b8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1598003240 con 0x7f15b8063510 2020-07-16T20:30:39.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 403536612 0 0) 0x7f1598003240 con 0x7f15b8063510 2020-07-16T20:30:39.363 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 >> v2:172.21.15.116:3300/0 conn(0x7f15b8063130 msgr2=0x7f15b8142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 --2- 172.21.15.22:0/3638006286 >> v2:172.21.15.116:3300/0 conn(0x7f15b8063130 0x7f15b8142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 >> v1:172.21.15.116:6789/0 conn(0x7f15b8143040 legacy=0x7f15b8147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.364 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80b5610 con 0x7f15b8063510 2020-07-16T20:30:39.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f15a00016d0 con 0x7f15b8063510 2020-07-16T20:30:39.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 >> v1:172.21.15.22:6789/0 conn(0x7f15b8063510 legacy=0x7f15b8146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.365 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 0x7f1598003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15980044e0 0x7f1598004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1598004e50 0x7f159800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159800bc20 con 0x7f1598003780 2020-07-16T20:30:39.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159800bd60 con 0x7f15980044e0 2020-07-16T20:30:39.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.333+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159800bea0 con 0x7f1598004e50 2020-07-16T20:30:39.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 0x7f1598003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b5d9b700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15980044e0 0x7f1598004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.376 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b6d9d700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1598004e50 0x7f159800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 -- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1598004e50 msgr2=0x7f159800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1598004e50 0x7f159800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.377 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 -- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15980044e0 msgr2=0x7f1598004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f15980044e0 0x7f1598004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 -- 172.21.15.22:0/3638006286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598003240 con 0x7f1598003780 2020-07-16T20:30:39.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b6d9d700 1 -- 172.21.15.22:0/3638006286 reap_dead start 2020-07-16T20:30:39.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b659c700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 0x7f1598003ba0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f15b000c000 tx=0x7f15b00091d0).ready entity=mon.0 client_cookie=46298fbd0c929233 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b000eb20 con 0x7f1598003780 2020-07-16T20:30:39.379 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b000ec80 con 0x7f1598003780 2020-07-16T20:30:39.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15b559a700 1 -- 172.21.15.22:0/3638006286 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b00123f0 con 0x7f1598003780 2020-07-16T20:30:39.380 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 -- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 msgr2=0x7f1598003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 0x7f1598003ba0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f15b000c000 tx=0x7f15b00091d0).stop 2020-07-16T20:30:39.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 -- 172.21.15.22:0/3638006286 shutdown_connections 2020-07-16T20:30:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 --2- 172.21.15.22:0/3638006286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1598003780 0x7f1598003ba0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 -- 172.21.15.22:0/3638006286 >> 172.21.15.22:0/3638006286 conn(0x7f15b80b9530 msgr2=0x7f15b80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 -- 172.21.15.22:0/3638006286 shutdown_connections 2020-07-16T20:30:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.334+0000 7f15bce2b700 1 -- 172.21.15.22:0/3638006286 wait complete. 2020-07-16T20:30:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 Processor -- start 2020-07-16T20:30:39.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 -- start start 2020-07-16T20:30:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15b8152800 0x7f15b8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15b81530d0 0x7f15b80639e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b8142200 con 0x7f15b8063ed0 2020-07-16T20:30:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b8142020 con 0x7f15b8152800 2020-07-16T20:30:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15bce2b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8140990 con 0x7f15b81530d0 2020-07-16T20:30:39.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15b659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15b8152800 0x7f15b8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15b659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f15b8152800 0x7f15b8152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39104/0 (socket says 172.21.15.22:39104) 2020-07-16T20:30:39.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.336+0000 7f15b659c700 1 -- 172.21.15.22:0/2623333121 learned_addr learned my addr 172.21.15.22:0/2623333121 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:39.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b5d9b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15b81530d0 0x7f15b80639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b659c700 1 -- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15b81530d0 msgr2=0x7f15b80639e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b659c700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15b81530d0 0x7f15b80639e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b659c700 1 -- 172.21.15.22:0/2623333121 >> v1:172.21.15.116:6789/0 conn(0x7f15b8063ed0 legacy=0x7f15b8155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b659c700 1 -- 172.21.15.22:0/2623333121 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8153570 con 0x7f15b8152800 2020-07-16T20:30:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15b659c700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b8152800 0x7f15b8152be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f15b000c000 tx=0x7f15b001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b00128f0 con 0x7f15b8152800 2020-07-16T20:30:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0012a50 con 0x7f15b8152800 2020-07-16T20:30:39.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b813a6b0 con 0x7f15b8152800 2020-07-16T20:30:39.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b0012db0 con 0x7f15b8152800 2020-07-16T20:30:39.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.337+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b8146f90 con 0x7f15b8152800 2020-07-16T20:30:39.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.338+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b805f320 con 0x7f15b8152800 2020-07-16T20:30:39.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.338+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f15b002a020 con 0x7f15b8152800 2020-07-16T20:30:39.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.338+0000 7f15ae7fc700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 0x7f1594052550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.338+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f15b0069cc0 con 0x7f15b8152800 2020-07-16T20:30:39.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.339+0000 7f15b5d9b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 0x7f1594052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.339+0000 7f15b5d9b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 0x7f1594052550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f15a0005000 tx=0x7f15a0001e50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.342+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f15b006f020 con 0x7f15b8152800 2020-07-16T20:30:39.506 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.502+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f15b809f5f0 con 0x7f15b8152800 2020-07-16T20:30:39.507 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.502+0000 7f15ae7fc700 1 -- 172.21.15.22:0/2623333121 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15b0016020 con 0x7f15b8152800 2020-07-16T20:30:39.507 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 msgr2=0x7f1594052550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.507 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 0x7f1594052550 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f15a0005000 tx=0x7f15a0001e50).stop 2020-07-16T20:30:39.507 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b8152800 msgr2=0x7f15b8152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b8152800 0x7f15b8152be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f15b000c000 tx=0x7f15b001a000).stop 2020-07-16T20:30:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 shutdown_connections 2020-07-16T20:30:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1594050090 0x7f1594052550 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15b8152800 0x7f15b8152be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 --2- 172.21.15.22:0/2623333121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f15b81530d0 0x7f15b80639e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 >> 172.21.15.22:0/2623333121 conn(0x7f15b80b9530 msgr2=0x7f15b80b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 shutdown_connections 2020-07-16T20:30:39.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.504+0000 7f15bce2b700 1 -- 172.21.15.22:0/2623333121 wait complete. 2020-07-16T20:30:39.510 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2020-07-16T20:30:39.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2020-07-16T20:30:39.516 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-07-16T20:30:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.631+0000 7efec554b700 1 Processor -- start 2020-07-16T20:30:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.631+0000 7efec554b700 1 -- start start 2020-07-16T20:30:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efec554b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec0147030 0x7efec00627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efec554b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efec0062cb0 0x7efec009e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.650 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efec554b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec0144e80 con 0x7efec009cce0 2020-07-16T20:30:39.650 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efec554b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec0144be0 con 0x7efec0062cb0 2020-07-16T20:30:39.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efec554b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec009e430 con 0x7efec0147030 2020-07-16T20:30:39.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efebeffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efec009cce0 0x7efec0146920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39818/0 (socket says 172.21.15.22:39818) 2020-07-16T20:30:39.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efebeffd700 1 -- 172.21.15.22:0/133297460 learned_addr learned my addr 172.21.15.22:0/133297460 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:39.652 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efebf7fe700 1 --2- 172.21.15.22:0/133297460 >> v2:172.21.15.22:3300/0 conn(0x7efec0062cb0 0x7efec009e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.652 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efebe7fc700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec0147030 0x7efec00627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.652 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.632+0000 7efebdffb700 1 -- 172.21.15.22:0/133297460 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687743141 0 0) 0x7efec0144e80 con 0x7efec009cce0 2020-07-16T20:30:39.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebdffb700 1 -- 172.21.15.22:0/133297460 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeac003240 con 0x7efec009cce0 2020-07-16T20:30:39.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebf7fe700 1 -- 172.21.15.22:0/133297460 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec0147030 msgr2=0x7efec00627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebf7fe700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec0147030 0x7efec00627c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.654 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebf7fe700 1 -- 172.21.15.22:0/133297460 >> v1:172.21.15.22:6789/0 conn(0x7efec009cce0 legacy=0x7efec0146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.654 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebf7fe700 1 -- 172.21.15.22:0/133297460 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec0144900 con 0x7efec0062cb0 2020-07-16T20:30:39.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebf7fe700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0062cb0 0x7efec009e8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7efeb80032b0 tx=0x7efeb80091d0).ready entity=mon.0 client_cookie=cbafca3d55514fb3 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebdffb700 1 -- 172.21.15.22:0/133297460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb800b9a0 con 0x7efec0062cb0 2020-07-16T20:30:39.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebdffb700 1 -- 172.21.15.22:0/133297460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb800bb00 con 0x7efec0062cb0 2020-07-16T20:30:39.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efebdffb700 1 -- 172.21.15.22:0/133297460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb800bc70 con 0x7efec0062cb0 2020-07-16T20:30:39.659 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 -- 172.21.15.22:0/133297460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0062cb0 msgr2=0x7efec009e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0062cb0 0x7efec009e8d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7efeb80032b0 tx=0x7efeb80091d0).stop 2020-07-16T20:30:39.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 -- 172.21.15.22:0/133297460 shutdown_connections 2020-07-16T20:30:39.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0062cb0 0x7efec009e8d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 --2- 172.21.15.22:0/133297460 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec0147030 0x7efec00627c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 -- 172.21.15.22:0/133297460 >> 172.21.15.22:0/133297460 conn(0x7efec00b9530 msgr2=0x7efec00b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 -- 172.21.15.22:0/133297460 shutdown_connections 2020-07-16T20:30:39.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.633+0000 7efec554b700 1 -- 172.21.15.22:0/133297460 wait complete. 2020-07-16T20:30:39.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 Processor -- start 2020-07-16T20:30:39.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 -- start start 2020-07-16T20:30:39.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 0x7efec0138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 0x7efec005f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efec0064de0 0x7efec005fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec0065310 con 0x7efec0064de0 2020-07-16T20:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec0065520 con 0x7efec013ced0 2020-07-16T20:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efec554b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec00657c0 con 0x7efec013d2b0 2020-07-16T20:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efebf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efec0064de0 0x7efec005fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efebf7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efec0064de0 0x7efec005fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39120/0 (socket says 172.21.15.22:39120) 2020-07-16T20:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.635+0000 7efebf7fe700 1 -- 172.21.15.22:0/190412112 learned_addr learned my addr 172.21.15.22:0/190412112 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebeffd700 1 --2- 172.21.15.22:0/190412112 >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 0x7efec0138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebe7fc700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 0x7efec005f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 -- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 msgr2=0x7efec005f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 0x7efec005f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 -- 172.21.15.22:0/190412112 >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 msgr2=0x7efec0138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 --2- 172.21.15.22:0/190412112 >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 0x7efec0138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 -- 172.21.15.22:0/190412112 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec013c310 con 0x7efec0064de0 2020-07-16T20:30:39.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebe7fc700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 0x7efec005f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:39.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebeffd700 1 --2- 172.21.15.22:0/190412112 >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 0x7efec0138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:39.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efebf7fe700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0064de0 0x7efec005fad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7efeb80032b0 tx=0x7efeb8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb80107a0 con 0x7efec0064de0 2020-07-16T20:30:39.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8010900 con 0x7efec0064de0 2020-07-16T20:30:39.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00638a0 con 0x7efec0064de0 2020-07-16T20:30:39.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeb8010c60 con 0x7efec0064de0 2020-07-16T20:30:39.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.636+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec0139120 con 0x7efec0064de0 2020-07-16T20:30:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.637+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec005f320 con 0x7efec0064de0 2020-07-16T20:30:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.637+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7efeb8027030 con 0x7efec0064de0 2020-07-16T20:30:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.637+0000 7efea6ffd700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 0x7efe9c0524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.638+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efeb8069010 con 0x7efec0064de0 2020-07-16T20:30:39.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.638+0000 7efebeffd700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 0x7efe9c0524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.638+0000 7efebeffd700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 0x7efe9c0524c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efeb400b000 tx=0x7efeb4009040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.641+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7efeb80417a0 con 0x7efec0064de0 2020-07-16T20:30:39.797 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.796+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efec0043fd0 con 0x7efec0064de0 2020-07-16T20:30:39.798 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.796+0000 7efea6ffd700 1 -- 172.21.15.22:0/190412112 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efeb8015090 con 0x7efec0064de0 2020-07-16T20:30:39.798 INFO:teuthology.orchestra.run.smithi022.stdout:55834574855 2020-07-16T20:30:39.799 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.797+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 msgr2=0x7efe9c0524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 0x7efe9c0524c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7efeb400b000 tx=0x7efeb4009040).stop 2020-07-16T20:30:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0064de0 msgr2=0x7efec005fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0064de0 0x7efec005fad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7efeb80032b0 tx=0x7efeb8016000).stop 2020-07-16T20:30:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 shutdown_connections 2020-07-16T20:30:39.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7efe9c050000 0x7efe9c0524c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efec0064de0 0x7efec005fad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> v2:172.21.15.116:3300/0 conn(0x7efec013ced0 0x7efec0138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 --2- 172.21.15.22:0/190412112 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7efec013d2b0 0x7efec005f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 >> 172.21.15.22:0/190412112 conn(0x7efec00b9530 msgr2=0x7efec013daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 shutdown_connections 2020-07-16T20:30:39.805 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.798+0000 7efec554b700 1 -- 172.21.15.22:0/190412112 wait complete. 2020-07-16T20:30:39.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.7 2020-07-16T20:30:39.810 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-07-16T20:30:39.810 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:30:39.925 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.923+0000 7fdc30ac1700 1 Processor -- start 2020-07-16T20:30:39.925 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.923+0000 7fdc30ac1700 1 -- start start 2020-07-16T20:30:39.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc30ac1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc30ac1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdc2c1449a0 0x7fdc2c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc30ac1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c147ed0 con 0x7fdc2c09e050 2020-07-16T20:30:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc30ac1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c148170 con 0x7fdc2c1449a0 2020-07-16T20:30:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc30ac1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c09cb10 con 0x7fdc2c09dc70 2020-07-16T20:30:39.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc29d9b700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdc2c09e050 0x7fdc2c144290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39832/0 (socket says 172.21.15.22:39832) 2020-07-16T20:30:39.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.924+0000 7fdc29d9b700 1 -- 172.21.15.22:0/2273646163 learned_addr learned my addr 172.21.15.22:0/2273646163 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:39.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 --2- 172.21.15.22:0/2273646163 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c1449a0 0x7fdc2c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2a59c700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2959a700 1 -- 172.21.15.22:0/2273646163 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366813246 0 0) 0x7fdc2c147ed0 con 0x7fdc2c09e050 2020-07-16T20:30:39.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2959a700 1 -- 172.21.15.22:0/2273646163 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc10003240 con 0x7fdc2c09e050 2020-07-16T20:30:39.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 -- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 msgr2=0x7fdc2c1475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:39.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 -- 172.21.15.22:0/2273646163 >> v1:172.21.15.22:6789/0 conn(0x7fdc2c09e050 legacy=0x7fdc2c144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 -- 172.21.15.22:0/2273646163 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c09cc80 con 0x7fdc2c1449a0 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2ad9d700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc2c1449a0 0x7fdc2c0b4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdc240032b0 tx=0x7fdc240091d0).ready entity=mon.1 client_cookie=c1aebf1c6851e940 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2959a700 1 -- 172.21.15.22:0/2273646163 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400b940 con 0x7fdc2c1449a0 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2959a700 1 -- 172.21.15.22:0/2273646163 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400baa0 con 0x7fdc2c1449a0 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc2959a700 1 -- 172.21.15.22:0/2273646163 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc2400bc10 con 0x7fdc2c1449a0 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc2c1449a0 msgr2=0x7fdc2c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc2c1449a0 0x7fdc2c0b4e00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdc240032b0 tx=0x7fdc240091d0).stop 2020-07-16T20:30:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2273646163 shutdown_connections 2020-07-16T20:30:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdc2c1449a0 0x7fdc2c0b4e00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2273646163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2273646163 >> 172.21.15.22:0/2273646163 conn(0x7fdc2c0b9530 msgr2=0x7fdc2c0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:39.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2273646163 shutdown_connections 2020-07-16T20:30:39.933 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.925+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2273646163 wait complete. 2020-07-16T20:30:39.935 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.927+0000 7fdc30ac1700 1 Processor -- start 2020-07-16T20:30:39.935 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.927+0000 7fdc30ac1700 1 -- start start 2020-07-16T20:30:39.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.927+0000 7fdc30ac1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.927+0000 7fdc30ac1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc2c09e050 0x7fdc2c143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.927+0000 7fdc30ac1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 0x7fdc2c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc30ac1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c13c640 con 0x7fdc2c09e050 2020-07-16T20:30:39.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc30ac1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c156ed0 con 0x7fdc2c143700 2020-07-16T20:30:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc30ac1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c157170 con 0x7fdc2c09dc70 2020-07-16T20:30:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc2c09e050 0x7fdc2c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdc2c09e050 0x7fdc2c143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39132/0 (socket says 172.21.15.22:39132) 2020-07-16T20:30:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 -- 172.21.15.22:0/2758013408 learned_addr learned my addr 172.21.15.22:0/2758013408 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:39.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc2a59c700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.938 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc2ad9d700 1 --2- 172.21.15.22:0/2758013408 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 0x7fdc2c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.938 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 -- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 msgr2=0x7fdc2c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.938 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.938 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 -- 172.21.15.22:0/2758013408 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 msgr2=0x7fdc2c0afc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:39.938 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 --2- 172.21.15.22:0/2758013408 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 0x7fdc2c0afc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:39.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 -- 172.21.15.22:0/2758013408 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c157da0 con 0x7fdc2c09e050 2020-07-16T20:30:39.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc2ad9d700 1 --2- 172.21.15.22:0/2758013408 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 0x7fdc2c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:39.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc29d9b700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c09e050 0x7fdc2c143210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fdc1c0010d0 tx=0x7fdc1c007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1c0072e0 con 0x7fdc2c09e050 2020-07-16T20:30:39.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c007440 con 0x7fdc2c09e050 2020-07-16T20:30:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c0b7b90 con 0x7fdc2c09e050 2020-07-16T20:30:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc1c0057e0 con 0x7fdc2c09e050 2020-07-16T20:30:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.928+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0b0140 con 0x7fdc2c09e050 2020-07-16T20:30:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.929+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c05f320 con 0x7fdc2c09e050 2020-07-16T20:30:39.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.929+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fdc1c01a060 con 0x7fdc2c09e050 2020-07-16T20:30:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.930+0000 7fdc1a7fc700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 0x7fdc00052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.930+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdc1c0670c0 con 0x7fdc2c09e050 2020-07-16T20:30:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.930+0000 7fdc2a59c700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 0x7fdc00052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.930+0000 7fdc2a59c700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 0x7fdc00052490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc20008000 tx=0x7fdc20008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:39.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:39.933+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fdc1c03f850 con 0x7fdc2c09e050 2020-07-16T20:30:40.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.084+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc2c157580 con 0x7fdc0004ffd0 2020-07-16T20:30:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.087+0000 7fdc1a7fc700 1 -- 172.21.15.22:0/2758013408 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82442 (secure 0 0 0) 0x7fdc2c157580 con 0x7fdc0004ffd0 2020-07-16T20:30:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 msgr2=0x7fdc00052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 0x7fdc00052490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fdc20008000 tx=0x7fdc20008040).stop 2020-07-16T20:30:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c09e050 msgr2=0x7fdc2c143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c09e050 0x7fdc2c143210 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fdc1c0010d0 tx=0x7fdc1c007a20).stop 2020-07-16T20:30:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 shutdown_connections 2020-07-16T20:30:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fdc0004ffd0 0x7fdc00052490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> v2:172.21.15.116:3300/0 conn(0x7fdc2c143700 0x7fdc2c0afc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdc2c09dc70 0x7fdc2c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 --2- 172.21.15.22:0/2758013408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc2c09e050 0x7fdc2c143210 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 >> 172.21.15.22:0/2758013408 conn(0x7fdc2c0b9530 msgr2=0x7fdc2c0b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 shutdown_connections 2020-07-16T20:30:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.089+0000 7fdc30ac1700 1 -- 172.21.15.22:0/2758013408 wait complete. 2020-07-16T20:30:40.093 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2020-07-16T20:30:40.101 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2020-07-16T20:30:39.329976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":889008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.371062"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960978+0000","last_change":"2020-07-16T20:30:29.590733+0000","last_active":"2020-07-16T20:30:29.960978+0000","last_peered":"2020-07-16T20:30:29.960978+0000","last_clean":"2020-07-16T20:30:29.960978+0000","last_became_active":"2020-07-16T20:30:29.590030+0000","last_became_peered":"2020-07-16T20:30:29.590030+0000","last_unstale":"2020-07-16T20:30:29.960978+0000","last_undegraded":"2020-07-16T20:30:29.960978+0000","last_fullsized":"2020-07-16T20:30:29.960978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970487+0000","last_change":"2020-07-16T20:30:23.564026+0000","last_active":"2020-07-16T20:30:29.970487+0000","last_peered":"2020-07-16T20:30:29.970487+0000","last_clean":"2020-07-16T20:30:29.970487+0000","last_became_active":"2020-07-16T20:30:23.563591+0000","last_became_peered":"2020-07-16T20:30:23.563591+0000","last_unstale":"2020-07-16T20:30:29.970487+0000","last_undegraded":"2020-07-16T20:30:29.970487+0000","last_fullsized":"2020-07-16T20:30:29.970487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.959365+0000","last_change":"2020-07-16T20:30:26.577657+0000","last_active":"2020-07-16T20:30:32.959365+0000","last_peered":"2020-07-16T20:30:32.959365+0000","last_clean":"2020-07-16T20:30:32.959365+0000","last_became_active":"2020-07-16T20:30:26.577264+0000","last_became_peered":"2020-07-16T20:30:26.577264+0000","last_unstale":"2020-07-16T20:30:32.959365+0000","last_undegraded":"2020-07-16T20:30:32.959365+0000","last_fullsized":"2020-07-16T20:30:32.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961017+0000","last_change":"2020-07-16T20:30:29.819730+0000","last_active":"2020-07-16T20:30:29.961017+0000","last_peered":"2020-07-16T20:30:29.961017+0000","last_clean":"2020-07-16T20:30:29.961017+0000","last_became_active":"2020-07-16T20:30:29.819079+0000","last_became_peered":"2020-07-16T20:30:29.819079+0000","last_unstale":"2020-07-16T20:30:29.961017+0000","last_undegraded":"2020-07-16T20:30:29.961017+0000","last_fullsized":"2020-07-16T20:30:29.961017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972715+0000","last_change":"2020-07-16T20:30:23.565160+0000","last_active":"2020-07-16T20:30:29.972715+0000","last_peered":"2020-07-16T20:30:29.972715+0000","last_clean":"2020-07-16T20:30:29.972715+0000","last_became_active":"2020-07-16T20:30:23.564708+0000","last_became_peered":"2020-07-16T20:30:23.564708+0000","last_unstale":"2020-07-16T20:30:29.972715+0000","last_undegraded":"2020-07-16T20:30:29.972715+0000","last_fullsized":"2020-07-16T20:30:29.972715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.956474+0000","last_change":"2020-07-16T20:30:26.576566+0000","last_active":"2020-07-16T20:30:32.956474+0000","last_peered":"2020-07-16T20:30:32.956474+0000","last_clean":"2020-07-16T20:30:32.956474+0000","last_became_active":"2020-07-16T20:30:26.576206+0000","last_became_peered":"2020-07-16T20:30:26.576206+0000","last_unstale":"2020-07-16T20:30:32.956474+0000","last_undegraded":"2020-07-16T20:30:32.956474+0000","last_fullsized":"2020-07-16T20:30:32.956474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964620+0000","last_change":"2020-07-16T20:30:29.963501+0000","last_active":"2020-07-16T20:30:29.964620+0000","last_peered":"2020-07-16T20:30:29.964620+0000","last_clean":"2020-07-16T20:30:29.964620+0000","last_became_active":"2020-07-16T20:30:29.962701+0000","last_became_peered":"2020-07-16T20:30:29.962701+0000","last_unstale":"2020-07-16T20:30:29.964620+0000","last_undegraded":"2020-07-16T20:30:29.964620+0000","last_fullsized":"2020-07-16T20:30:29.964620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960393+0000","last_change":"2020-07-16T20:30:23.563276+0000","last_active":"2020-07-16T20:30:29.960393+0000","last_peered":"2020-07-16T20:30:29.960393+0000","last_clean":"2020-07-16T20:30:29.960393+0000","last_became_active":"2020-07-16T20:30:23.562833+0000","last_became_peered":"2020-07-16T20:30:23.562833+0000","last_unstale":"2020-07-16T20:30:29.960393+0000","last_undegraded":"2020-07-16T20:30:29.960393+0000","last_fullsized":"2020-07-16T20:30:29.960393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.963350+0000","last_change":"2020-07-16T20:30:26.728399+0000","last_active":"2020-07-16T20:30:32.963350+0000","last_peered":"2020-07-16T20:30:32.963350+0000","last_clean":"2020-07-16T20:30:32.963350+0000","last_became_active":"2020-07-16T20:30:26.727822+0000","last_became_peered":"2020-07-16T20:30:26.727822+0000","last_unstale":"2020-07-16T20:30:32.963350+0000","last_undegraded":"2020-07-16T20:30:32.963350+0000","last_fullsized":"2020-07-16T20:30:32.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972314+0000","last_change":"2020-07-16T20:30:29.963087+0000","last_active":"2020-07-16T20:30:29.972314+0000","last_peered":"2020-07-16T20:30:29.972314+0000","last_clean":"2020-07-16T20:30:29.972314+0000","last_became_active":"2020-07-16T20:30:29.962463+0000","last_became_peered":"2020-07-16T20:30:29.962463+0000","last_unstale":"2020-07-16T20:30:29.972314+0000","last_undegraded":"2020-07-16T20:30:29.972314+0000","last_fullsized":"2020-07-16T20:30:29.972314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972497+0000","last_change":"2020-07-16T20:30:23.564311+0000","last_active":"2020-07-16T20:30:29.972497+0000","last_peered":"2020-07-16T20:30:29.972497+0000","last_clean":"2020-07-16T20:30:29.972497+0000","last_became_active":"2020-07-16T20:30:23.563870+0000","last_became_peered":"2020-07-16T20:30:23.563870+0000","last_unstale":"2020-07-16T20:30:29.972497+0000","last_undegraded":"2020-07-16T20:30:29.972497+0000","last_fullsized":"2020-07-16T20:30:29.972497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970024+0000","last_change":"2020-07-16T20:30:18.798690+0000","last_active":"2020-07-16T20:30:29.970024+0000","last_peered":"2020-07-16T20:30:29.970024+0000","last_clean":"2020-07-16T20:30:29.970024+0000","last_became_active":"2020-07-16T20:30:18.798374+0000","last_became_peered":"2020-07-16T20:30:18.798374+0000","last_unstale":"2020-07-16T20:30:29.970024+0000","last_undegraded":"2020-07-16T20:30:29.970024+0000","last_fullsized":"2020-07-16T20:30:29.970024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_clean_scrub_stamp":"2020-07-16T20:30:11.506317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:31.122600+0000","last_change":"2020-07-16T20:30:26.575513+0000","last_active":"2020-07-16T20:30:31.122600+0000","last_peered":"2020-07-16T20:30:31.122600+0000","last_clean":"2020-07-16T20:30:31.122600+0000","last_became_active":"2020-07-16T20:30:26.575008+0000","last_became_peered":"2020-07-16T20:30:26.575008+0000","last_unstale":"2020-07-16T20:30:31.122600+0000","last_undegraded":"2020-07-16T20:30:31.122600+0000","last_fullsized":"2020-07-16T20:30:31.122600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970256+0000","last_change":"2020-07-16T20:30:29.962769+0000","last_active":"2020-07-16T20:30:29.970256+0000","last_peered":"2020-07-16T20:30:29.970256+0000","last_clean":"2020-07-16T20:30:29.970256+0000","last_became_active":"2020-07-16T20:30:29.962094+0000","last_became_peered":"2020-07-16T20:30:29.962094+0000","last_unstale":"2020-07-16T20:30:29.970256+0000","last_undegraded":"2020-07-16T20:30:29.970256+0000","last_fullsized":"2020-07-16T20:30:29.970256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972436+0000","last_change":"2020-07-16T20:30:23.565757+0000","last_active":"2020-07-16T20:30:29.972436+0000","last_peered":"2020-07-16T20:30:29.972436+0000","last_clean":"2020-07-16T20:30:29.972436+0000","last_became_active":"2020-07-16T20:30:23.565340+0000","last_became_peered":"2020-07-16T20:30:23.565340+0000","last_unstale":"2020-07-16T20:30:29.972436+0000","last_undegraded":"2020-07-16T20:30:29.972436+0000","last_fullsized":"2020-07-16T20:30:29.972436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961060+0000","last_change":"2020-07-16T20:30:26.576938+0000","last_active":"2020-07-16T20:30:29.961060+0000","last_peered":"2020-07-16T20:30:29.961060+0000","last_clean":"2020-07-16T20:30:29.961060+0000","last_became_active":"2020-07-16T20:30:26.576529+0000","last_became_peered":"2020-07-16T20:30:26.576529+0000","last_unstale":"2020-07-16T20:30:29.961060+0000","last_undegraded":"2020-07-16T20:30:29.961060+0000","last_fullsized":"2020-07-16T20:30:29.961060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961144+0000","last_change":"2020-07-16T20:30:29.819984+0000","last_active":"2020-07-16T20:30:29.961144+0000","last_peered":"2020-07-16T20:30:29.961144+0000","last_clean":"2020-07-16T20:30:29.961144+0000","last_became_active":"2020-07-16T20:30:29.819257+0000","last_became_peered":"2020-07-16T20:30:29.819257+0000","last_unstale":"2020-07-16T20:30:29.961144+0000","last_undegraded":"2020-07-16T20:30:29.961144+0000","last_fullsized":"2020-07-16T20:30:29.961144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972741+0000","last_change":"2020-07-16T20:30:23.564144+0000","last_active":"2020-07-16T20:30:29.972741+0000","last_peered":"2020-07-16T20:30:29.972741+0000","last_clean":"2020-07-16T20:30:29.972741+0000","last_became_active":"2020-07-16T20:30:23.563690+0000","last_became_peered":"2020-07-16T20:30:23.563690+0000","last_unstale":"2020-07-16T20:30:29.972741+0000","last_undegraded":"2020-07-16T20:30:29.972741+0000","last_fullsized":"2020-07-16T20:30:29.972741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.962719+0000","last_change":"2020-07-16T20:30:26.579571+0000","last_active":"2020-07-16T20:30:32.962719+0000","last_peered":"2020-07-16T20:30:32.962719+0000","last_clean":"2020-07-16T20:30:32.962719+0000","last_became_active":"2020-07-16T20:30:26.579193+0000","last_became_peered":"2020-07-16T20:30:26.579193+0000","last_unstale":"2020-07-16T20:30:32.962719+0000","last_undegraded":"2020-07-16T20:30:32.962719+0000","last_fullsized":"2020-07-16T20:30:32.962719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970842+0000","last_change":"2020-07-16T20:30:29.962943+0000","last_active":"2020-07-16T20:30:29.970842+0000","last_peered":"2020-07-16T20:30:29.970842+0000","last_clean":"2020-07-16T20:30:29.970842+0000","last_became_active":"2020-07-16T20:30:29.962240+0000","last_became_peered":"2020-07-16T20:30:29.962240+0000","last_unstale":"2020-07-16T20:30:29.970842+0000","last_undegraded":"2020-07-16T20:30:29.970842+0000","last_fullsized":"2020-07-16T20:30:29.970842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.961561+0000","last_change":"2020-07-16T20:30:26.578033+0000","last_active":"2020-07-16T20:30:32.961561+0000","last_peered":"2020-07-16T20:30:32.961561+0000","last_clean":"2020-07-16T20:30:32.961561+0000","last_became_active":"2020-07-16T20:30:26.577510+0000","last_became_peered":"2020-07-16T20:30:26.577510+0000","last_unstale":"2020-07-16T20:30:32.961561+0000","last_undegraded":"2020-07-16T20:30:32.961561+0000","last_fullsized":"2020-07-16T20:30:32.961561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.971041+0000","last_change":"2020-07-16T20:30:23.565353+0000","last_active":"2020-07-16T20:30:29.971041+0000","last_peered":"2020-07-16T20:30:29.971041+0000","last_clean":"2020-07-16T20:30:29.971041+0000","last_became_active":"2020-07-16T20:30:23.565031+0000","last_became_peered":"2020-07-16T20:30:23.565031+0000","last_unstale":"2020-07-16T20:30:29.971041+0000","last_undegraded":"2020-07-16T20:30:29.971041+0000","last_fullsized":"2020-07-16T20:30:29.971041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964572+0000","last_change":"2020-07-16T20:30:29.962904+0000","last_active":"2020-07-16T20:30:29.964572+0000","last_peered":"2020-07-16T20:30:29.964572+0000","last_clean":"2020-07-16T20:30:29.964572+0000","last_became_active":"2020-07-16T20:30:29.962274+0000","last_became_peered":"2020-07-16T20:30:29.962274+0000","last_unstale":"2020-07-16T20:30:29.964572+0000","last_undegraded":"2020-07-16T20:30:29.964572+0000","last_fullsized":"2020-07-16T20:30:29.964572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972529+0000","last_change":"2020-07-16T20:30:23.565324+0000","last_active":"2020-07-16T20:30:29.972529+0000","last_peered":"2020-07-16T20:30:29.972529+0000","last_clean":"2020-07-16T20:30:29.972529+0000","last_became_active":"2020-07-16T20:30:23.564073+0000","last_became_peered":"2020-07-16T20:30:23.564073+0000","last_unstale":"2020-07-16T20:30:29.972529+0000","last_undegraded":"2020-07-16T20:30:29.972529+0000","last_fullsized":"2020-07-16T20:30:29.972529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.958525+0000","last_change":"2020-07-16T20:30:26.728247+0000","last_active":"2020-07-16T20:30:32.958525+0000","last_peered":"2020-07-16T20:30:32.958525+0000","last_clean":"2020-07-16T20:30:32.958525+0000","last_became_active":"2020-07-16T20:30:26.727617+0000","last_became_peered":"2020-07-16T20:30:26.727617+0000","last_unstale":"2020-07-16T20:30:32.958525+0000","last_undegraded":"2020-07-16T20:30:32.958525+0000","last_fullsized":"2020-07-16T20:30:32.958525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":112820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":110744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.784}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":111125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}]}} 2020-07-16T20:30:40.106 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:30:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.220+0000 7f2c6d4bc700 1 Processor -- start 2020-07-16T20:30:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.220+0000 7f2c6d4bc700 1 -- start start 2020-07-16T20:30:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c6d4bc700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c6d4bc700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c6d4bc700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c680b5c20 con 0x7f2c680b3b30 2020-07-16T20:30:40.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c6d4bc700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680ae6f0 con 0x7f2c68142b10 2020-07-16T20:30:40.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c6d4bc700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68143460 con 0x7f2c680b4fb0 2020-07-16T20:30:40.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c667fc700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:44966/0 (socket says 172.21.15.22:44966) 2020-07-16T20:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c677fe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2c680b3b30 0x7f2c680b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42196/0 (socket says 172.21.15.22:42196) 2020-07-16T20:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 -- 172.21.15.22:0/3460788040 learned_addr learned my addr 172.21.15.22:0/3460788040 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 -- 172.21.15.22:0/3460788040 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 msgr2=0x7f2c68142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 --2- 172.21.15.22:0/3460788040 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 -- 172.21.15.22:0/3460788040 >> v1:172.21.15.116:6789/0 conn(0x7f2c680b3b30 legacy=0x7f2c680b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 -- 172.21.15.22:0/3460788040 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68060520 con 0x7f2c680b4fb0 2020-07-16T20:30:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.221+0000 7f2c66ffd700 1 --2- 172.21.15.22:0/3460788040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2c5c002f30 tx=0x7f2c5c006e90).ready entity=mon.2 client_cookie=b81d778c4cb43e29 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c65ffb700 1 -- 172.21.15.22:0/3460788040 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c009850 con 0x7f2c680b4fb0 2020-07-16T20:30:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c65ffb700 1 -- 172.21.15.22:0/3460788040 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c0099b0 con 0x7f2c680b4fb0 2020-07-16T20:30:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c65ffb700 1 -- 172.21.15.22:0/3460788040 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c009d10 con 0x7f2c680b4fb0 2020-07-16T20:30:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/3460788040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 msgr2=0x7f2c68060030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/3460788040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2c5c002f30 tx=0x7f2c5c006e90).stop 2020-07-16T20:30:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/3460788040 shutdown_connections 2020-07-16T20:30:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/3460788040 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b4fb0 0x7f2c68060030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/3460788040 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/3460788040 >> 172.21.15.22:0/3460788040 conn(0x7f2c680b9530 msgr2=0x7f2c680b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/3460788040 shutdown_connections 2020-07-16T20:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.222+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/3460788040 wait complete. 2020-07-16T20:30:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.223+0000 7f2c6d4bc700 1 Processor -- start 2020-07-16T20:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.223+0000 7f2c6d4bc700 1 -- start start 2020-07-16T20:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c6d4bc700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 0x7f2c68157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c6d4bc700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c6d4bc700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c68062710 con 0x7f2c68140470 2020-07-16T20:30:40.236 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c6d4bc700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c680629b0 con 0x7f2c68142b10 2020-07-16T20:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c6d4bc700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68062c50 con 0x7f2c680b3b30 2020-07-16T20:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c677fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2c68140470 0x7f2c6813b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39856/0 (socket says 172.21.15.22:39856) 2020-07-16T20:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c677fe700 1 -- 172.21.15.22:0/4130110108 learned_addr learned my addr 172.21.15.22:0/4130110108 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c66ffd700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 0x7f2c68157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.224+0000 7f2c667fc700 1 --2- 172.21.15.22:0/4130110108 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155573697 0 0) 0x7f2c68062710 con 0x7f2c68140470 2020-07-16T20:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c44003240 con 0x7f2c68140470 2020-07-16T20:30:40.238 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1110342147 0 0) 0x7f2c44003240 con 0x7f2c68140470 2020-07-16T20:30:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c66ffd700 1 -- 172.21.15.22:0/4130110108 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 msgr2=0x7f2c68141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c66ffd700 1 --2- 172.21.15.22:0/4130110108 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c66ffd700 1 -- 172.21.15.22:0/4130110108 >> v1:172.21.15.22:6789/0 conn(0x7f2c68140470 legacy=0x7f2c6813b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c66ffd700 1 -- 172.21.15.22:0/4130110108 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68157a40 con 0x7f2c680b3b30 2020-07-16T20:30:40.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c66ffd700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 0x7f2c68157550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2c60001d50 tx=0x7f2c5c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c60001bb0 con 0x7f2c680b3b30 2020-07-16T20:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c01e460 con 0x7f2c680b3b30 2020-07-16T20:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c5c009d90 con 0x7f2c680b3b30 2020-07-16T20:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c681424b0 con 0x7f2c680b3b30 2020-07-16T20:30:40.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.225+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6813e790 con 0x7f2c680b3b30 2020-07-16T20:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.226+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6805f320 con 0x7f2c680b3b30 2020-07-16T20:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.226+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2c5c025030 con 0x7f2c680b3b30 2020-07-16T20:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.227+0000 7f2c4effd700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 0x7f2c440527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.227+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2c5c068e30 con 0x7f2c680b3b30 2020-07-16T20:30:40.242 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.227+0000 7f2c667fc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 0x7f2c440527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.227+0000 7f2c667fc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 0x7f2c440527f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2c58008000 tx=0x7f2c58008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.231+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f2c5c0415c0 con 0x7f2c680b3b30 2020-07-16T20:30:40.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.382+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c68043fd0 con 0x7f2c44050330 2020-07-16T20:30:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.385+0000 7f2c4effd700 1 -- 172.21.15.22:0/4130110108 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82442 (secure 0 0 0) 0x7f2c68043fd0 con 0x7f2c44050330 2020-07-16T20:30:40.388 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:40.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 msgr2=0x7f2c440527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 0x7f2c440527f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f2c58008000 tx=0x7f2c58008040).stop 2020-07-16T20:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 msgr2=0x7f2c68157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 0x7f2c68157550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2c60001d50 tx=0x7f2c5c015000).stop 2020-07-16T20:30:40.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 shutdown_connections 2020-07-16T20:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2c44050330 0x7f2c440527f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/4130110108 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2c680b3b30 0x7f2c68157550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 --2- 172.21.15.22:0/4130110108 >> v2:172.21.15.116:3300/0 conn(0x7f2c68142b10 0x7f2c68141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 >> 172.21.15.22:0/4130110108 conn(0x7f2c680b9530 msgr2=0x7f2c680b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.386+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 shutdown_connections 2020-07-16T20:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.387+0000 7f2c6d4bc700 1 -- 172.21.15.22:0/4130110108 wait complete. 2020-07-16T20:30:40.392 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2020-07-16T20:30:40.403 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2020-07-16T20:30:39.329976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":889008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.371062"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960978+0000","last_change":"2020-07-16T20:30:29.590733+0000","last_active":"2020-07-16T20:30:29.960978+0000","last_peered":"2020-07-16T20:30:29.960978+0000","last_clean":"2020-07-16T20:30:29.960978+0000","last_became_active":"2020-07-16T20:30:29.590030+0000","last_became_peered":"2020-07-16T20:30:29.590030+0000","last_unstale":"2020-07-16T20:30:29.960978+0000","last_undegraded":"2020-07-16T20:30:29.960978+0000","last_fullsized":"2020-07-16T20:30:29.960978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970487+0000","last_change":"2020-07-16T20:30:23.564026+0000","last_active":"2020-07-16T20:30:29.970487+0000","last_peered":"2020-07-16T20:30:29.970487+0000","last_clean":"2020-07-16T20:30:29.970487+0000","last_became_active":"2020-07-16T20:30:23.563591+0000","last_became_peered":"2020-07-16T20:30:23.563591+0000","last_unstale":"2020-07-16T20:30:29.970487+0000","last_undegraded":"2020-07-16T20:30:29.970487+0000","last_fullsized":"2020-07-16T20:30:29.970487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.959365+0000","last_change":"2020-07-16T20:30:26.577657+0000","last_active":"2020-07-16T20:30:32.959365+0000","last_peered":"2020-07-16T20:30:32.959365+0000","last_clean":"2020-07-16T20:30:32.959365+0000","last_became_active":"2020-07-16T20:30:26.577264+0000","last_became_peered":"2020-07-16T20:30:26.577264+0000","last_unstale":"2020-07-16T20:30:32.959365+0000","last_undegraded":"2020-07-16T20:30:32.959365+0000","last_fullsized":"2020-07-16T20:30:32.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961017+0000","last_change":"2020-07-16T20:30:29.819730+0000","last_active":"2020-07-16T20:30:29.961017+0000","last_peered":"2020-07-16T20:30:29.961017+0000","last_clean":"2020-07-16T20:30:29.961017+0000","last_became_active":"2020-07-16T20:30:29.819079+0000","last_became_peered":"2020-07-16T20:30:29.819079+0000","last_unstale":"2020-07-16T20:30:29.961017+0000","last_undegraded":"2020-07-16T20:30:29.961017+0000","last_fullsized":"2020-07-16T20:30:29.961017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972715+0000","last_change":"2020-07-16T20:30:23.565160+0000","last_active":"2020-07-16T20:30:29.972715+0000","last_peered":"2020-07-16T20:30:29.972715+0000","last_clean":"2020-07-16T20:30:29.972715+0000","last_became_active":"2020-07-16T20:30:23.564708+0000","last_became_peered":"2020-07-16T20:30:23.564708+0000","last_unstale":"2020-07-16T20:30:29.972715+0000","last_undegraded":"2020-07-16T20:30:29.972715+0000","last_fullsized":"2020-07-16T20:30:29.972715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.956474+0000","last_change":"2020-07-16T20:30:26.576566+0000","last_active":"2020-07-16T20:30:32.956474+0000","last_peered":"2020-07-16T20:30:32.956474+0000","last_clean":"2020-07-16T20:30:32.956474+0000","last_became_active":"2020-07-16T20:30:26.576206+0000","last_became_peered":"2020-07-16T20:30:26.576206+0000","last_unstale":"2020-07-16T20:30:32.956474+0000","last_undegraded":"2020-07-16T20:30:32.956474+0000","last_fullsized":"2020-07-16T20:30:32.956474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964620+0000","last_change":"2020-07-16T20:30:29.963501+0000","last_active":"2020-07-16T20:30:29.964620+0000","last_peered":"2020-07-16T20:30:29.964620+0000","last_clean":"2020-07-16T20:30:29.964620+0000","last_became_active":"2020-07-16T20:30:29.962701+0000","last_became_peered":"2020-07-16T20:30:29.962701+0000","last_unstale":"2020-07-16T20:30:29.964620+0000","last_undegraded":"2020-07-16T20:30:29.964620+0000","last_fullsized":"2020-07-16T20:30:29.964620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960393+0000","last_change":"2020-07-16T20:30:23.563276+0000","last_active":"2020-07-16T20:30:29.960393+0000","last_peered":"2020-07-16T20:30:29.960393+0000","last_clean":"2020-07-16T20:30:29.960393+0000","last_became_active":"2020-07-16T20:30:23.562833+0000","last_became_peered":"2020-07-16T20:30:23.562833+0000","last_unstale":"2020-07-16T20:30:29.960393+0000","last_undegraded":"2020-07-16T20:30:29.960393+0000","last_fullsized":"2020-07-16T20:30:29.960393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.963350+0000","last_change":"2020-07-16T20:30:26.728399+0000","last_active":"2020-07-16T20:30:32.963350+0000","last_peered":"2020-07-16T20:30:32.963350+0000","last_clean":"2020-07-16T20:30:32.963350+0000","last_became_active":"2020-07-16T20:30:26.727822+0000","last_became_peered":"2020-07-16T20:30:26.727822+0000","last_unstale":"2020-07-16T20:30:32.963350+0000","last_undegraded":"2020-07-16T20:30:32.963350+0000","last_fullsized":"2020-07-16T20:30:32.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972314+0000","last_change":"2020-07-16T20:30:29.963087+0000","last_active":"2020-07-16T20:30:29.972314+0000","last_peered":"2020-07-16T20:30:29.972314+0000","last_clean":"2020-07-16T20:30:29.972314+0000","last_became_active":"2020-07-16T20:30:29.962463+0000","last_became_peered":"2020-07-16T20:30:29.962463+0000","last_unstale":"2020-07-16T20:30:29.972314+0000","last_undegraded":"2020-07-16T20:30:29.972314+0000","last_fullsized":"2020-07-16T20:30:29.972314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972497+0000","last_change":"2020-07-16T20:30:23.564311+0000","last_active":"2020-07-16T20:30:29.972497+0000","last_peered":"2020-07-16T20:30:29.972497+0000","last_clean":"2020-07-16T20:30:29.972497+0000","last_became_active":"2020-07-16T20:30:23.563870+0000","last_became_peered":"2020-07-16T20:30:23.563870+0000","last_unstale":"2020-07-16T20:30:29.972497+0000","last_undegraded":"2020-07-16T20:30:29.972497+0000","last_fullsized":"2020-07-16T20:30:29.972497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970024+0000","last_change":"2020-07-16T20:30:18.798690+0000","last_active":"2020-07-16T20:30:29.970024+0000","last_peered":"2020-07-16T20:30:29.970024+0000","last_clean":"2020-07-16T20:30:29.970024+0000","last_became_active":"2020-07-16T20:30:18.798374+0000","last_became_peered":"2020-07-16T20:30:18.798374+0000","last_unstale":"2020-07-16T20:30:29.970024+0000","last_undegraded":"2020-07-16T20:30:29.970024+0000","last_fullsized":"2020-07-16T20:30:29.970024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_clean_scrub_stamp":"2020-07-16T20:30:11.506317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:31.122600+0000","last_change":"2020-07-16T20:30:26.575513+0000","last_active":"2020-07-16T20:30:31.122600+0000","last_peered":"2020-07-16T20:30:31.122600+0000","last_clean":"2020-07-16T20:30:31.122600+0000","last_became_active":"2020-07-16T20:30:26.575008+0000","last_became_peered":"2020-07-16T20:30:26.575008+0000","last_unstale":"2020-07-16T20:30:31.122600+0000","last_undegraded":"2020-07-16T20:30:31.122600+0000","last_fullsized":"2020-07-16T20:30:31.122600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970256+0000","last_change":"2020-07-16T20:30:29.962769+0000","last_active":"2020-07-16T20:30:29.970256+0000","last_peered":"2020-07-16T20:30:29.970256+0000","last_clean":"2020-07-16T20:30:29.970256+0000","last_became_active":"2020-07-16T20:30:29.962094+0000","last_became_peered":"2020-07-16T20:30:29.962094+0000","last_unstale":"2020-07-16T20:30:29.970256+0000","last_undegraded":"2020-07-16T20:30:29.970256+0000","last_fullsized":"2020-07-16T20:30:29.970256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972436+0000","last_change":"2020-07-16T20:30:23.565757+0000","last_active":"2020-07-16T20:30:29.972436+0000","last_peered":"2020-07-16T20:30:29.972436+0000","last_clean":"2020-07-16T20:30:29.972436+0000","last_became_active":"2020-07-16T20:30:23.565340+0000","last_became_peered":"2020-07-16T20:30:23.565340+0000","last_unstale":"2020-07-16T20:30:29.972436+0000","last_undegraded":"2020-07-16T20:30:29.972436+0000","last_fullsized":"2020-07-16T20:30:29.972436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961060+0000","last_change":"2020-07-16T20:30:26.576938+0000","last_active":"2020-07-16T20:30:29.961060+0000","last_peered":"2020-07-16T20:30:29.961060+0000","last_clean":"2020-07-16T20:30:29.961060+0000","last_became_active":"2020-07-16T20:30:26.576529+0000","last_became_peered":"2020-07-16T20:30:26.576529+0000","last_unstale":"2020-07-16T20:30:29.961060+0000","last_undegraded":"2020-07-16T20:30:29.961060+0000","last_fullsized":"2020-07-16T20:30:29.961060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961144+0000","last_change":"2020-07-16T20:30:29.819984+0000","last_active":"2020-07-16T20:30:29.961144+0000","last_peered":"2020-07-16T20:30:29.961144+0000","last_clean":"2020-07-16T20:30:29.961144+0000","last_became_active":"2020-07-16T20:30:29.819257+0000","last_became_peered":"2020-07-16T20:30:29.819257+0000","last_unstale":"2020-07-16T20:30:29.961144+0000","last_undegraded":"2020-07-16T20:30:29.961144+0000","last_fullsized":"2020-07-16T20:30:29.961144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972741+0000","last_change":"2020-07-16T20:30:23.564144+0000","last_active":"2020-07-16T20:30:29.972741+0000","last_peered":"2020-07-16T20:30:29.972741+0000","last_clean":"2020-07-16T20:30:29.972741+0000","last_became_active":"2020-07-16T20:30:23.563690+0000","last_became_peered":"2020-07-16T20:30:23.563690+0000","last_unstale":"2020-07-16T20:30:29.972741+0000","last_undegraded":"2020-07-16T20:30:29.972741+0000","last_fullsized":"2020-07-16T20:30:29.972741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.962719+0000","last_change":"2020-07-16T20:30:26.579571+0000","last_active":"2020-07-16T20:30:32.962719+0000","last_peered":"2020-07-16T20:30:32.962719+0000","last_clean":"2020-07-16T20:30:32.962719+0000","last_became_active":"2020-07-16T20:30:26.579193+0000","last_became_peered":"2020-07-16T20:30:26.579193+0000","last_unstale":"2020-07-16T20:30:32.962719+0000","last_undegraded":"2020-07-16T20:30:32.962719+0000","last_fullsized":"2020-07-16T20:30:32.962719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970842+0000","last_change":"2020-07-16T20:30:29.962943+0000","last_active":"2020-07-16T20:30:29.970842+0000","last_peered":"2020-07-16T20:30:29.970842+0000","last_clean":"2020-07-16T20:30:29.970842+0000","last_became_active":"2020-07-16T20:30:29.962240+0000","last_became_peered":"2020-07-16T20:30:29.962240+0000","last_unstale":"2020-07-16T20:30:29.970842+0000","last_undegraded":"2020-07-16T20:30:29.970842+0000","last_fullsized":"2020-07-16T20:30:29.970842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.961561+0000","last_change":"2020-07-16T20:30:26.578033+0000","last_active":"2020-07-16T20:30:32.961561+0000","last_peered":"2020-07-16T20:30:32.961561+0000","last_clean":"2020-07-16T20:30:32.961561+0000","last_became_active":"2020-07-16T20:30:26.577510+0000","last_became_peered":"2020-07-16T20:30:26.577510+0000","last_unstale":"2020-07-16T20:30:32.961561+0000","last_undegraded":"2020-07-16T20:30:32.961561+0000","last_fullsized":"2020-07-16T20:30:32.961561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.971041+0000","last_change":"2020-07-16T20:30:23.565353+0000","last_active":"2020-07-16T20:30:29.971041+0000","last_peered":"2020-07-16T20:30:29.971041+0000","last_clean":"2020-07-16T20:30:29.971041+0000","last_became_active":"2020-07-16T20:30:23.565031+0000","last_became_peered":"2020-07-16T20:30:23.565031+0000","last_unstale":"2020-07-16T20:30:29.971041+0000","last_undegraded":"2020-07-16T20:30:29.971041+0000","last_fullsized":"2020-07-16T20:30:29.971041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964572+0000","last_change":"2020-07-16T20:30:29.962904+0000","last_active":"2020-07-16T20:30:29.964572+0000","last_peered":"2020-07-16T20:30:29.964572+0000","last_clean":"2020-07-16T20:30:29.964572+0000","last_became_active":"2020-07-16T20:30:29.962274+0000","last_became_peered":"2020-07-16T20:30:29.962274+0000","last_unstale":"2020-07-16T20:30:29.964572+0000","last_undegraded":"2020-07-16T20:30:29.964572+0000","last_fullsized":"2020-07-16T20:30:29.964572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972529+0000","last_change":"2020-07-16T20:30:23.565324+0000","last_active":"2020-07-16T20:30:29.972529+0000","last_peered":"2020-07-16T20:30:29.972529+0000","last_clean":"2020-07-16T20:30:29.972529+0000","last_became_active":"2020-07-16T20:30:23.564073+0000","last_became_peered":"2020-07-16T20:30:23.564073+0000","last_unstale":"2020-07-16T20:30:29.972529+0000","last_undegraded":"2020-07-16T20:30:29.972529+0000","last_fullsized":"2020-07-16T20:30:29.972529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.958525+0000","last_change":"2020-07-16T20:30:26.728247+0000","last_active":"2020-07-16T20:30:32.958525+0000","last_peered":"2020-07-16T20:30:32.958525+0000","last_clean":"2020-07-16T20:30:32.958525+0000","last_became_active":"2020-07-16T20:30:26.727617+0000","last_became_peered":"2020-07-16T20:30:26.727617+0000","last_unstale":"2020-07-16T20:30:32.958525+0000","last_undegraded":"2020-07-16T20:30:32.958525+0000","last_fullsized":"2020-07-16T20:30:32.958525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":112820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.135}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7230000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":110744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.784}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":111125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.52}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}]}} 2020-07-16T20:30:40.406 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-07-16T20:30:40.407 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-07-16T20:30:40.407 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-07-16T20:30:40.407 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-07-16T20:30:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.520+0000 7f0b68ecc700 1 Processor -- start 2020-07-16T20:30:40.522 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.520+0000 7f0b68ecc700 1 -- start start 2020-07-16T20:30:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b68ecc700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b64147e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.525 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b68ecc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b641412b0 0x7f0b640605f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b68ecc700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b64147780 con 0x7f0b64060ae0 2020-07-16T20:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b68ecc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640b5c30 con 0x7f0b641412b0 2020-07-16T20:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b68ecc700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6405c550 con 0x7f0b6409dde0 2020-07-16T20:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b61d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b641412b0 0x7f0b640605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.526 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b62d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0b64060ae0 0x7f0b64143ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39864/0 (socket says 172.21.15.22:39864) 2020-07-16T20:30:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b62d9d700 1 -- 172.21.15.22:0/3945250169 learned_addr learned my addr 172.21.15.22:0/3945250169 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.521+0000 7f0b6259c700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b64147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b6159a700 1 -- 172.21.15.22:0/3945250169 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541934383 0 0) 0x7f0b64147780 con 0x7f0b64060ae0 2020-07-16T20:30:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b6159a700 1 -- 172.21.15.22:0/3945250169 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b44003240 con 0x7f0b64060ae0 2020-07-16T20:30:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b61d9b700 1 -- 172.21.15.22:0/3945250169 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 msgr2=0x7f0b64147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b61d9b700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b64147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b61d9b700 1 -- 172.21.15.22:0/3945250169 >> v1:172.21.15.22:6789/0 conn(0x7f0b64060ae0 legacy=0x7f0b64143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b61d9b700 1 -- 172.21.15.22:0/3945250169 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b641479e0 con 0x7f0b641412b0 2020-07-16T20:30:40.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b61d9b700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b641412b0 0x7f0b640605f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0b54002f30 tx=0x7f0b54006dd0).ready entity=mon.0 client_cookie=b102272d44ae5e69 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b6159a700 1 -- 172.21.15.22:0/3945250169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b540096a0 con 0x7f0b641412b0 2020-07-16T20:30:40.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b6159a700 1 -- 172.21.15.22:0/3945250169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b54009800 con 0x7f0b641412b0 2020-07-16T20:30:40.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b6159a700 1 -- 172.21.15.22:0/3945250169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b54009b60 con 0x7f0b641412b0 2020-07-16T20:30:40.530 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 -- 172.21.15.22:0/3945250169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b641412b0 msgr2=0x7f0b640605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.530 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b641412b0 0x7f0b640605f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f0b54002f30 tx=0x7f0b54006dd0).stop 2020-07-16T20:30:40.530 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 -- 172.21.15.22:0/3945250169 shutdown_connections 2020-07-16T20:30:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b64147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/3945250169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b641412b0 0x7f0b640605f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 -- 172.21.15.22:0/3945250169 >> 172.21.15.22:0/3945250169 conn(0x7f0b640b6bb0 msgr2=0x7f0b6405b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 -- 172.21.15.22:0/3945250169 shutdown_connections 2020-07-16T20:30:40.532 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.522+0000 7f0b68ecc700 1 -- 172.21.15.22:0/3945250169 wait complete. 2020-07-16T20:30:40.534 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.523+0000 7f0b68ecc700 1 Processor -- start 2020-07-16T20:30:40.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 -- start start 2020-07-16T20:30:40.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b640664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b64067400 0x7f0b640628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b640b0e60 con 0x7f0b64060ae0 2020-07-16T20:30:40.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b640b1100 con 0x7f0b64067400 2020-07-16T20:30:40.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b68ecc700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b640b13a0 con 0x7f0b6409dde0 2020-07-16T20:30:40.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b62d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b64067400 0x7f0b640628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b62d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b64067400 0x7f0b640628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39162/0 (socket says 172.21.15.22:39162) 2020-07-16T20:30:40.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.524+0000 7f0b62d9d700 1 -- 172.21.15.22:0/91078461 learned_addr learned my addr 172.21.15.22:0/91078461 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:40.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b61d9b700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b640664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b62d9d700 1 -- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 msgr2=0x7f0b640664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b62d9d700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b640664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b62d9d700 1 -- 172.21.15.22:0/91078461 >> v1:172.21.15.116:6789/0 conn(0x7f0b64060ae0 legacy=0x7f0b64145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b62d9d700 1 -- 172.21.15.22:0/91078461 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640b0ae0 con 0x7f0b64067400 2020-07-16T20:30:40.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b62d9d700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b64067400 0x7f0b640628b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0b640b1720 tx=0x7f0b5c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c005b80 con 0x7f0b64067400 2020-07-16T20:30:40.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c005ce0 con 0x7f0b64067400 2020-07-16T20:30:40.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b64062da0 con 0x7f0b64067400 2020-07-16T20:30:40.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b5c007300 con 0x7f0b64067400 2020-07-16T20:30:40.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.525+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6413ecf0 con 0x7f0b64067400 2020-07-16T20:30:40.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.526+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6405f320 con 0x7f0b64067400 2020-07-16T20:30:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.526+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f0b5c010030 con 0x7f0b64067400 2020-07-16T20:30:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.526+0000 7f0b5a7fc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 0x7f0b40052520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.526+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f0b5c067cb0 con 0x7f0b64067400 2020-07-16T20:30:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.526+0000 7f0b6259c700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 0x7f0b40052520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.540 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.527+0000 7f0b6259c700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 0x7f0b40052520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0b4c00c000 tx=0x7f0b4c006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.541 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.530+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f0b5c040440 con 0x7f0b64067400 2020-07-16T20:30:40.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.743+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0b640b1510 con 0x7f0b64067400 2020-07-16T20:30:40.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.743+0000 7f0b5a7fc700 1 -- 172.21.15.22:0/91078461 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f0b5c043a60 con 0x7f0b64067400 2020-07-16T20:30:40.745 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:40.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 msgr2=0x7f0b40052520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 0x7f0b40052520 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f0b4c00c000 tx=0x7f0b4c006dd0).stop 2020-07-16T20:30:40.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b64067400 msgr2=0x7f0b640628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.747 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b64067400 0x7f0b640628b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0b640b1720 tx=0x7f0b5c007d40).stop 2020-07-16T20:30:40.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 shutdown_connections 2020-07-16T20:30:40.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f0b40050060 0x7f0b40052520 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.748 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b64067400 0x7f0b640628b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 --2- 172.21.15.22:0/91078461 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0b6409dde0 0x7f0b640664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.744+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 >> 172.21.15.22:0/91078461 conn(0x7f0b640b6bb0 msgr2=0x7f0b64140b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.745+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 shutdown_connections 2020-07-16T20:30:40.749 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.745+0000 7f0b68ecc700 1 -- 172.21.15.22:0/91078461 wait complete. 2020-07-16T20:30:40.756 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-07-16T20:30:40.757 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-07-16T20:30:40.758 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.871+0000 7ff570723700 1 Processor -- start 2020-07-16T20:30:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.871+0000 7ff570723700 1 -- start start 2020-07-16T20:30:40.882 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff570723700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff56809e050 0x7ff568144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff570723700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff568144780 0x7ff5680b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.883 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff570723700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff568147ed0 con 0x7ff56809dc70 2020-07-16T20:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff570723700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff568148170 con 0x7ff56809e050 2020-07-16T20:30:40.884 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff570723700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56809cb10 con 0x7ff568144780 2020-07-16T20:30:40.885 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff56dcbe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff56809e050 0x7ff568144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.885 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff56dcbe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff56809e050 0x7ff568144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39170/0 (socket says 172.21.15.22:39170) 2020-07-16T20:30:40.886 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff56e4bf700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff56809dc70 0x7ff5681475c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39874/0 (socket says 172.21.15.22:39874) 2020-07-16T20:30:40.886 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.872+0000 7ff56dcbe700 1 -- 172.21.15.22:0/3970146280 learned_addr learned my addr 172.21.15.22:0/3970146280 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:40.886 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56ecc0700 1 --2- 172.21.15.22:0/3970146280 >> v2:172.21.15.116:3300/0 conn(0x7ff568144780 0x7ff5680b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.887 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56dcbe700 1 -- 172.21.15.22:0/3970146280 >> v2:172.21.15.116:3300/0 conn(0x7ff568144780 msgr2=0x7ff5680b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:40.887 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56dcbe700 1 --2- 172.21.15.22:0/3970146280 >> v2:172.21.15.116:3300/0 conn(0x7ff568144780 0x7ff5680b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.888 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56dcbe700 1 -- 172.21.15.22:0/3970146280 >> v1:172.21.15.22:6789/0 conn(0x7ff56809dc70 legacy=0x7ff5681475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.888 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56d4bd700 1 -- 172.21.15.22:0/3970146280 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977136409 0 0) 0x7ff568147ed0 con 0x7ff56809dc70 2020-07-16T20:30:40.889 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56dcbe700 1 -- 172.21.15.22:0/3970146280 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56809cc50 con 0x7ff56809e050 2020-07-16T20:30:40.889 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56dcbe700 1 --2- 172.21.15.22:0/3970146280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56809e050 0x7ff568144290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff564002f30 tx=0x7ff564006e90).ready entity=mon.0 client_cookie=616352c97a14753d server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.890 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56d4bd700 1 -- 172.21.15.22:0/3970146280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff564009850 con 0x7ff56809e050 2020-07-16T20:30:40.891 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56d4bd700 1 -- 172.21.15.22:0/3970146280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5640099b0 con 0x7ff56809e050 2020-07-16T20:30:40.891 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff56d4bd700 1 -- 172.21.15.22:0/3970146280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff564009d10 con 0x7ff56809e050 2020-07-16T20:30:40.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 -- 172.21.15.22:0/3970146280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56809e050 msgr2=0x7ff568144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 --2- 172.21.15.22:0/3970146280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56809e050 0x7ff568144290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff564002f30 tx=0x7ff564006e90).stop 2020-07-16T20:30:40.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 -- 172.21.15.22:0/3970146280 shutdown_connections 2020-07-16T20:30:40.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 --2- 172.21.15.22:0/3970146280 >> v2:172.21.15.116:3300/0 conn(0x7ff568144780 0x7ff5680b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 --2- 172.21.15.22:0/3970146280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff56809e050 0x7ff568144290 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 -- 172.21.15.22:0/3970146280 >> 172.21.15.22:0/3970146280 conn(0x7ff5680b9530 msgr2=0x7ff5680b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:40.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 -- 172.21.15.22:0/3970146280 shutdown_connections 2020-07-16T20:30:40.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.873+0000 7ff570723700 1 -- 172.21.15.22:0/3970146280 wait complete. 2020-07-16T20:30:40.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 Processor -- start 2020-07-16T20:30:40.895 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 -- start start 2020-07-16T20:30:40.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff56809dc70 0x7ff568134ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.896 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680b8be0 con 0x7ff568144780 2020-07-16T20:30:40.897 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680b8e80 con 0x7ff56809dc70 2020-07-16T20:30:40.897 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.875+0000 7ff570723700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b7a50 con 0x7ff56813eda0 2020-07-16T20:30:40.898 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.898 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56e4bf700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff56809dc70 0x7ff568134ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.898 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56dcbe700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7ff568144780 0x7ff56813e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42232/0 (socket says 172.21.15.22:42232) 2020-07-16T20:30:40.899 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56dcbe700 1 -- 172.21.15.22:0/3804429089 learned_addr learned my addr 172.21.15.22:0/3804429089 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:40.899 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:45004/0 (socket says 172.21.15.22:45004) 2020-07-16T20:30:40.899 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 -- 172.21.15.22:0/3804429089 >> v2:172.21.15.116:3300/0 conn(0x7ff56809dc70 msgr2=0x7ff568134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.900 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 --2- 172.21.15.22:0/3804429089 >> v2:172.21.15.116:3300/0 conn(0x7ff56809dc70 0x7ff568134ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:40.900 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 -- 172.21.15.22:0/3804429089 >> v1:172.21.15.116:6789/0 conn(0x7ff568144780 legacy=0x7ff56813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 -- 172.21.15.22:0/3804429089 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680b7bc0 con 0x7ff56813eda0 2020-07-16T20:30:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff56ecc0700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff56000a000 tx=0x7ff560008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.901 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560009980 con 0x7ff56813eda0 2020-07-16T20:30:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff560009ae0 con 0x7ff56813eda0 2020-07-16T20:30:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680b69e0 con 0x7ff56813eda0 2020-07-16T20:30:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff560009e40 con 0x7ff56813eda0 2020-07-16T20:30:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.876+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5680b6f30 con 0x7ff56813eda0 2020-07-16T20:30:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.877+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5680b8a40 con 0x7ff56813eda0 2020-07-16T20:30:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.878+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff560013480 con 0x7ff56813eda0 2020-07-16T20:30:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.878+0000 7ff55a7fc700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 0x7ff5400524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.878+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff560068620 con 0x7ff56813eda0 2020-07-16T20:30:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.878+0000 7ff56e4bf700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 0x7ff5400524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.878+0000 7ff56e4bf700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 0x7ff5400524a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff55c00d000 tx=0x7ff55c0079c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:40.882+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff5680b8a40 con 0x7ff56813eda0 2020-07-16T20:30:41.044 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.043+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5680b8a40 con 0x7ff56813eda0 2020-07-16T20:30:41.045 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.044+0000 7ff55a7fc700 1 -- 172.21.15.22:0/3804429089 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7ff5680b8a40 con 0x7ff56813eda0 2020-07-16T20:30:41.046 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:41.046 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:41.048 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 msgr2=0x7ff5400524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.049 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 0x7ff5400524a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff55c00d000 tx=0x7ff55c0079c0).stop 2020-07-16T20:30:41.049 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 msgr2=0x7ff568137130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.049 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff56000a000 tx=0x7ff560008040).stop 2020-07-16T20:30:41.050 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 shutdown_connections 2020-07-16T20:30:41.050 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff54004ffe0 0x7ff5400524a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.050 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 --2- 172.21.15.22:0/3804429089 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff56813eda0 0x7ff568137130 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.051 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 --2- 172.21.15.22:0/3804429089 >> v2:172.21.15.116:3300/0 conn(0x7ff56809dc70 0x7ff568134ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.051 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 >> 172.21.15.22:0/3804429089 conn(0x7ff5680b9530 msgr2=0x7ff5680b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.051 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 shutdown_connections 2020-07-16T20:30:41.052 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.045+0000 7ff570723700 1 -- 172.21.15.22:0/3804429089 wait complete. 2020-07-16T20:30:41.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:11.371623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:21.693414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:25.164093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:27.610215+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:30:41.059 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:41.180 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.176+0000 7f93a1b22700 1 Processor -- start 2020-07-16T20:30:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.176+0000 7f93a1b22700 1 -- start start 2020-07-16T20:30:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f93a1b22700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f939c060200 0x7f939c05ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f93a1b22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c0b0870 0x7f939c0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.181 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f93a1b22700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c0b1340 con 0x7f939c148860 2020-07-16T20:30:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f93a1b22700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0b15a0 con 0x7f939c0b0870 2020-07-16T20:30:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f93a1b22700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0606a0 con 0x7f939c060200 2020-07-16T20:30:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f939affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c0b0870 0x7f939c0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f939affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c0b0870 0x7f939c0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39182/0 (socket says 172.21.15.22:39182) 2020-07-16T20:30:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f939affd700 1 -- 172.21.15.22:0/3144207780 learned_addr learned my addr 172.21.15.22:0/3144207780 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.177+0000 7f939b7fe700 1 --2- 172.21.15.22:0/3144207780 >> v2:172.21.15.116:3300/0 conn(0x7f939c060200 0x7f939c05ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939affd700 1 -- 172.21.15.22:0/3144207780 >> v2:172.21.15.116:3300/0 conn(0x7f939c060200 msgr2=0x7f939c05ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939affd700 1 --2- 172.21.15.22:0/3144207780 >> v2:172.21.15.116:3300/0 conn(0x7f939c060200 0x7f939c05ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939affd700 1 -- 172.21.15.22:0/3144207780 >> v1:172.21.15.116:6789/0 conn(0x7f939c148860 legacy=0x7f939c148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939affd700 1 -- 172.21.15.22:0/3144207780 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c05cf50 con 0x7f939c0b0870 2020-07-16T20:30:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939affd700 1 --2- 172.21.15.22:0/3144207780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c0b0870 0x7f939c0b0cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9390002f30 tx=0x7f9390006e90).ready entity=mon.0 client_cookie=c58d6d3379c64684 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939a7fc700 1 -- 172.21.15.22:0/3144207780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9390009850 con 0x7f939c0b0870 2020-07-16T20:30:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939a7fc700 1 -- 172.21.15.22:0/3144207780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93900099b0 con 0x7f939c0b0870 2020-07-16T20:30:41.184 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f939a7fc700 1 -- 172.21.15.22:0/3144207780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9390009d10 con 0x7f939c0b0870 2020-07-16T20:30:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 -- 172.21.15.22:0/3144207780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c0b0870 msgr2=0x7f939c0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 --2- 172.21.15.22:0/3144207780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c0b0870 0x7f939c0b0cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9390002f30 tx=0x7f9390006e90).stop 2020-07-16T20:30:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 -- 172.21.15.22:0/3144207780 shutdown_connections 2020-07-16T20:30:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 --2- 172.21.15.22:0/3144207780 >> v2:172.21.15.116:3300/0 conn(0x7f939c060200 0x7f939c05ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.185 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 --2- 172.21.15.22:0/3144207780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c0b0870 0x7f939c0b0cb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 -- 172.21.15.22:0/3144207780 >> 172.21.15.22:0/3144207780 conn(0x7f939c0b6c00 msgr2=0x7f939c0b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 -- 172.21.15.22:0/3144207780 shutdown_connections 2020-07-16T20:30:41.186 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.178+0000 7f93a1b22700 1 -- 172.21.15.22:0/3144207780 wait complete. 2020-07-16T20:30:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.180+0000 7f93a1b22700 1 Processor -- start 2020-07-16T20:30:41.189 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.180+0000 7f93a1b22700 1 -- start start 2020-07-16T20:30:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f939c060200 0x7f939c09ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c148860 0x7f939c117de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939c118a70 con 0x7f939c1182d0 2020-07-16T20:30:41.190 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c118860 con 0x7f939c148860 2020-07-16T20:30:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c09f170 con 0x7f939c060200 2020-07-16T20:30:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c148860 0x7f939c117de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939bfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f939c1182d0 0x7f939c142d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39898/0 (socket says 172.21.15.22:39898) 2020-07-16T20:30:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939bfff700 1 -- 172.21.15.22:0/2456333699 learned_addr learned my addr 172.21.15.22:0/2456333699 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:41.191 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f939c148860 0x7f939c117de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39188/0 (socket says 172.21.15.22:39188) 2020-07-16T20:30:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939b7fe700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f939c060200 0x7f939c09ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 -- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f939c060200 msgr2=0x7f939c09ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f939c060200 0x7f939c09ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 -- 172.21.15.22:0/2456333699 >> v1:172.21.15.22:6789/0 conn(0x7f939c1182d0 legacy=0x7f939c142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.192 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289264534 0 0) 0x7f939c118a70 con 0x7f939c1182d0 2020-07-16T20:30:41.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 -- 172.21.15.22:0/2456333699 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c09f2b0 con 0x7f939c148860 2020-07-16T20:30:41.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f939affd700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c148860 0x7f939c117de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9390002f30 tx=0x7f9390015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939000bec0 con 0x7f939c148860 2020-07-16T20:30:41.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939001d5d0 con 0x7f939c148860 2020-07-16T20:30:41.193 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c15a8d0 con 0x7f939c148860 2020-07-16T20:30:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f939001d930 con 0x7f939c148860 2020-07-16T20:30:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.181+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c143600 con 0x7f939c148860 2020-07-16T20:30:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.182+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c05f8a0 con 0x7f939c148860 2020-07-16T20:30:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.183+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f9390025030 con 0x7f939c148860 2020-07-16T20:30:41.194 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.183+0000 7f937b7fe700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 0x7f9374052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.183+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9390069250 con 0x7f939c148860 2020-07-16T20:30:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.183+0000 7f939b7fe700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 0x7f9374052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.183+0000 7f939b7fe700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 0x7f9374052320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f938c008000 tx=0x7f938c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.195 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.186+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f93900419e0 con 0x7f939c148860 2020-07-16T20:30:41.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.345+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f939c118ea0 con 0x7f939c148860 2020-07-16T20:30:41.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.345+0000 7f937b7fe700 1 -- 172.21.15.22:0/2456333699 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9390045000 con 0x7f939c148860 2020-07-16T20:30:41.348 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2020-07-16T20:30:41.349 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 msgr2=0x7f9374052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 0x7f9374052320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f938c008000 tx=0x7f938c008040).stop 2020-07-16T20:30:41.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c148860 msgr2=0x7f939c117de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c148860 0x7f939c117de0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9390002f30 tx=0x7f9390015000).stop 2020-07-16T20:30:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 shutdown_connections 2020-07-16T20:30:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f937404fe60 0x7f9374052320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f939c060200 0x7f939c09ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 --2- 172.21.15.22:0/2456333699 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f939c148860 0x7f939c117de0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.346+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 >> 172.21.15.22:0/2456333699 conn(0x7f939c0b6c00 msgr2=0x7f939c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.347+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 shutdown_connections 2020-07-16T20:30:41.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.347+0000 7f93a1b22700 1 -- 172.21.15.22:0/2456333699 wait complete. 2020-07-16T20:30:41.358 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:41.485 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.473+0000 7f1d0becf700 1 Processor -- start 2020-07-16T20:30:41.493 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.474+0000 7f1d0becf700 1 -- start start 2020-07-16T20:30:41.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.474+0000 7f1d0becf700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 0x7f1d040b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.474+0000 7f1d0becf700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040b4be0 con 0x7f1d040b4770 2020-07-16T20:30:41.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.474+0000 7f1d0becf700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040b8ff0 con 0x7f1d040b8670 2020-07-16T20:30:41.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.474+0000 7f1d0becf700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b3de0 con 0x7f1d040b8a50 2020-07-16T20:30:41.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0a46c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1d040b4770 0x7f1d04147960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39906/0 (socket says 172.21.15.22:39906) 2020-07-16T20:30:41.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0a46c700 1 -- 172.21.15.22:0/1573061583 learned_addr learned my addr 172.21.15.22:0/1573061583 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:41.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0946a700 1 --2- 172.21.15.22:0/1573061583 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 0x7f1d040b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922613330 0 0) 0x7f1d040b4be0 con 0x7f1d040b4770 2020-07-16T20:30:41.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec003240 con 0x7f1d040b4770 2020-07-16T20:30:41.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926635022 0 0) 0x7f1d040b8ff0 con 0x7f1d040b8670 2020-07-16T20:30:41.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d040b4be0 con 0x7f1d040b8670 2020-07-16T20:30:41.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 492474741 0 0) 0x7f1cec003240 con 0x7f1d040b4770 2020-07-16T20:30:41.498 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0946a700 1 -- 172.21.15.22:0/1573061583 >> v1:172.21.15.116:6789/0 conn(0x7f1d040b8670 legacy=0x7f1d0409d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0946a700 1 -- 172.21.15.22:0/1573061583 >> v1:172.21.15.22:6789/0 conn(0x7f1d040b4770 legacy=0x7f1d04147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.499 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0946a700 1 -- 172.21.15.22:0/1573061583 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0409de30 con 0x7f1d040b8a50 2020-07-16T20:30:41.506 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0946a700 1 --2- 172.21.15.22:0/1573061583 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 0x7f1d040b4280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1cfc001450 tx=0x7f1d00006dd0).ready entity=mon.2 client_cookie=ddbb9102936fe7cd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.507 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cfc001a50 con 0x7f1d040b8a50 2020-07-16T20:30:41.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0000d5c0 con 0x7f1d040b8a50 2020-07-16T20:30:41.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d08c69700 1 -- 172.21.15.22:0/1573061583 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0000d730 con 0x7f1d040b8a50 2020-07-16T20:30:41.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0becf700 1 -- 172.21.15.22:0/1573061583 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 msgr2=0x7f1d040b4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1573061583 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 0x7f1d040b4280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f1cfc001450 tx=0x7f1d00006dd0).stop 2020-07-16T20:30:41.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0becf700 1 -- 172.21.15.22:0/1573061583 shutdown_connections 2020-07-16T20:30:41.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1573061583 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d040b8a50 0x7f1d040b4280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.475+0000 7f1d0becf700 1 -- 172.21.15.22:0/1573061583 >> 172.21.15.22:0/1573061583 conn(0x7f1d040b9660 msgr2=0x7f1d040b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.476+0000 7f1d0becf700 1 -- 172.21.15.22:0/1573061583 shutdown_connections 2020-07-16T20:30:41.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.476+0000 7f1d0becf700 1 -- 172.21.15.22:0/1573061583 wait complete. 2020-07-16T20:30:41.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.477+0000 7f1d0becf700 1 Processor -- start 2020-07-16T20:30:41.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.477+0000 7f1d0becf700 1 -- start start 2020-07-16T20:30:41.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0becf700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 0x7f1d040b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0becf700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0becf700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d041556f0 con 0x7f1d040b4770 2020-07-16T20:30:41.510 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0becf700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d04143ad0 con 0x7f1d040b8670 2020-07-16T20:30:41.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0becf700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04155990 con 0x7f1d04158540 2020-07-16T20:30:41.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0946a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 0x7f1d040b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:45032/0 (socket says 172.21.15.22:45032) 2020-07-16T20:30:41.511 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0946a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 0x7f1d040b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:38316/0 (socket says 172.21.15.22:38316) 2020-07-16T20:30:41.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 -- 172.21.15.22:0/1549864875 learned_addr learned my addr 172.21.15.22:0/1549864875 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:41.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d09c6b700 1 --1- 172.21.15.22:0/1549864875 >> v1:172.21.15.116:6789/0 conn(0x7f1d040b4770 0x7f1d04154f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42258/0 (socket says 172.21.15.22:42258) 2020-07-16T20:30:41.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 -- 172.21.15.22:0/1549864875 >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 msgr2=0x7f1d040b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 --2- 172.21.15.22:0/1549864875 >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 0x7f1d040b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.512 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 -- 172.21.15.22:0/1549864875 >> v1:172.21.15.116:6789/0 conn(0x7f1d040b4770 legacy=0x7f1d04154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 -- 172.21.15.22:0/1549864875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04155c30 con 0x7f1d04158540 2020-07-16T20:30:41.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1d0a46c700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1cfc001320 tx=0x7f1cfc001570).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.478+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cfc004a90 con 0x7f1d04158540 2020-07-16T20:30:41.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.479+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc004bf0 con 0x7f1d04158540 2020-07-16T20:30:41.513 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.479+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cfc007170 con 0x7f1d04158540 2020-07-16T20:30:41.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.479+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d040b2fa0 con 0x7f1d04158540 2020-07-16T20:30:41.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.479+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0413fdf0 con 0x7f1d04158540 2020-07-16T20:30:41.514 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d041400d0 con 0x7f1d04158540 2020-07-16T20:30:41.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f1cfc01b060 con 0x7f1d04158540 2020-07-16T20:30:41.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1cf1ffb700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 0x7f1cdc0524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1cfc067a10 con 0x7f1d04158540 2020-07-16T20:30:41.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1d09c6b700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 0x7f1cdc0524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.515 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.480+0000 7f1d09c6b700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 0x7f1cdc0524a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1d040b3360 tx=0x7f1cf40076c0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.516 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.484+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f1cfc0401a0 con 0x7f1d04158540 2020-07-16T20:30:41.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.640+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d0405f320 con 0x7f1d04158540 2020-07-16T20:30:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.640+0000 7f1cf1ffb700 1 -- 172.21.15.22:0/1549864875 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1cfc019030 con 0x7f1d04158540 2020-07-16T20:30:41.642 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 msgr2=0x7f1cdc0524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 0x7f1cdc0524a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1d040b3360 tx=0x7f1cf40076c0).stop 2020-07-16T20:30:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 msgr2=0x7f1d0413f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1cfc001320 tx=0x7f1cfc001570).stop 2020-07-16T20:30:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 shutdown_connections 2020-07-16T20:30:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1cdc04ffe0 0x7f1cdc0524a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1549864875 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1d04158540 0x7f1d0413f6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 --2- 172.21.15.22:0/1549864875 >> v2:172.21.15.116:3300/0 conn(0x7f1d040b8670 0x7f1d040b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 >> 172.21.15.22:0/1549864875 conn(0x7f1d040b9660 msgr2=0x7f1d0405f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 shutdown_connections 2020-07-16T20:30:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.642+0000 7f1d0becf700 1 -- 172.21.15.22:0/1549864875 wait complete. 2020-07-16T20:30:41.654 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:30:41.771 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 Processor -- start 2020-07-16T20:30:41.772 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 -- start start 2020-07-16T20:30:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 0x7f7c000b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 0x7f7c00147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c000b4bc0 con 0x7f7c000b8670 2020-07-16T20:30:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c000b8ff0 con 0x7f7c000b8a50 2020-07-16T20:30:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.770+0000 7f7c05161700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000b3de0 con 0x7f7c000b4770 2020-07-16T20:30:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 0x7f7c00147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfe59c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 0x7f7c000b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfed9d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f7c000b8670 0x7f7c0009d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42266/0 (socket says 172.21.15.22:42266) 2020-07-16T20:30:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfed9d700 1 -- 172.21.15.22:0/871754424 learned_addr learned my addr 172.21.15.22:0/871754424 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 -- 172.21.15.22:0/871754424 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 msgr2=0x7f7c000b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 --2- 172.21.15.22:0/871754424 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 0x7f7c000b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 -- 172.21.15.22:0/871754424 >> v1:172.21.15.116:6789/0 conn(0x7f7c000b8670 legacy=0x7f7c0009d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 -- 172.21.15.22:0/871754424 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0009de30 con 0x7f7c000b4770 2020-07-16T20:30:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfe59c700 1 --2- 172.21.15.22:0/871754424 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 0x7f7c000b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bff59e700 1 --2- 172.21.15.22:0/871754424 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 0x7f7c00147960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7bf80032b0 tx=0x7f7bf80091d0).ready entity=mon.2 client_cookie=6d21d9b5de32c8cc server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfdd9b700 1 -- 172.21.15.22:0/871754424 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf800bb90 con 0x7f7c000b4770 2020-07-16T20:30:41.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfdd9b700 1 -- 172.21.15.22:0/871754424 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf800bcf0 con 0x7f7c000b4770 2020-07-16T20:30:41.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7bfdd9b700 1 -- 172.21.15.22:0/871754424 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8010660 con 0x7f7c000b4770 2020-07-16T20:30:41.790 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7c05161700 1 -- 172.21.15.22:0/871754424 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 msgr2=0x7f7c00147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.771+0000 7f7c05161700 1 --2- 172.21.15.22:0/871754424 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 0x7f7c00147960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f7bf80032b0 tx=0x7f7bf80091d0).stop 2020-07-16T20:30:41.791 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 -- 172.21.15.22:0/871754424 shutdown_connections 2020-07-16T20:30:41.792 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 --2- 172.21.15.22:0/871754424 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b4770 0x7f7c00147960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 --2- 172.21.15.22:0/871754424 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8a50 0x7f7c000b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 -- 172.21.15.22:0/871754424 >> 172.21.15.22:0/871754424 conn(0x7f7c000b9660 msgr2=0x7f7c000b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.793 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 -- 172.21.15.22:0/871754424 shutdown_connections 2020-07-16T20:30:41.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.772+0000 7f7c05161700 1 -- 172.21.15.22:0/871754424 wait complete. 2020-07-16T20:30:41.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.773+0000 7f7c05161700 1 Processor -- start 2020-07-16T20:30:41.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.773+0000 7f7c05161700 1 -- start start 2020-07-16T20:30:41.794 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7c05161700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 0x7f7c00066630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7c05161700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 0x7f7c00062a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7c05161700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0013eae0 con 0x7f7c000b8a50 2020-07-16T20:30:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7c05161700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0013e900 con 0x7f7c000b8670 2020-07-16T20:30:41.795 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7c05161700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0013ed80 con 0x7f7c000b6770 2020-07-16T20:30:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bfe59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7c000b8a50 0x7f7c00146080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39924/0 (socket says 172.21.15.22:39924) 2020-07-16T20:30:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bfe59c700 1 -- 172.21.15.22:0/3529495882 learned_addr learned my addr 172.21.15.22:0/3529495882 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:41.796 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 0x7f7c00062a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bfed9d700 1 --2- 172.21.15.22:0/3529495882 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 0x7f7c00066630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100651694 0 0) 0x7f7c0013eae0 con 0x7f7c000b8a50 2020-07-16T20:30:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003240 con 0x7f7c000b8a50 2020-07-16T20:30:41.797 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 -- 172.21.15.22:0/3529495882 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 msgr2=0x7f7c00066630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 --2- 172.21.15.22:0/3529495882 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 0x7f7c00066630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 -- 172.21.15.22:0/3529495882 >> v1:172.21.15.22:6789/0 conn(0x7f7c000b8a50 legacy=0x7f7c00146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 -- 172.21.15.22:0/3529495882 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0013e4c0 con 0x7f7c000b6770 2020-07-16T20:30:41.798 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bfed9d700 1 --2- 172.21.15.22:0/3529495882 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 0x7f7c00066630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.774+0000 7f7bff59e700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 0x7f7c00062a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7bf80032b0 tx=0x7f7bf8018000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8018610 con 0x7f7c000b6770 2020-07-16T20:30:41.799 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8018770 con 0x7f7c000b6770 2020-07-16T20:30:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c00062f30 con 0x7f7c000b6770 2020-07-16T20:30:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8018ad0 con 0x7f7c000b6770 2020-07-16T20:30:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0013be70 con 0x7f7c000b6770 2020-07-16T20:30:41.800 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.775+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c00063150 con 0x7f7c000b6770 2020-07-16T20:30:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.776+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7bf8021020 con 0x7f7c000b6770 2020-07-16T20:30:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.776+0000 7f7be6ffd700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 0x7f7bdc0527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.776+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7bf806a3c0 con 0x7f7c000b6770 2020-07-16T20:30:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.776+0000 7f7bfed9d700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 0x7f7bdc0527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:41.801 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.777+0000 7f7bfed9d700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 0x7f7bdc0527f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7bf000d000 tx=0x7f7bf0007b60).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:41.802 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.780+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f7bf8042b80 con 0x7f7c000b6770 2020-07-16T20:30:41.943 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.941+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c0013e650 con 0x7f7c000b6770 2020-07-16T20:30:41.944 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.942+0000 7f7be6ffd700 1 -- 172.21.15.22:0/3529495882 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7bf80461a0 con 0x7f7c000b6770 2020-07-16T20:30:41.944 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:41.946 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 msgr2=0x7f7bdc0527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.946 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 0x7f7bdc0527f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7bf000d000 tx=0x7f7bf0007b60).stop 2020-07-16T20:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 msgr2=0x7f7c00062a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 0x7f7c00062a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f7bf80032b0 tx=0x7f7bf8018000).stop 2020-07-16T20:30:41.947 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 shutdown_connections 2020-07-16T20:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f7bdc050330 0x7f7bdc0527f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 --2- 172.21.15.22:0/3529495882 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f7c000b6770 0x7f7c00062a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 --2- 172.21.15.22:0/3529495882 >> v2:172.21.15.116:3300/0 conn(0x7f7c000b8670 0x7f7c00066630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:41.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 >> 172.21.15.22:0/3529495882 conn(0x7f7c000b9660 msgr2=0x7f7c000afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:41.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 shutdown_connections 2020-07-16T20:30:41.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:41.943+0000 7f7c05161700 1 -- 172.21.15.22:0/3529495882 wait complete. 2020-07-16T20:30:41.960 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:30:42.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.076+0000 7f1aa9178700 1 Processor -- start 2020-07-16T20:30:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.076+0000 7f1aa9178700 1 -- start start 2020-07-16T20:30:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa9178700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b87b0 0x7f1aa40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa9178700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa9178700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa409e030 con 0x7f1aa40b7560 2020-07-16T20:30:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa9178700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40b7ee0 con 0x7f1aa40b87b0 2020-07-16T20:30:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa9178700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409daf0 con 0x7f1aa409f240 2020-07-16T20:30:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:45054/0 (socket says 172.21.15.22:45054) 2020-07-16T20:30:42.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 -- 172.21.15.22:0/3545643666 learned_addr learned my addr 172.21.15.22:0/3545643666 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa2d9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b87b0 0x7f1aa40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 -- 172.21.15.22:0/3545643666 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b87b0 msgr2=0x7f1aa40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 --2- 172.21.15.22:0/3545643666 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b87b0 0x7f1aa40b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 -- 172.21.15.22:0/3545643666 >> v1:172.21.15.116:6789/0 conn(0x7f1aa40b7560 legacy=0x7f1aa409cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.077+0000 7f1aa359e700 1 -- 172.21.15.22:0/3545643666 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa409dd90 con 0x7f1aa409f240 2020-07-16T20:30:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa359e700 1 --2- 172.21.15.22:0/3545643666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1a9c0032b0 tx=0x7f1a9c009270).ready entity=mon.2 client_cookie=e5248908eeb2f4c8 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa1d9b700 1 -- 172.21.15.22:0/3545643666 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9c00bdf0 con 0x7f1aa409f240 2020-07-16T20:30:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa1d9b700 1 -- 172.21.15.22:0/3545643666 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c009e60 con 0x7f1aa409f240 2020-07-16T20:30:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa1d9b700 1 -- 172.21.15.22:0/3545643666 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9c010660 con 0x7f1aa409f240 2020-07-16T20:30:42.112 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 -- 172.21.15.22:0/3545643666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 msgr2=0x7f1aa40b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 --2- 172.21.15.22:0/3545643666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1a9c0032b0 tx=0x7f1a9c009270).stop 2020-07-16T20:30:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 -- 172.21.15.22:0/3545643666 shutdown_connections 2020-07-16T20:30:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 --2- 172.21.15.22:0/3545643666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa409f240 0x7f1aa40b79f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.113 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 --2- 172.21.15.22:0/3545643666 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b87b0 0x7f1aa40b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 -- 172.21.15.22:0/3545643666 >> 172.21.15.22:0/3545643666 conn(0x7f1aa40b9660 msgr2=0x7f1aa40b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 -- 172.21.15.22:0/3545643666 shutdown_connections 2020-07-16T20:30:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.078+0000 7f1aa9178700 1 -- 172.21.15.22:0/3545643666 wait complete. 2020-07-16T20:30:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 Processor -- start 2020-07-16T20:30:42.114 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 -- start start 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 0x7f1aa4140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa40b87b0 0x7f1aa413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa413f800 0x7f1aa412e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa4140dc0 con 0x7f1aa413f800 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa4141060 con 0x7f1aa40b7560 2020-07-16T20:30:42.115 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa9178700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa413e3d0 con 0x7f1aa40b87b0 2020-07-16T20:30:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa413f800 0x7f1aa412e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa359e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1aa413f800 0x7f1aa412e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39232/0 (socket says 172.21.15.22:39232) 2020-07-16T20:30:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa359e700 1 -- 172.21.15.22:0/2893673064 learned_addr learned my addr 172.21.15.22:0/2893673064 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa2d9d700 1 --2- 172.21.15.22:0/2893673064 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 0x7f1aa4140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.116 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.080+0000 7f1aa259c700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa40b87b0 0x7f1aa413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 -- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa40b87b0 msgr2=0x7f1aa413dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa40b87b0 0x7f1aa413dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 -- 172.21.15.22:0/2893673064 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 msgr2=0x7f1aa4140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 --2- 172.21.15.22:0/2893673064 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 0x7f1aa4140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.117 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 -- 172.21.15.22:0/2893673064 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa412e920 con 0x7f1aa413f800 2020-07-16T20:30:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa2d9d700 1 --2- 172.21.15.22:0/2893673064 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 0x7f1aa4140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa359e700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa413f800 0x7f1aa412e430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1a9c0032b0 tx=0x7f1a9c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9c01f070 con 0x7f1aa413f800 2020-07-16T20:30:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c018800 con 0x7f1aa413f800 2020-07-16T20:30:42.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9c018b60 con 0x7f1aa413f800 2020-07-16T20:30:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa412eab0 con 0x7f1aa413f800 2020-07-16T20:30:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.081+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4066690 con 0x7f1aa413f800 2020-07-16T20:30:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.082+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4140c10 con 0x7f1aa413f800 2020-07-16T20:30:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.082+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f1a9c00f3d0 con 0x7f1aa413f800 2020-07-16T20:30:42.119 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.082+0000 7f1a9affd700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 0x7f1a80052460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.082+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1a9c06b1b0 con 0x7f1aa413f800 2020-07-16T20:30:42.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.083+0000 7f1aa2d9d700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 0x7f1a80052460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.083+0000 7f1aa2d9d700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 0x7f1a80052460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1a8c00b000 tx=0x7f1a8c006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.120 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.086+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f1a9c043a20 con 0x7f1aa413f800 2020-07-16T20:30:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.243+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1aa40b55c0 con 0x7f1aa413f800 2020-07-16T20:30:42.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.243+0000 7f1a9affd700 1 -- 172.21.15.22:0/2893673064 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1a9c028070 con 0x7f1aa413f800 2020-07-16T20:30:42.246 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:42.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.244+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 msgr2=0x7f1a80052460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.244+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 0x7f1a80052460 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f1a8c00b000 tx=0x7f1a8c006dd0).stop 2020-07-16T20:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.244+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa413f800 msgr2=0x7f1aa412e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.244+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa413f800 0x7f1aa412e430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1a9c0032b0 tx=0x7f1a9c018000).stop 2020-07-16T20:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 shutdown_connections 2020-07-16T20:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f1a8004ffa0 0x7f1a80052460 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.249 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1aa413f800 0x7f1aa412e430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> v2:172.21.15.116:3300/0 conn(0x7f1aa40b7560 0x7f1aa4140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 --2- 172.21.15.22:0/2893673064 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1aa40b87b0 0x7f1aa413dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 >> 172.21.15.22:0/2893673064 conn(0x7f1aa40b9660 msgr2=0x7f1aa40af600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 shutdown_connections 2020-07-16T20:30:42.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.245+0000 7f1aa9178700 1 -- 172.21.15.22:0/2893673064 wait complete. 2020-07-16T20:30:42.259 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:30:42.374 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.372+0000 7f72176c1700 1 Processor -- start 2020-07-16T20:30:42.375 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f72176c1700 1 -- start start 2020-07-16T20:30:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f72176c1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f7210142b10 0x7f7210142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f72176c1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100b5c20 con 0x7f72100b4fb0 2020-07-16T20:30:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f72176c1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72100ae6f0 con 0x7f721014ac40 2020-07-16T20:30:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f72176c1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7210143460 con 0x7f7210142b10 2020-07-16T20:30:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f721545d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f72100b4fb0 0x7f7210060030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39944/0 (socket says 172.21.15.22:39944) 2020-07-16T20:30:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.373+0000 7f721545d700 1 -- 172.21.15.22:0/1530539845 learned_addr learned my addr 172.21.15.22:0/1530539845 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:42.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f7214c5c700 1 --2- 172.21.15.22:0/1530539845 >> v2:172.21.15.116:3300/0 conn(0x7f7210142b10 0x7f7210142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120627716 0 0) 0x7f72100b5c20 con 0x7f72100b4fb0 2020-07-16T20:30:42.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc003240 con 0x7f72100b4fb0 2020-07-16T20:30:42.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71880515 0 0) 0x7f72100ae6f0 con 0x7f721014ac40 2020-07-16T20:30:42.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72100b5c20 con 0x7f721014ac40 2020-07-16T20:30:42.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f7214c5c700 1 -- 172.21.15.22:0/1530539845 >> v1:172.21.15.116:6789/0 conn(0x7f721014ac40 legacy=0x7f721014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f7214c5c700 1 -- 172.21.15.22:0/1530539845 >> v1:172.21.15.22:6789/0 conn(0x7f72100b4fb0 legacy=0x7f7210060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1626548262 0 0) 0x7f71fc003240 con 0x7f72100b4fb0 2020-07-16T20:30:42.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f7214c5c700 1 -- 172.21.15.22:0/1530539845 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100aeb90 con 0x7f7210142b10 2020-07-16T20:30:42.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f7214c5c700 1 --2- 172.21.15.22:0/1530539845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7210142b10 0x7f7210142f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7208001450 tx=0x7f7204006dd0).ready entity=mon.1 client_cookie=26c54f472c9aea97 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7208001a50 con 0x7f7210142b10 2020-07-16T20:30:42.388 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400d610 con 0x7f7210142b10 2020-07-16T20:30:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f720ffff700 1 -- 172.21.15.22:0/1530539845 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720400d780 con 0x7f7210142b10 2020-07-16T20:30:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 -- 172.21.15.22:0/1530539845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7210142b10 msgr2=0x7f7210142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 --2- 172.21.15.22:0/1530539845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7210142b10 0x7f7210142f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7208001450 tx=0x7f7204006dd0).stop 2020-07-16T20:30:42.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 -- 172.21.15.22:0/1530539845 shutdown_connections 2020-07-16T20:30:42.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 --2- 172.21.15.22:0/1530539845 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7210142b10 0x7f7210142f70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 -- 172.21.15.22:0/1530539845 >> 172.21.15.22:0/1530539845 conn(0x7f72100b9530 msgr2=0x7f72100b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 -- 172.21.15.22:0/1530539845 shutdown_connections 2020-07-16T20:30:42.392 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.374+0000 7f72176c1700 1 -- 172.21.15.22:0/1530539845 wait complete. 2020-07-16T20:30:42.392 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.376+0000 7f72176c1700 1 Processor -- start 2020-07-16T20:30:42.392 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.376+0000 7f72176c1700 1 -- start start 2020-07-16T20:30:42.393 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f721014ac40 0x7f72101404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.393 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 0x7f72100b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.394 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72101533b0 con 0x7f72100b4fb0 2020-07-16T20:30:42.394 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721013b820 con 0x7f721014ac40 2020-07-16T20:30:42.394 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7210153610 con 0x7f72100b87e0 2020-07-16T20:30:42.395 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f721014ac40 0x7f72101404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.395 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f721545d700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f72100b4fb0 0x7f721013b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42300/0 (socket says 172.21.15.22:42300) 2020-07-16T20:30:42.395 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f721545d700 1 -- 172.21.15.22:0/2485729503 learned_addr learned my addr 172.21.15.22:0/2485729503 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:42.396 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7215c5e700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 0x7f72100b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.396 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 -- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 msgr2=0x7f72100b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.396 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 0x7f72100b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.397 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 -- 172.21.15.22:0/2485729503 >> v1:172.21.15.116:6789/0 conn(0x7f72100b4fb0 legacy=0x7f721013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.397 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864741066 0 0) 0x7f72101533b0 con 0x7f72100b4fb0 2020-07-16T20:30:42.397 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 -- 172.21.15.22:0/2485729503 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210140990 con 0x7f721014ac40 2020-07-16T20:30:42.398 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7215c5e700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 0x7f72100b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:42.398 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f7214c5c700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721014ac40 0x7f72101404a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7208001450 tx=0x7f7204015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720401e460 con 0x7f721014ac40 2020-07-16T20:30:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720401e5c0 con 0x7f721014ac40 2020-07-16T20:30:42.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.377+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7210140c40 con 0x7f721014ac40 2020-07-16T20:30:42.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.378+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720401e920 con 0x7f721014ac40 2020-07-16T20:30:42.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.378+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72100b8e70 con 0x7f721014ac40 2020-07-16T20:30:42.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.378+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72101537b0 con 0x7f721014ac40 2020-07-16T20:30:42.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.379+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f7204025030 con 0x7f721014ac40 2020-07-16T20:30:42.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.379+0000 7f720d7fa700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 0x7f71e8052350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:42.402 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.379+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f7204069170 con 0x7f721014ac40 2020-07-16T20:30:42.402 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.379+0000 7f721545d700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 0x7f71e8052350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:42.403 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.379+0000 7f721545d700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 0x7f71e8052350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7208001290 tx=0x7f7208001520).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:42.403 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.383+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f7204041860 con 0x7f721014ac40 2020-07-16T20:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.591+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f721005f320 con 0x7f721014ac40 2020-07-16T20:30:42.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.592+0000 7f720d7fa700 1 -- 172.21.15.22:0/2485729503 <== mon.1 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2133 (secure 0 0 0) 0x7f7204044e80 con 0x7f721014ac40 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:42.594 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3205071775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3205071775},{"type":"v1","addr":"172.21.15.116:6835","nonce":3205071775}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:29.955842+0000","modified":"2020-07-16T20:30:33.948780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.22:6833/2653244854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2653244854},{"type":"v1","addr":"172.21.15.22:6833","nonce":2653244854}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:30:42.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 msgr2=0x7f71e8052350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.596 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 0x7f71e8052350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7208001290 tx=0x7f7208001520).stop 2020-07-16T20:30:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721014ac40 msgr2=0x7f72101404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721014ac40 0x7f72101404a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f7208001450 tx=0x7f7204015000).stop 2020-07-16T20:30:42.597 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 shutdown_connections 2020-07-16T20:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f71e804fe90 0x7f71e8052350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72100b87e0 0x7f72100b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 --2- 172.21.15.22:0/2485729503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f721014ac40 0x7f72101404a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 >> 172.21.15.22:0/2485729503 conn(0x7f72100b9530 msgr2=0x7f721009edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 shutdown_connections 2020-07-16T20:30:42.599 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:42.593+0000 7f72176c1700 1 -- 172.21.15.22:0/2485729503 wait complete. 2020-07-16T20:30:42.600 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2020-07-16T20:30:42.808 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-16T20:30:29.955842+0000', 'modified': '2020-07-16T20:30:33.948780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4357}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4357': {'gid': 4357, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.22:6833/2653244854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6832', 'nonce': 2653244854}, {'type': 'v1', 'addr': '172.21.15.22:6833', 'nonce': 2653244854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-16T20:30:42.809 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-16T20:30:42.810 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-07-16T20:30:42.950 INFO:teuthology.orchestra.run.smithi022.stdout:{"cluster_fsid":"70778c64-6d4b-4710-8151-64d2394b5553","whoami":0,"id":4357,"want_state":"up:active","state":"up:active","rank_uptime":9.9948419770000001,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":10.574436392999999} 2020-07-16T20:30:42.951 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "70778c64-6d4b-4710-8151-64d2394b5553", "id": 4357, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 9.994841977, "state": "up:active", "uptime": 10.574436393, "want_state": "up:active", "whoami": 0 } 2020-07-16T20:30:42.952 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-07-16T20:30:43.012 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-07-16T20:30:43.013 INFO:tasks.ceph_fuse:config is None 2020-07-16T20:30:43.013 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None, 'client.2': None, 'client.3': None} 2020-07-16T20:30:43.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:43.017 INFO:teuthology.orchestra.run.smithi022:> ip netns list 2020-07-16T20:30:43.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:43.039 INFO:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2020-07-16T20:30:43.111 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2020-07-16T20:30:43.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:30:43.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:43.113 INFO:teuthology.orchestra.run.smithi116:> ip netns list 2020-07-16T20:30:43.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:43.133 INFO:teuthology.orchestra.run.smithi116:> sudo ip link delete ceph-brx 2020-07-16T20:30:43.207 INFO:teuthology.orchestra.run.smithi116.stderr:Cannot find device "ceph-brx" 2020-07-16T20:30:43.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:30:43.211 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-07-16T20:30:43.212 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:43.329 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.327+0000 7f2b77297700 1 Processor -- start 2020-07-16T20:30:43.329 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.327+0000 7f2b77297700 1 -- start start 2020-07-16T20:30:43.336 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b77297700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b700b41d0 0x7f2b700b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b77297700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b70060420 con 0x7f2b700b3df0 2020-07-16T20:30:43.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b77297700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7014a7e0 con 0x7f2b700b9230 2020-07-16T20:30:43.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b77297700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7014aa80 con 0x7f2b700b41d0 2020-07-16T20:30:43.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b75033700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2b700b3df0 0x7f2b70146830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39958/0 (socket says 172.21.15.22:39958) 2020-07-16T20:30:43.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b75033700 1 -- 172.21.15.22:0/4047291738 learned_addr learned my addr 172.21.15.22:0/4047291738 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:43.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b74832700 1 --2- 172.21.15.22:0/4047291738 >> v2:172.21.15.116:3300/0 conn(0x7f2b700b41d0 0x7f2b700b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.328+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796903985 0 0) 0x7f2b70060420 con 0x7f2b700b3df0 2020-07-16T20:30:43.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b58003240 con 0x7f2b700b3df0 2020-07-16T20:30:43.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3549818325 0 0) 0x7f2b58003240 con 0x7f2b700b3df0 2020-07-16T20:30:43.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 >> v2:172.21.15.116:3300/0 conn(0x7f2b700b41d0 msgr2=0x7f2b700b8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 --2- 172.21.15.22:0/4047291738 >> v2:172.21.15.116:3300/0 conn(0x7f2b700b41d0 0x7f2b700b8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 >> v1:172.21.15.116:6789/0 conn(0x7f2b700b9230 legacy=0x7f2b70150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70146f40 con 0x7f2b700b3df0 2020-07-16T20:30:43.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f2b600016d0 con 0x7f2b700b3df0 2020-07-16T20:30:43.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 >> v1:172.21.15.22:6789/0 conn(0x7f2b700b3df0 legacy=0x7f2b70146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b58003730 0x7f2b58003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 0x7f2b58004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b58004e50 0x7f2b5800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7014aa80 con 0x7f2b580044e0 2020-07-16T20:30:43.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58004350 con 0x7f2b58003730 2020-07-16T20:30:43.343 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5800bc50 con 0x7f2b58004e50 2020-07-16T20:30:43.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 0x7f2b58004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b75033700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b58003730 0x7f2b58003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.344 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b75834700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b58004e50 0x7f2b5800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 -- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b58004e50 msgr2=0x7f2b5800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b58004e50 0x7f2b5800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 -- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b58003730 msgr2=0x7f2b58003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2b58003730 0x7f2b58003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 -- 172.21.15.22:0/4047291738 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58003240 con 0x7f2b580044e0 2020-07-16T20:30:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b75834700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b58004e50 0x7f2b5800b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b75834700 1 -- 172.21.15.22:0/4047291738 reap_dead start 2020-07-16T20:30:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b74832700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 0x7f2b58004960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f2b6c00c000 tx=0x7f2b6c008040).ready entity=mon.0 client_cookie=9508b327083322b0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.346 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c00eb60 con 0x7f2b580044e0 2020-07-16T20:30:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00ecc0 con 0x7f2b580044e0 2020-07-16T20:30:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.329+0000 7f2b5ffff700 1 -- 172.21.15.22:0/4047291738 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c0125e0 con 0x7f2b580044e0 2020-07-16T20:30:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 -- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 msgr2=0x7f2b58004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.347 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 0x7f2b58004960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f2b6c00c000 tx=0x7f2b6c008040).stop 2020-07-16T20:30:43.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 -- 172.21.15.22:0/4047291738 shutdown_connections 2020-07-16T20:30:43.348 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 --2- 172.21.15.22:0/4047291738 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2b580044e0 0x7f2b58004960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 -- 172.21.15.22:0/4047291738 >> 172.21.15.22:0/4047291738 conn(0x7f2b700bd9b0 msgr2=0x7f2b700bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 -- 172.21.15.22:0/4047291738 shutdown_connections 2020-07-16T20:30:43.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.330+0000 7f2b77297700 1 -- 172.21.15.22:0/4047291738 wait complete. 2020-07-16T20:30:43.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.331+0000 7f2b77297700 1 Processor -- start 2020-07-16T20:30:43.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.331+0000 7f2b77297700 1 -- start start 2020-07-16T20:30:43.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b77297700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b77297700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b77297700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b70147230 con 0x7f2b700a1d90 2020-07-16T20:30:43.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b77297700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b70147460 con 0x7f2b70147ba0 2020-07-16T20:30:43.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b77297700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700a39f0 con 0x7f2b700a2170 2020-07-16T20:30:43.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b74832700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b75834700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b74832700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:45092/0 (socket says 172.21.15.22:45092) 2020-07-16T20:30:43.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b75834700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:38380/0 (socket says 172.21.15.22:38380) 2020-07-16T20:30:43.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b74832700 1 -- 172.21.15.22:0/804675386 learned_addr learned my addr 172.21.15.22:0/804675386 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:43.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108880754 0 0) 0x7f2b70147230 con 0x7f2b700a1d90 2020-07-16T20:30:43.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.332+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003240 con 0x7f2b700a1d90 2020-07-16T20:30:43.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b74832700 1 -- 172.21.15.22:0/804675386 >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 msgr2=0x7f2b700a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b74832700 1 --2- 172.21.15.22:0/804675386 >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b74832700 1 -- 172.21.15.22:0/804675386 >> v1:172.21.15.116:6789/0 conn(0x7f2b700a1d90 legacy=0x7f2b700a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b74832700 1 -- 172.21.15.22:0/804675386 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700a1620 con 0x7f2b700a2170 2020-07-16T20:30:43.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b75834700 1 --2- 172.21.15.22:0/804675386 >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:43.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b74832700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2b6c00c000 tx=0x7f2b6c019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c01c8d0 con 0x7f2b700a2170 2020-07-16T20:30:43.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c01ca30 con 0x7f2b700a2170 2020-07-16T20:30:43.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b70156900 con 0x7f2b700a2170 2020-07-16T20:30:43.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c01cd90 con 0x7f2b700a2170 2020-07-16T20:30:43.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.333+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b70156dd0 con 0x7f2b700a2170 2020-07-16T20:30:43.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.334+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7005f320 con 0x7f2b700a2170 2020-07-16T20:30:43.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.334+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f2b6c025470 con 0x7f2b700a2170 2020-07-16T20:30:43.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.334+0000 7f2b5d7fa700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 0x7f2b480527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.334+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2b6c069940 con 0x7f2b700a2170 2020-07-16T20:30:43.357 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.335+0000 7f2b75033700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 0x7f2b480527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.358 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.335+0000 7f2b75033700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 0x7f2b480527f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2b6000b000 tx=0x7f2b60007750).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.358 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.338+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f2b6c041ff0 con 0x7f2b700a2170 2020-07-16T20:30:43.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.495+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b70147870 con 0x7f2b700a2170 2020-07-16T20:30:43.497 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.496+0000 7f2b5d7fa700 1 -- 172.21.15.22:0/804675386 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f2b6c045610 con 0x7f2b700a2170 2020-07-16T20:30:43.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:43.498 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:43.500 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 msgr2=0x7f2b480527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.501 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 0x7f2b480527f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2b6000b000 tx=0x7f2b60007750).stop 2020-07-16T20:30:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 msgr2=0x7f2b700b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2b6c00c000 tx=0x7f2b6c019000).stop 2020-07-16T20:30:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 shutdown_connections 2020-07-16T20:30:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f2b48050330 0x7f2b480527f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 --2- 172.21.15.22:0/804675386 >> v2:172.21.15.116:3300/0 conn(0x7f2b70147ba0 0x7f2b700a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 --2- 172.21.15.22:0/804675386 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2b700a2170 0x7f2b700b7250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 >> 172.21.15.22:0/804675386 conn(0x7f2b700bd9b0 msgr2=0x7f2b7005f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.504 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 shutdown_connections 2020-07-16T20:30:43.504 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.497+0000 7f2b77297700 1 -- 172.21.15.22:0/804675386 wait complete. 2020-07-16T20:30:43.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-07-16T20:30:11.371623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-07-16T20:30:21.693414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-07-16T20:30:25.164093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-07-16T20:30:27.610215+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-07-16T20:30:43.515 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-07-16T20:30:43.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 Processor -- start 2020-07-16T20:30:43.637 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 -- start start 2020-07-16T20:30:43.643 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb63c0b87b0 0x7fb63c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.643 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 0x7fb63c0b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c09e030 con 0x7fb63c0b7560 2020-07-16T20:30:43.644 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0b7ee0 con 0x7fb63c0b87b0 2020-07-16T20:30:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.635+0000 7fb640f68700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c09daf0 con 0x7fb63c09f240 2020-07-16T20:30:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb63c0b87b0 0x7fb63c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.651 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb63c0b87b0 0x7fb63c0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39270/0 (socket says 172.21.15.22:39270) 2020-07-16T20:30:43.652 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 -- 172.21.15.22:0/2399519139 learned_addr learned my addr 172.21.15.22:0/2399519139 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:43.652 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63ad9d700 1 --2- 172.21.15.22:0/2399519139 >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 0x7fb63c0b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 -- 172.21.15.22:0/2399519139 >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 msgr2=0x7fb63c0b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 --2- 172.21.15.22:0/2399519139 >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 0x7fb63c0b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 -- 172.21.15.22:0/2399519139 >> v1:172.21.15.116:6789/0 conn(0x7fb63c0b7560 legacy=0x7fb63c09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.653 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 -- 172.21.15.22:0/2399519139 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c09dd90 con 0x7fb63c0b87b0 2020-07-16T20:30:43.654 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63ad9d700 1 --2- 172.21.15.22:0/2399519139 >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 0x7fb63c0b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:43.654 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63a59c700 1 --2- 172.21.15.22:0/2399519139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63c0b87b0 0x7fb63c0b4980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb63c05b2e0 tx=0x7fb630006e90).ready entity=mon.0 client_cookie=fe45179cdb120156 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63959a700 1 -- 172.21.15.22:0/2399519139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb630009930 con 0x7fb63c0b87b0 2020-07-16T20:30:43.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63959a700 1 -- 172.21.15.22:0/2399519139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630009a90 con 0x7fb63c0b87b0 2020-07-16T20:30:43.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb63959a700 1 -- 172.21.15.22:0/2399519139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb630009e30 con 0x7fb63c0b87b0 2020-07-16T20:30:43.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 -- 172.21.15.22:0/2399519139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63c0b87b0 msgr2=0x7fb63c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 --2- 172.21.15.22:0/2399519139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63c0b87b0 0x7fb63c0b4980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb63c05b2e0 tx=0x7fb630006e90).stop 2020-07-16T20:30:43.656 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 -- 172.21.15.22:0/2399519139 shutdown_connections 2020-07-16T20:30:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 --2- 172.21.15.22:0/2399519139 >> v2:172.21.15.116:3300/0 conn(0x7fb63c09f240 0x7fb63c0b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 --2- 172.21.15.22:0/2399519139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb63c0b87b0 0x7fb63c0b4980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 -- 172.21.15.22:0/2399519139 >> 172.21.15.22:0/2399519139 conn(0x7fb63c0b9660 msgr2=0x7fb63c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.657 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 -- 172.21.15.22:0/2399519139 shutdown_connections 2020-07-16T20:30:43.660 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.636+0000 7fb640f68700 1 -- 172.21.15.22:0/2399519139 wait complete. 2020-07-16T20:30:43.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 Processor -- start 2020-07-16T20:30:43.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 -- start start 2020-07-16T20:30:43.661 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 0x7fb63c13efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c144d00 con 0x7fb63c0b7560 2020-07-16T20:30:43.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c144fa0 con 0x7fb63c13ebb0 2020-07-16T20:30:43.662 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.638+0000 7fb640f68700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c145240 con 0x7fb63c1456e0 2020-07-16T20:30:43.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb63ad9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 0x7fb63c13efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb63a59c700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb63c0b7560 0x7fb63c1461d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42336/0 (socket says 172.21.15.22:42336) 2020-07-16T20:30:43.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb63ad9d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 0x7fb63c13efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.22:38394/0 (socket says 172.21.15.22:38394) 2020-07-16T20:30:43.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.22:45104/0 (socket says 172.21.15.22:45104) 2020-07-16T20:30:43.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb63a59c700 1 -- 172.21.15.22:0/3968563677 learned_addr learned my addr 172.21.15.22:0/3968563677 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:43.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389504974 0 0) 0x7fb63c144d00 con 0x7fb63c0b7560 2020-07-16T20:30:43.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb610003240 con 0x7fb63c0b7560 2020-07-16T20:30:43.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 -- 172.21.15.22:0/3968563677 >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 msgr2=0x7fb63c13efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 --2- 172.21.15.22:0/3968563677 >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 0x7fb63c13efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 -- 172.21.15.22:0/3968563677 >> v1:172.21.15.116:6789/0 conn(0x7fb63c0b7560 legacy=0x7fb63c1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 -- 172.21.15.22:0/3968563677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c13c5a0 con 0x7fb63c1456e0 2020-07-16T20:30:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb639d9b700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb62c0022d0 tx=0x7fb62c007ed0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c006870 con 0x7fb63c1456e0 2020-07-16T20:30:43.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c0069d0 con 0x7fb63c1456e0 2020-07-16T20:30:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb62c006d30 con 0x7fb63c1456e0 2020-07-16T20:30:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c144910 con 0x7fb63c1456e0 2020-07-16T20:30:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.639+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c13f6e0 con 0x7fb63c1456e0 2020-07-16T20:30:43.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.640+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c0b4e70 con 0x7fb63c1456e0 2020-07-16T20:30:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.640+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb62c019030 con 0x7fb63c1456e0 2020-07-16T20:30:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.641+0000 7fb62a7fc700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 0x7fb610052820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.641+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb62c0675c0 con 0x7fb63c1456e0 2020-07-16T20:30:43.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.641+0000 7fb63a59c700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 0x7fb610052820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.641+0000 7fb63a59c700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 0x7fb610052820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb63000b180 tx=0x7fb630015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.645+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb62c03fcd0 con 0x7fb63c1456e0 2020-07-16T20:30:43.805 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.802+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb63c05f320 con 0x7fb63c1456e0 2020-07-16T20:30:43.807 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.803+0000 7fb62a7fc700 1 -- 172.21.15.22:0/3968563677 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v25) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb62c007b40 con 0x7fb63c1456e0 2020-07-16T20:30:43.807 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2020-07-16T20:30:43.809 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 msgr2=0x7fb610052820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 0x7fb610052820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb63000b180 tx=0x7fb630015000).stop 2020-07-16T20:30:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 msgr2=0x7fb63c1468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.810 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fb62c0022d0 tx=0x7fb62c007ed0).stop 2020-07-16T20:30:43.811 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 shutdown_connections 2020-07-16T20:30:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb610050360 0x7fb610052820 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.812 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 --2- 172.21.15.22:0/3968563677 >> v2:172.21.15.116:3300/0 conn(0x7fb63c13ebb0 0x7fb63c13efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.813 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 --2- 172.21.15.22:0/3968563677 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb63c1456e0 0x7fb63c1468e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.813 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 >> 172.21.15.22:0/3968563677 conn(0x7fb63c0b9660 msgr2=0x7fb63c142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.814 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 shutdown_connections 2020-07-16T20:30:43.815 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.804+0000 7fb640f68700 1 -- 172.21.15.22:0/3968563677 wait complete. 2020-07-16T20:30:43.819 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-07-16T20:30:43.945 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.935+0000 7ff635c7e700 1 Processor -- start 2020-07-16T20:30:43.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.935+0000 7ff635c7e700 1 -- start start 2020-07-16T20:30:43.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff635c7e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff6300b8670 0x7ff6300b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.948 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff635c7e700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 0x7ff63009dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff635c7e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6300b8ff0 con 0x7ff6300b4280 2020-07-16T20:30:43.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff635c7e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6300b3de0 con 0x7ff6300b8670 2020-07-16T20:30:43.949 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff635c7e700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63009f700 con 0x7ff63009d720 2020-07-16T20:30:43.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff6300b8670 0x7ff6300b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff6300b4280 0x7ff63005f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39996/0 (socket says 172.21.15.22:39996) 2020-07-16T20:30:43.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62ffff700 1 -- 172.21.15.22:0/3420850168 learned_addr learned my addr 172.21.15.22:0/3420850168 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 -- 172.21.15.22:0/3420850168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 msgr2=0x7ff63009dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62effd700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 0x7ff63009dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62e7fc700 1 -- 172.21.15.22:0/3420850168 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912044010 0 0) 0x7ff6300b8ff0 con 0x7ff6300b4280 2020-07-16T20:30:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 0x7ff63009dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 -- 172.21.15.22:0/3420850168 >> v1:172.21.15.22:6789/0 conn(0x7ff6300b4280 legacy=0x7ff63005f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 -- 172.21.15.22:0/3420850168 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300b56f0 con 0x7ff6300b8670 2020-07-16T20:30:43.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62effd700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 0x7ff63009dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:43.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.936+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6300b8670 0x7ff6300b8a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff620002f30 tx=0x7ff620006dd0).ready entity=mon.0 client_cookie=3154e764b4f40673 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff62e7fc700 1 -- 172.21.15.22:0/3420850168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6200097f0 con 0x7ff6300b8670 2020-07-16T20:30:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff62e7fc700 1 -- 172.21.15.22:0/3420850168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620009950 con 0x7ff6300b8670 2020-07-16T20:30:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff62e7fc700 1 -- 172.21.15.22:0/3420850168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff620009cb0 con 0x7ff6300b8670 2020-07-16T20:30:43.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 -- 172.21.15.22:0/3420850168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6300b8670 msgr2=0x7ff6300b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6300b8670 0x7ff6300b8a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff620002f30 tx=0x7ff620006dd0).stop 2020-07-16T20:30:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 -- 172.21.15.22:0/3420850168 shutdown_connections 2020-07-16T20:30:43.955 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6300b8670 0x7ff6300b8a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.956 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 --2- 172.21.15.22:0/3420850168 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff63009d720 0x7ff63009dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.956 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 -- 172.21.15.22:0/3420850168 >> 172.21.15.22:0/3420850168 conn(0x7ff6300b9660 msgr2=0x7ff6300b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:43.956 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 -- 172.21.15.22:0/3420850168 shutdown_connections 2020-07-16T20:30:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.937+0000 7ff635c7e700 1 -- 172.21.15.22:0/3420850168 wait complete. 2020-07-16T20:30:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.938+0000 7ff635c7e700 1 Processor -- start 2020-07-16T20:30:43.957 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.938+0000 7ff635c7e700 1 -- start start 2020-07-16T20:30:43.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff635c7e700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff63009d720 0x7ff630063cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff635c7e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff630159710 con 0x7ff6300b4280 2020-07-16T20:30:43.958 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff635c7e700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff630063580 con 0x7ff630146c20 2020-07-16T20:30:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff635c7e700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff630063820 con 0x7ff63009d720 2020-07-16T20:30:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff62effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff6300b4280 0x7ff630066b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40000/0 (socket says 172.21.15.22:40000) 2020-07-16T20:30:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff62effd700 1 -- 172.21.15.22:0/2326446975 learned_addr learned my addr 172.21.15.22:0/2326446975 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:43.959 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935226670 0 0) 0x7ff630159710 con 0x7ff6300b4280 2020-07-16T20:30:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/2326446975 >> v2:172.21.15.116:3300/0 conn(0x7ff63009d720 0x7ff630063cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.939+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff608003240 con 0x7ff6300b4280 2020-07-16T20:30:43.960 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3935356485 0 0) 0x7ff608003240 con 0x7ff6300b4280 2020-07-16T20:30:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff630159710 con 0x7ff6300b4280 2020-07-16T20:30:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369022211 0 0) 0x7ff630063580 con 0x7ff630146c20 2020-07-16T20:30:43.961 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff608003240 con 0x7ff630146c20 2020-07-16T20:30:43.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7ff624001080 con 0x7ff6300b4280 2020-07-16T20:30:43.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 >> v2:172.21.15.116:3300/0 conn(0x7ff63009d720 msgr2=0x7ff630063cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.962 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 --2- 172.21.15.22:0/2326446975 >> v2:172.21.15.116:3300/0 conn(0x7ff63009d720 0x7ff630063cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 >> v1:172.21.15.116:6789/0 conn(0x7ff630146c20 legacy=0x7ff6301589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 >> v1:172.21.15.22:6789/0 conn(0x7ff6300b4280 legacy=0x7ff630066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.963 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 0x7ff608003d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6080044e0 0x7ff608004960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.964 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff608004e50 0x7ff60800b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff630063820 con 0x7ff608003990 2020-07-16T20:30:43.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60800bc20 con 0x7ff6080044e0 2020-07-16T20:30:43.965 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60800bd90 con 0x7ff608004e50 2020-07-16T20:30:43.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 0x7ff608003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62effd700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6080044e0 0x7ff608004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.966 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62ffff700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff608004e50 0x7ff60800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 -- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff608004e50 msgr2=0x7ff60800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff608004e50 0x7ff60800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.967 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 -- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6080044e0 msgr2=0x7ff608004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:43.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff6080044e0 0x7ff608004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:43.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6300641b0 con 0x7ff608003990 2020-07-16T20:30:43.968 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62ffff700 1 -- 172.21.15.22:0/2326446975 reap_dead start 2020-07-16T20:30:43.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff630067270 con 0x7ff608003990 2020-07-16T20:30:43.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff630063e80 con 0x7ff608003990 2020-07-16T20:30:43.969 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff62f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 0x7ff608003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff62001c000 tx=0x7ff620015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff620023030 con 0x7ff608003990 2020-07-16T20:30:43.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62001f650 con 0x7ff608003990 2020-07-16T20:30:43.970 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.940+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff62001f9b0 con 0x7ff608003990 2020-07-16T20:30:43.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.941+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff630067400 con 0x7ff608003990 2020-07-16T20:30:43.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.941+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff62001a040 con 0x7ff608003990 2020-07-16T20:30:43.971 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.942+0000 7ff60f7fe700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 0x7ff608056370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:43.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.942+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff620024070 con 0x7ff608003990 2020-07-16T20:30:43.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.942+0000 7ff62effd700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 0x7ff608056370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:43.972 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.942+0000 7ff62effd700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 0x7ff608056370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff62400e000 tx=0x7ff624008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:43.973 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:43.945+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff630067400 con 0x7ff608003990 2020-07-16T20:30:44.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.103+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff630067400 con 0x7ff608003990 2020-07-16T20:30:44.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.103+0000 7ff60f7fe700 1 -- 172.21.15.22:0/2326446975 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff630067400 con 0x7ff608003990 2020-07-16T20:30:44.105 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:44.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 msgr2=0x7ff608056370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 0x7ff608056370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7ff62400e000 tx=0x7ff624008040).stop 2020-07-16T20:30:44.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 msgr2=0x7ff608003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 0x7ff608003d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff62001c000 tx=0x7ff620015000).stop 2020-07-16T20:30:44.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 shutdown_connections 2020-07-16T20:30:44.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff608053eb0 0x7ff608056370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 --2- 172.21.15.22:0/2326446975 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff608003990 0x7ff608003d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 >> 172.21.15.22:0/2326446975 conn(0x7ff6300b9660 msgr2=0x7ff63009e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 shutdown_connections 2020-07-16T20:30:44.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.105+0000 7ff635c7e700 1 -- 172.21.15.22:0/2326446975 wait complete. 2020-07-16T20:30:44.119 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-07-16T20:30:44.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 Processor -- start 2020-07-16T20:30:44.240 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 -- start start 2020-07-16T20:30:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4400b87b0 0x7ff4400b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff44009f240 0x7ff4400b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44009e030 con 0x7ff4400b7560 2020-07-16T20:30:44.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400b7ee0 con 0x7ff4400b87b0 2020-07-16T20:30:44.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff445cee700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44009daf0 con 0x7ff44009f240 2020-07-16T20:30:44.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.239+0000 7ff43f7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff4400b87b0 0x7ff4400b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43effd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff4400b7560 0x7ff44009cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40012/0 (socket says 172.21.15.22:40012) 2020-07-16T20:30:44.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43effd700 1 -- 172.21.15.22:0/1970119505 learned_addr learned my addr 172.21.15.22:0/1970119505 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:44.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43ffff700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff44009f240 0x7ff4400b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43f7fe700 1 -- 172.21.15.22:0/1970119505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff44009f240 msgr2=0x7ff4400b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43f7fe700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff44009f240 0x7ff4400b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43f7fe700 1 -- 172.21.15.22:0/1970119505 >> v1:172.21.15.22:6789/0 conn(0x7ff4400b7560 legacy=0x7ff44009cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.245 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43f7fe700 1 -- 172.21.15.22:0/1970119505 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44009dd90 con 0x7ff4400b87b0 2020-07-16T20:30:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43f7fe700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4400b87b0 0x7ff4400b4980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff434002f30 tx=0x7ff434006dd0).ready entity=mon.0 client_cookie=f44cd82a70d80883 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43e7fc700 1 -- 172.21.15.22:0/1970119505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4340097f0 con 0x7ff4400b87b0 2020-07-16T20:30:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43e7fc700 1 -- 172.21.15.22:0/1970119505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434009950 con 0x7ff4400b87b0 2020-07-16T20:30:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff43e7fc700 1 -- 172.21.15.22:0/1970119505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff434009cb0 con 0x7ff4400b87b0 2020-07-16T20:30:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 -- 172.21.15.22:0/1970119505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4400b87b0 msgr2=0x7ff4400b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4400b87b0 0x7ff4400b4980 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7ff434002f30 tx=0x7ff434006dd0).stop 2020-07-16T20:30:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 -- 172.21.15.22:0/1970119505 shutdown_connections 2020-07-16T20:30:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff44009f240 0x7ff4400b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 --2- 172.21.15.22:0/1970119505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff4400b87b0 0x7ff4400b4980 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 -- 172.21.15.22:0/1970119505 >> 172.21.15.22:0/1970119505 conn(0x7ff4400b9660 msgr2=0x7ff4400b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 -- 172.21.15.22:0/1970119505 shutdown_connections 2020-07-16T20:30:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.240+0000 7ff445cee700 1 -- 172.21.15.22:0/1970119505 wait complete. 2020-07-16T20:30:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.242+0000 7ff445cee700 1 Processor -- start 2020-07-16T20:30:44.248 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.242+0000 7ff445cee700 1 -- start start 2020-07-16T20:30:44.251 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.242+0000 7ff445cee700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4400b7560 0x7ff4400b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.251 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.242+0000 7ff445cee700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff440064570 0x7ff440140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.251 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff445cee700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff440066ac0 con 0x7ff4400639e0 2020-07-16T20:30:44.251 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff445cee700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400635d0 con 0x7ff440064570 2020-07-16T20:30:44.252 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff445cee700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400640d0 con 0x7ff4400b7560 2020-07-16T20:30:44.252 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff440064570 0x7ff440140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.252 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff440064570 0x7ff440140eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39314/0 (socket says 172.21.15.22:39314) 2020-07-16T20:30:44.252 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 -- 172.21.15.22:0/2252725649 learned_addr learned my addr 172.21.15.22:0/2252725649 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:44.252 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43f7fe700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4400b7560 0x7ff4400b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 -- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4400b7560 msgr2=0x7ff4400b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4400b7560 0x7ff4400b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 -- 172.21.15.22:0/2252725649 >> v1:172.21.15.116:6789/0 conn(0x7ff4400639e0 legacy=0x7ff440145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 -- 172.21.15.22:0/2252725649 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400b3610 con 0x7ff440064570 2020-07-16T20:30:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff43effd700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440064570 0x7ff440140eb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff44005b2e0 tx=0x7ff430007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4300072e0 con 0x7ff440064570 2020-07-16T20:30:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff430007440 con 0x7ff440064570 2020-07-16T20:30:44.255 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff440147670 con 0x7ff440064570 2020-07-16T20:30:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4300057e0 con 0x7ff440064570 2020-07-16T20:30:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.243+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4401413a0 con 0x7ff440064570 2020-07-16T20:30:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.244+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4400633e0 con 0x7ff440064570 2020-07-16T20:30:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.244+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7ff43001a060 con 0x7ff440064570 2020-07-16T20:30:44.256 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.245+0000 7ff41f7fe700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 0x7ff4180522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.245+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff430067090 con 0x7ff440064570 2020-07-16T20:30:44.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.245+0000 7ff43f7fe700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 0x7ff4180522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.245+0000 7ff43f7fe700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 0x7ff4180522f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff43401c000 tx=0x7ff434015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.257 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.248+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7ff43003f820 con 0x7ff440064570 2020-07-16T20:30:44.408 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.406+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff44005f320 con 0x7ff440064570 2020-07-16T20:30:44.409 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.407+0000 7ff41f7fe700 1 -- 172.21.15.22:0/2252725649 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff4300180a0 con 0x7ff440064570 2020-07-16T20:30:44.409 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:44.410 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 msgr2=0x7ff4180522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.410 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 0x7ff4180522f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff43401c000 tx=0x7ff434015000).stop 2020-07-16T20:30:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440064570 msgr2=0x7ff440140eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440064570 0x7ff440140eb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7ff44005b2e0 tx=0x7ff430007be0).stop 2020-07-16T20:30:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 shutdown_connections 2020-07-16T20:30:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7ff41804fe30 0x7ff4180522f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff4400b7560 0x7ff4400b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.412 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 --2- 172.21.15.22:0/2252725649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff440064570 0x7ff440140eb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.412 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 >> 172.21.15.22:0/2252725649 conn(0x7ff4400b9660 msgr2=0x7ff44009ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.412 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 shutdown_connections 2020-07-16T20:30:44.412 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.408+0000 7ff445cee700 1 -- 172.21.15.22:0/2252725649 wait complete. 2020-07-16T20:30:44.420 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-07-16T20:30:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.537+0000 7fa33aa52700 1 Processor -- start 2020-07-16T20:30:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.537+0000 7fa33aa52700 1 -- start start 2020-07-16T20:30:44.545 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 0x7fa3340b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3340b4770 0x7fa334147960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340b4bc0 con 0x7fa3340b8670 2020-07-16T20:30:44.546 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340b8ff0 con 0x7fa3340b4770 2020-07-16T20:30:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340b3de0 con 0x7fa3340b8a50 2020-07-16T20:30:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3340b4770 0x7fa334147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa333fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3340b8670 0x7fa33409d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40026/0 (socket says 172.21.15.22:40026) 2020-07-16T20:30:44.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa333fff700 1 -- 172.21.15.22:0/1661108270 learned_addr learned my addr 172.21.15.22:0/1661108270 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:44.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa3337fe700 1 --2- 172.21.15.22:0/1661108270 >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 0x7fa3340b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 -- 172.21.15.22:0/1661108270 >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 msgr2=0x7fa3340b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 --2- 172.21.15.22:0/1661108270 >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 0x7fa3340b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 -- 172.21.15.22:0/1661108270 >> v1:172.21.15.22:6789/0 conn(0x7fa3340b8670 legacy=0x7fa33409d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa332ffd700 1 -- 172.21.15.22:0/1661108270 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286338702 0 0) 0x7fa3340b4bc0 con 0x7fa3340b8670 2020-07-16T20:30:44.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 -- 172.21.15.22:0/1661108270 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33409de30 con 0x7fa3340b4770 2020-07-16T20:30:44.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa3337fe700 1 --2- 172.21.15.22:0/1661108270 >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 0x7fa3340b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa338fef700 1 --2- 172.21.15.22:0/1661108270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b4770 0x7fa334147960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa3340b4e30 tx=0x7fa32c0091d0).ready entity=mon.0 client_cookie=f2acba3a093d4dd3 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa332ffd700 1 -- 172.21.15.22:0/1661108270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32c009e80 con 0x7fa3340b4770 2020-07-16T20:30:44.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa332ffd700 1 -- 172.21.15.22:0/1661108270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c00bbc0 con 0x7fa3340b4770 2020-07-16T20:30:44.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa332ffd700 1 -- 172.21.15.22:0/1661108270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32c00bd30 con 0x7fa3340b4770 2020-07-16T20:30:44.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- 172.21.15.22:0/1661108270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b4770 msgr2=0x7fa334147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 --2- 172.21.15.22:0/1661108270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b4770 0x7fa334147960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fa3340b4e30 tx=0x7fa32c0091d0).stop 2020-07-16T20:30:44.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- 172.21.15.22:0/1661108270 shutdown_connections 2020-07-16T20:30:44.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 --2- 172.21.15.22:0/1661108270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b4770 0x7fa334147960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 --2- 172.21.15.22:0/1661108270 >> v2:172.21.15.116:3300/0 conn(0x7fa3340b8a50 0x7fa3340b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- 172.21.15.22:0/1661108270 >> 172.21.15.22:0/1661108270 conn(0x7fa3340b9660 msgr2=0x7fa3340b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- 172.21.15.22:0/1661108270 shutdown_connections 2020-07-16T20:30:44.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.538+0000 7fa33aa52700 1 -- 172.21.15.22:0/1661108270 wait complete. 2020-07-16T20:30:44.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.540+0000 7fa33aa52700 1 Processor -- start 2020-07-16T20:30:44.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.540+0000 7fa33aa52700 1 -- start start 2020-07-16T20:30:44.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa33aa52700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3340b8670 0x7fa33413bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.556 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa33aa52700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3340b8a50 0x7fa334146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.556 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa33aa52700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33413c320 con 0x7fa334139200 2020-07-16T20:30:44.556 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa33aa52700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3341365e0 con 0x7fa3340b8a50 2020-07-16T20:30:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa33aa52700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340b26c0 con 0x7fa3340b8670 2020-07-16T20:30:44.557 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa3340b8a50 0x7fa334146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa338fef700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa334139200 0x7fa334158970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40034/0 (socket says 172.21.15.22:40034) 2020-07-16T20:30:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa338fef700 1 -- 172.21.15.22:0/2764602344 learned_addr learned my addr 172.21.15.22:0/2764602344 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa333fff700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3340b8670 0x7fa33413bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 -- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3340b8670 msgr2=0x7fa33413bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3340b8670 0x7fa33413bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 -- 172.21.15.22:0/2764602344 >> v1:172.21.15.22:6789/0 conn(0x7fa334139200 legacy=0x7fa334158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155652181 0 0) 0x7fa33413c320 con 0x7fa334139200 2020-07-16T20:30:44.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 -- 172.21.15.22:0/2764602344 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33413c5c0 con 0x7fa3340b8a50 2020-07-16T20:30:44.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa3337fe700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b8a50 0x7fa334146ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa328007000 tx=0x7fa328008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32800e570 con 0x7fa3340b8a50 2020-07-16T20:30:44.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.541+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32800c030 con 0x7fa3340b8a50 2020-07-16T20:30:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.542+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32800e8c0 con 0x7fa3340b8a50 2020-07-16T20:30:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.542+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33413c860 con 0x7fa3340b8a50 2020-07-16T20:30:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.542+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa334146fd0 con 0x7fa3340b8a50 2020-07-16T20:30:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.542+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33413c9f0 con 0x7fa3340b8a50 2020-07-16T20:30:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.543+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fa328019030 con 0x7fa3340b8a50 2020-07-16T20:30:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.543+0000 7fa313fff700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 0x7fa30c052440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.543+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa3280674a0 con 0x7fa3340b8a50 2020-07-16T20:30:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.543+0000 7fa333fff700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 0x7fa30c052440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.543+0000 7fa333fff700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 0x7fa30c052440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa32400d000 tx=0x7fa324001160).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.546+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fa32803fce0 con 0x7fa3340b8a50 2020-07-16T20:30:44.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.704+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa33405f320 con 0x7fa3340b8a50 2020-07-16T20:30:44.706 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.704+0000 7fa313fff700 1 -- 172.21.15.22:0/2764602344 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa328043300 con 0x7fa3340b8a50 2020-07-16T20:30:44.706 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2020-07-16T20:30:44.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 msgr2=0x7fa30c052440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 0x7fa30c052440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa32400d000 tx=0x7fa324001160).stop 2020-07-16T20:30:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b8a50 msgr2=0x7fa334146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b8a50 0x7fa334146ae0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fa328007000 tx=0x7fa328008040).stop 2020-07-16T20:30:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 shutdown_connections 2020-07-16T20:30:44.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fa30c04ff80 0x7fa30c052440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa3340b8670 0x7fa33413bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 --2- 172.21.15.22:0/2764602344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3340b8a50 0x7fa334146ae0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 >> 172.21.15.22:0/2764602344 conn(0x7fa3340b9660 msgr2=0x7fa33414ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 shutdown_connections 2020-07-16T20:30:44.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.706+0000 7fa33aa52700 1 -- 172.21.15.22:0/2764602344 wait complete. 2020-07-16T20:30:44.717 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-07-16T20:30:44.718 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-07-16T20:30:44.832 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.831+0000 7f3108077700 1 Processor -- start 2020-07-16T20:30:44.833 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.831+0000 7f3108077700 1 -- start start 2020-07-16T20:30:44.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f3100060030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3100142b10 0x7f3100142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f31000b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000b5c20 con 0x7f3100142b10 2020-07-16T20:30:44.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000ae6f0 con 0x7f31000b4fb0 2020-07-16T20:30:44.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3108077700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3100143460 con 0x7f31000b3b30 2020-07-16T20:30:44.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3100142b10 0x7f3100142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3100142b10 0x7f3100142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39334/0 (socket says 172.21.15.22:39334) 2020-07-16T20:30:44.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 -- 172.21.15.22:0/2829080210 learned_addr learned my addr 172.21.15.22:0/2829080210 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:44.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3106614700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f31000b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105e13700 1 --2- 172.21.15.22:0/2829080210 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f3100060030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 -- 172.21.15.22:0/2829080210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 msgr2=0x7f31000b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f31000b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 -- 172.21.15.22:0/2829080210 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 msgr2=0x7f3100060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:44.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 --2- 172.21.15.22:0/2829080210 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f3100060030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 -- 172.21.15.22:0/2829080210 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100060520 con 0x7f3100142b10 2020-07-16T20:30:44.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105e13700 1 --2- 172.21.15.22:0/2829080210 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f3100060030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:44.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.832+0000 7f3105612700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3100142b10 0x7f3100142f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f30fc002f30 tx=0x7f30fc006e90).ready entity=mon.0 client_cookie=ab31e5c9050503e5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3104e11700 1 -- 172.21.15.22:0/2829080210 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30fc009850 con 0x7f3100142b10 2020-07-16T20:30:44.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3104e11700 1 -- 172.21.15.22:0/2829080210 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc0099b0 con 0x7f3100142b10 2020-07-16T20:30:44.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3104e11700 1 -- 172.21.15.22:0/2829080210 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30fc009d10 con 0x7f3100142b10 2020-07-16T20:30:44.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 -- 172.21.15.22:0/2829080210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3100142b10 msgr2=0x7f3100142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3100142b10 0x7f3100142f70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f30fc002f30 tx=0x7f30fc006e90).stop 2020-07-16T20:30:44.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 -- 172.21.15.22:0/2829080210 shutdown_connections 2020-07-16T20:30:44.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f31000b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 --2- 172.21.15.22:0/2829080210 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f3100060030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 --2- 172.21.15.22:0/2829080210 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3100142b10 0x7f3100142f70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 -- 172.21.15.22:0/2829080210 >> 172.21.15.22:0/2829080210 conn(0x7f31000b9530 msgr2=0x7f31000b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:44.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 -- 172.21.15.22:0/2829080210 shutdown_connections 2020-07-16T20:30:44.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.833+0000 7f3108077700 1 -- 172.21.15.22:0/2829080210 wait complete. 2020-07-16T20:30:44.848 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.834+0000 7f3108077700 1 Processor -- start 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.834+0000 7f3108077700 1 -- start start 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f3100149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f31001572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310014aed0 0x7f3100157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310014a0b0 con 0x7f310014aed0 2020-07-16T20:30:44.849 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310014a350 con 0x7f31000b4fb0 2020-07-16T20:30:44.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3108077700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3100149b00 con 0x7f31000b3b30 2020-07-16T20:30:44.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310014aed0 0x7f3100157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310014aed0 0x7f3100157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39340/0 (socket says 172.21.15.22:39340) 2020-07-16T20:30:44.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 -- 172.21.15.22:0/651557303 learned_addr learned my addr 172.21.15.22:0/651557303 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:44.850 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3105e13700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f3100149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3105612700 1 --2- 172.21.15.22:0/651557303 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f31001572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 -- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 msgr2=0x7f3100149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f3100149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 -- 172.21.15.22:0/651557303 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 msgr2=0x7f31001572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:44.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 --2- 172.21.15.22:0/651557303 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f31001572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 -- 172.21.15.22:0/651557303 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100157c80 con 0x7f310014aed0 2020-07-16T20:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f3106614700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310014aed0 0x7f3100157790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f30f8006de0 tx=0x7f30f80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.835+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f800c950 con 0x7f310014aed0 2020-07-16T20:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.836+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f800cab0 con 0x7f310014aed0 2020-07-16T20:30:44.852 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.836+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f800ce10 con 0x7f310014aed0 2020-07-16T20:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.836+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100157f30 con 0x7f310014aed0 2020-07-16T20:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.836+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31000af2e0 con 0x7f310014aed0 2020-07-16T20:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31000aef10 con 0x7f310014aed0 2020-07-16T20:30:44.853 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f30f8022070 con 0x7f310014aed0 2020-07-16T20:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f30edffb700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 0x7f30d8052520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f30f8068290 con 0x7f310014aed0 2020-07-16T20:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f3105e13700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 0x7f30d8052520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:44.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.837+0000 7f3105e13700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 0x7f30d8052520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f30f000c000 tx=0x7f30f0008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:44.858 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:44.840+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f30f8040a20 con 0x7f310014aed0 2020-07-16T20:30:45.051 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.050+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3100149c70 con 0x7f310014aed0 2020-07-16T20:30:45.052 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.050+0000 7f30edffb700 1 -- 172.21.15.22:0/651557303 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2133 (secure 0 0 0) 0x7f3100149c70 con 0x7f310014aed0 2020-07-16T20:30:45.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:45.052 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/3205071775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":3205071775},{"type":"v1","addr":"172.21.15.116:6835","nonce":3205071775}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-07-16T20:30:29.955842+0000","modified":"2020-07-16T20:30:33.948780+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4357},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4357":{"gid":4357,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.22:6833/2653244854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":2653244854},{"type":"v1","addr":"172.21.15.22:6833","nonce":2653244854}]},"join_fscid":-1,"export_targets":[],"features":4540138292837744639,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-07-16T20:30:45.053 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 msgr2=0x7f30d8052520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.053 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 0x7f30d8052520 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f30f000c000 tx=0x7f30f0008040).stop 2020-07-16T20:30:45.054 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310014aed0 msgr2=0x7f3100157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.054 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310014aed0 0x7f3100157790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f30f8006de0 tx=0x7f30f80091d0).stop 2020-07-16T20:30:45.054 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 shutdown_connections 2020-07-16T20:30:45.054 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f30d8050060 0x7f30d8052520 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.054 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310014aed0 0x7f3100157790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.055 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f31000b3b30 0x7f3100149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.055 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 --2- 172.21.15.22:0/651557303 >> v2:172.21.15.116:3300/0 conn(0x7f31000b4fb0 0x7f31001572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.055 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.051+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 >> 172.21.15.22:0/651557303 conn(0x7f31000b9530 msgr2=0x7f31000b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.055 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.052+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 shutdown_connections 2020-07-16T20:30:45.055 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.052+0000 7f3108077700 1 -- 172.21.15.22:0/651557303 wait complete. 2020-07-16T20:30:45.056 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2020-07-16T20:30:45.264 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-07-16T20:30:29.955842+0000', 'modified': '2020-07-16T20:30:33.948780+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4357}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4357': {'gid': 4357, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.22:6833/2653244854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6832', 'nonce': 2653244854}, {'type': 'v1', 'addr': '172.21.15.22:6833', 'nonce': 2653244854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292837744639, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-07-16T20:30:45.265 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-07-16T20:30:45.266 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-07-16T20:30:45.405 INFO:teuthology.orchestra.run.smithi022.stdout:{"cluster_fsid":"70778c64-6d4b-4710-8151-64d2394b5553","whoami":0,"id":4357,"want_state":"up:active","state":"up:active","rank_uptime":12.450243035,"mdsmap_epoch":5,"osdmap_epoch":25,"osdmap_epoch_barrier":25,"uptime":13.029842121} 2020-07-16T20:30:45.406 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "70778c64-6d4b-4710-8151-64d2394b5553", "id": 4357, "mdsmap_epoch": 5, "osdmap_epoch": 25, "osdmap_epoch_barrier": 25, "rank_uptime": 12.450243035, "state": "up:active", "uptime": 13.029842121, "want_state": "up:active", "whoami": 0 } 2020-07-16T20:30:45.407 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-07-16T20:30:45.407 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-07-16T20:30:45.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:45.408 INFO:teuthology.orchestra.run.smithi022:> ip addr 2020-07-16T20:30:45.424 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-07-16T20:30:45.425 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-07-16T20:30:45.425 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2020-07-16T20:30:45.425 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:30:45.425 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2020-07-16T20:30:45.426 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:30:45.426 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:30:45.426 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2020-07-16T20:30:45.426 INFO:teuthology.orchestra.run.smithi022.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2020-07-16T20:30:45.427 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:30:45.427 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2020-07-16T20:30:45.427 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42824sec preferred_lft 42824sec 2020-07-16T20:30:45.427 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2020-07-16T20:30:45.428 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2020-07-16T20:30:45.428 INFO:teuthology.orchestra.run.smithi022.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:30:45.428 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2020-07-16T20:30:45.429 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-07-16T20:30:45.429 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2020-07-16T20:30:45.430 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-07-16T20:30:45.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-07-16T20:30:45.432 INFO:teuthology.orchestra.run.smithi022:> (cd /home/teuthworker && exec sudo bash -c ' 2020-07-16T20:30:45.433 INFO:teuthology.orchestra.run.smithi022:> set -e 2020-07-16T20:30:45.434 INFO:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2020-07-16T20:30:45.434 INFO:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2020-07-16T20:30:45.435 INFO:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2020-07-16T20:30:45.435 INFO:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-07-16T20:30:45.436 INFO:teuthology.orchestra.run.smithi022:> ') 2020-07-16T20:30:45.479 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 0: cd: /home/teuthworker: No such file or directory 2020-07-16T20:30:45.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-07-16T20:30:45.481 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 93, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/ceph_fuse.py", line 157, in task info["mount"].mount(mountpoint=mountpoint, mount_path=mount_path) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/fuse_mount.py", line 33, in mount self.setup_netns() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 303, in setup_netns self._setup_brx_and_nat() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 136, in _setup_brx_and_nat """, cwd=os.getcwd(), timeout=(5*60), omit_sudo=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 529, in run_shell_payload return self.run_shell(["bash", "-c", Raw(f"'{payload}'")], **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 526, in run_shell timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: "(cd /home/teuthworker && exec sudo bash -c '\n set -e\n sudo ip link add name ceph-brx type bridge\n sudo ip addr flush dev ceph-brx\n sudo ip link set ceph-brx up\n sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx\n ')" 2020-07-16T20:30:45.523 ERROR:teuthology.run_tasks: Sentry event: http://sentry.ceph.com/sepia/teuthology/?q=5dfa5af1bcdf4fc087691c5850eb03f5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 93, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/ceph_fuse.py", line 157, in task info["mount"].mount(mountpoint=mountpoint, mount_path=mount_path) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/fuse_mount.py", line 33, in mount self.setup_netns() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 303, in setup_netns self._setup_brx_and_nat() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 136, in _setup_brx_and_nat """, cwd=os.getcwd(), timeout=(5*60), omit_sudo=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 529, in run_shell_payload return self.run_shell(["bash", "-c", Raw(f"'{payload}'")], **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200716.140830/qa/tasks/cephfs/mount.py", line 526, in run_shell timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 204, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 160, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 182, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: "(cd /home/teuthworker && exec sudo bash -c '\n set -e\n sudo ip link add name ceph-brx type bridge\n sudo ip addr flush dev ceph-brx\n sudo ip link set ceph-brx up\n sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx\n ')" 2020-07-16T20:30:45.524 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2020-07-16T20:30:45.535 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-07-16T20:30:45.563 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-07-16T20:30:45.564 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 Processor -- start 2020-07-16T20:30:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 -- start start 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f382009dc70 0x7f38201475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f382009e050 0x7f3820144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f38200b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820147ed0 con 0x7f382009dc70 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820148170 con 0x7f382009e050 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.681+0000 7f3826e5a700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382009cb10 con 0x7f3820144780 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f382009dc70 0x7f38201475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f382009dc70 0x7f38201475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39346/0 (socket says 172.21.15.22:39346) 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 -- 172.21.15.22:0/3825150146 learned_addr learned my addr 172.21.15.22:0/3825150146 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f38253f7700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f38200b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f381ffff700 1 --2- 172.21.15.22:0/3825150146 >> v2:172.21.15.116:3300/0 conn(0x7f382009e050 0x7f3820144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 -- 172.21.15.22:0/3825150146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 msgr2=0x7f38200b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f38200b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 -- 172.21.15.22:0/3825150146 >> v2:172.21.15.116:3300/0 conn(0x7f382009e050 msgr2=0x7f3820144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 --2- 172.21.15.22:0/3825150146 >> v2:172.21.15.116:3300/0 conn(0x7f382009e050 0x7f3820144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 -- 172.21.15.22:0/3825150146 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382009cc80 con 0x7f382009dc70 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3824bf6700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f382009dc70 0x7f38201475c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3810002f30 tx=0x7f3810006e90).ready entity=mon.0 client_cookie=cfd325bc1f5b8202 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f381f7fe700 1 -- 172.21.15.22:0/3825150146 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3810009850 con 0x7f382009dc70 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f381f7fe700 1 -- 172.21.15.22:0/3825150146 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100099b0 con 0x7f382009dc70 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f381f7fe700 1 -- 172.21.15.22:0/3825150146 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3810009d10 con 0x7f382009dc70 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 -- 172.21.15.22:0/3825150146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f382009dc70 msgr2=0x7f38201475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.689 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f382009dc70 0x7f38201475c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3810002f30 tx=0x7f3810006e90).stop 2020-07-16T20:30:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 -- 172.21.15.22:0/3825150146 shutdown_connections 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f382009dc70 0x7f38201475c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 --2- 172.21.15.22:0/3825150146 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f38200b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 --2- 172.21.15.22:0/3825150146 >> v2:172.21.15.116:3300/0 conn(0x7f382009e050 0x7f3820144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 -- 172.21.15.22:0/3825150146 >> 172.21.15.22:0/3825150146 conn(0x7f38200b9530 msgr2=0x7f38200b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 -- 172.21.15.22:0/3825150146 shutdown_connections 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.682+0000 7f3826e5a700 1 -- 172.21.15.22:0/3825150146 wait complete. 2020-07-16T20:30:45.699 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.684+0000 7f3826e5a700 1 Processor -- start 2020-07-16T20:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.684+0000 7f3826e5a700 1 -- start start 2020-07-16T20:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f3826e5a700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f3820158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f3826e5a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200670f0 con 0x7f3820064fd0 2020-07-16T20:30:45.702 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f3826e5a700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3820067390 con 0x7f382009e050 2020-07-16T20:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f3826e5a700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38201434d0 con 0x7f3820144780 2020-07-16T20:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f38253f7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3820064fd0 0x7f3820158d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40062/0 (socket says 172.21.15.22:40062) 2020-07-16T20:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f38253f7700 1 -- 172.21.15.22:0/908435488 learned_addr learned my addr 172.21.15.22:0/908435488 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381ffff700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f3820158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.703 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043360929 0 0) 0x7f38200670f0 con 0x7f3820064fd0 2020-07-16T20:30:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37f8003240 con 0x7f3820064fd0 2020-07-16T20:30:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875552316 0 0) 0x7f3820067390 con 0x7f382009e050 2020-07-16T20:30:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38200670f0 con 0x7f382009e050 2020-07-16T20:30:45.704 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1605091422 0 0) 0x7f37f8003240 con 0x7f3820064fd0 2020-07-16T20:30:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381ffff700 1 -- 172.21.15.22:0/908435488 >> v1:172.21.15.116:6789/0 conn(0x7f382009e050 legacy=0x7f3820066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381ffff700 1 -- 172.21.15.22:0/908435488 >> v1:172.21.15.22:6789/0 conn(0x7f3820064fd0 legacy=0x7f3820158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381ffff700 1 -- 172.21.15.22:0/908435488 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820159460 con 0x7f3820144780 2020-07-16T20:30:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.685+0000 7f381ffff700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f3820158860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f38200b2890 tx=0x7f3814008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3818001810 con 0x7f3820144780 2020-07-16T20:30:45.707 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820063a10 con 0x7f3820144780 2020-07-16T20:30:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381400f640 con 0x7f3820144780 2020-07-16T20:30:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381400f9a0 con 0x7f3820144780 2020-07-16T20:30:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382013dd70 con 0x7f3820144780 2020-07-16T20:30:45.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.686+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38201596b0 con 0x7f3820144780 2020-07-16T20:30:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.687+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f381401a030 con 0x7f3820144780 2020-07-16T20:30:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.687+0000 7f381cff9700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 0x7f37f8052930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.687+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f38140674d0 con 0x7f3820144780 2020-07-16T20:30:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.687+0000 7f3824bf6700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 0x7f37f8052930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.688+0000 7f3824bf6700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 0x7f37f8052930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3810006b60 tx=0x7f3810015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:45.718 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.691+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f381403fb80 con 0x7f3820144780 2020-07-16T20:30:45.851 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.849+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3820143610 con 0x7f3820144780 2020-07-16T20:30:45.854 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.851+0000 7f381cff9700 1 -- 172.21.15.22:0/908435488 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7f38140431a0 con 0x7f3820144780 2020-07-16T20:30:45.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 msgr2=0x7f37f8052930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 0x7f37f8052930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3810006b60 tx=0x7f3810015000).stop 2020-07-16T20:30:45.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 msgr2=0x7f3820158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.855 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f3820158860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f38200b2890 tx=0x7f3814008040).stop 2020-07-16T20:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 shutdown_connections 2020-07-16T20:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f37f8050470 0x7f37f8052930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 --2- 172.21.15.22:0/908435488 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3820144780 0x7f3820158860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 >> 172.21.15.22:0/908435488 conn(0x7f38200b9530 msgr2=0x7f3820144d60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:45.856 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 shutdown_connections 2020-07-16T20:30:45.857 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.852+0000 7f3826e5a700 1 -- 172.21.15.22:0/908435488 wait complete. 2020-07-16T20:30:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:45.857 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:45.864 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:30:45.989 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.979+0000 7f83fedd0700 1 Processor -- start 2020-07-16T20:30:45.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.979+0000 7f83fedd0700 1 -- start start 2020-07-16T20:30:45.990 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fedd0700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f83f80b4fb0 0x7f83f8060030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fedd0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b5c20 con 0x7f83f814ac40 2020-07-16T20:30:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fedd0700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80ae6f0 con 0x7f83f8142b10 2020-07-16T20:30:45.991 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fedd0700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f8060520 con 0x7f83f80b4fb0 2020-07-16T20:30:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fd36d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f83f814ac40 0x7f83f814d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40070/0 (socket says 172.21.15.22:40070) 2020-07-16T20:30:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fd36d700 1 -- 172.21.15.22:0/933979922 learned_addr learned my addr 172.21.15.22:0/933979922 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:45.992 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116810823 0 0) 0x7f83f80b5c20 con 0x7f83f814ac40 2020-07-16T20:30:45.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e4003240 con 0x7f83f814ac40 2020-07-16T20:30:45.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fcb6c700 1 --2- 172.21.15.22:0/933979922 >> v2:172.21.15.116:3300/0 conn(0x7f83f80b4fb0 0x7f83f8060030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3209187835 0 0) 0x7f83e4003240 con 0x7f83f814ac40 2020-07-16T20:30:45.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 >> v2:172.21.15.116:3300/0 conn(0x7f83f80b4fb0 msgr2=0x7f83f8060030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.993 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 --2- 172.21.15.22:0/933979922 >> v2:172.21.15.116:3300/0 conn(0x7f83f80b4fb0 0x7f83f8060030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 >> v1:172.21.15.116:6789/0 conn(0x7f83f8142b10 legacy=0x7f83f8142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8060660 con 0x7f83f814ac40 2020-07-16T20:30:45.994 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f83f0001a50 con 0x7f83f814ac40 2020-07-16T20:30:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 >> v1:172.21.15.22:6789/0 conn(0x7f83f814ac40 legacy=0x7f83f814d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83e4003730 0x7f83e4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.995 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83e40044e0 0x7f83e4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 0x7f83e400c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8060520 con 0x7f83e4004e50 2020-07-16T20:30:45.996 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e4004350 con 0x7f83e4003730 2020-07-16T20:30:45.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e400cd60 con 0x7f83e40044e0 2020-07-16T20:30:45.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fd36d700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 0x7f83e400c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.997 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.980+0000 7f83fcb6c700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83e4003730 0x7f83e4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.998 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83f7fff700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83e40044e0 0x7f83e4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:45.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 -- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83e40044e0 msgr2=0x7f83e4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83e40044e0 0x7f83e4004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 -- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83e4003730 msgr2=0x7f83e4003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:45.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f83e4003730 0x7f83e4003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:45.999 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 -- 172.21.15.22:0/933979922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e4003240 con 0x7f83e4004e50 2020-07-16T20:30:46.000 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 -- 172.21.15.22:0/933979922 reap_dead start 2020-07-16T20:30:46.001 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fd36d700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 0x7f83e400c840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f83f0001760 tx=0x7f83f809c6f0).ready entity=mon.0 client_cookie=4dcc3d460065deb server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0005b80 con 0x7f83e4004e50 2020-07-16T20:30:46.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0005ce0 con 0x7f83e4004e50 2020-07-16T20:30:46.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83f77fe700 1 -- 172.21.15.22:0/933979922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f00072c0 con 0x7f83e4004e50 2020-07-16T20:30:46.002 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 -- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 msgr2=0x7f83e400c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 0x7f83e400c840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f83f0001760 tx=0x7f83f809c6f0).stop 2020-07-16T20:30:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 -- 172.21.15.22:0/933979922 shutdown_connections 2020-07-16T20:30:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 --2- 172.21.15.22:0/933979922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83e4004e50 0x7f83e400c840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 -- 172.21.15.22:0/933979922 >> 172.21.15.22:0/933979922 conn(0x7f83f80b9530 msgr2=0x7f83f80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.003 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 -- 172.21.15.22:0/933979922 shutdown_connections 2020-07-16T20:30:46.004 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.981+0000 7f83fedd0700 1 -- 172.21.15.22:0/933979922 wait complete. 2020-07-16T20:30:46.004 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 Processor -- start 2020-07-16T20:30:46.004 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 -- start start 2020-07-16T20:30:46.004 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f83f8065c20 0x7f83f8064ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.004 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f83f8062db0 0x7f83f80aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.005 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80b1570 con 0x7f83f80afd90 2020-07-16T20:30:46.005 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80b17a0 con 0x7f83f8062db0 2020-07-16T20:30:46.007 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.983+0000 7f83fedd0700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80b1a40 con 0x7f83f8065c20 2020-07-16T20:30:46.007 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fcb6c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f83f80afd90 0x7f83f80b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40078/0 (socket says 172.21.15.22:40078) 2020-07-16T20:30:46.007 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fcb6c700 1 -- 172.21.15.22:0/3430099931 learned_addr learned my addr 172.21.15.22:0/3430099931 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:46.008 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 --2- 172.21.15.22:0/3430099931 >> v2:172.21.15.22:3300/0 conn(0x7f83f8062db0 0x7f83f80aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.008 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f7fff700 1 --2- 172.21.15.22:0/3430099931 >> v2:172.21.15.116:3300/0 conn(0x7f83f8065c20 0x7f83f8064ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.008 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696908649 0 0) 0x7f83f80b1570 con 0x7f83f80afd90 2020-07-16T20:30:46.008 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4003240 con 0x7f83f80afd90 2020-07-16T20:30:46.008 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 -- 172.21.15.22:0/3430099931 >> v2:172.21.15.116:3300/0 conn(0x7f83f8065c20 msgr2=0x7f83f8064ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 --2- 172.21.15.22:0/3430099931 >> v2:172.21.15.116:3300/0 conn(0x7f83f8065c20 0x7f83f8064ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 -- 172.21.15.22:0/3430099931 >> v1:172.21.15.22:6789/0 conn(0x7f83f80afd90 legacy=0x7f83f80b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 -- 172.21.15.22:0/3430099931 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80b1ce0 con 0x7f83f8062db0 2020-07-16T20:30:46.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fd36d700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83f8062db0 0x7f83f80aeab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f83f0001760 tx=0x7f83f0013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0005b80 con 0x7f83f8062db0 2020-07-16T20:30:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0007800 con 0x7f83f8062db0 2020-07-16T20:30:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80b2890 con 0x7f83f8062db0 2020-07-16T20:30:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83f0013e70 con 0x7f83f8062db0 2020-07-16T20:30:46.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.984+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80638b0 con 0x7f83f8062db0 2020-07-16T20:30:46.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.985+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f805f320 con 0x7f83f8062db0 2020-07-16T20:30:46.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.985+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f83f001c020 con 0x7f83f8062db0 2020-07-16T20:30:46.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.986+0000 7f83f4ff9700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 0x7f83d40527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.986+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f83f0067ea0 con 0x7f83f8062db0 2020-07-16T20:30:46.012 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.986+0000 7f83fcb6c700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 0x7f83d40527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.012 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.986+0000 7f83fcb6c700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 0x7f83d40527f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f83e800c000 tx=0x7f83e8008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.013 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:45.989+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f83f0040660 con 0x7f83f8062db0 2020-07-16T20:30:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.141+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83f8043fd0 con 0x7f83d4050330 2020-07-16T20:30:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.144+0000 7f83f4ff9700 1 -- 172.21.15.22:0/3430099931 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82358 (secure 0 0 0) 0x7f83f8043fd0 con 0x7f83d4050330 2020-07-16T20:30:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 msgr2=0x7f83d40527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 0x7f83d40527f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f83e800c000 tx=0x7f83e8008040).stop 2020-07-16T20:30:46.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83f8062db0 msgr2=0x7f83f80aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.150 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83f8062db0 0x7f83f80aeab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f83f0001760 tx=0x7f83f0013000).stop 2020-07-16T20:30:46.150 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 shutdown_connections 2020-07-16T20:30:46.150 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f83d4050330 0x7f83d40527f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.151 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 --2- 172.21.15.22:0/3430099931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83f8062db0 0x7f83f80aeab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.151 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 --2- 172.21.15.22:0/3430099931 >> v2:172.21.15.116:3300/0 conn(0x7f83f8065c20 0x7f83f8064ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.151 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 >> 172.21.15.22:0/3430099931 conn(0x7f83f80b9530 msgr2=0x7f83f809ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 shutdown_connections 2020-07-16T20:30:46.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.145+0000 7f83fedd0700 1 -- 172.21.15.22:0/3430099931 wait complete. 2020-07-16T20:30:46.152 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2020-07-16T20:30:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:46.158 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2020-07-16T20:30:45.331372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":889008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002884"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960978+0000","last_change":"2020-07-16T20:30:29.590733+0000","last_active":"2020-07-16T20:30:29.960978+0000","last_peered":"2020-07-16T20:30:29.960978+0000","last_clean":"2020-07-16T20:30:29.960978+0000","last_became_active":"2020-07-16T20:30:29.590030+0000","last_became_peered":"2020-07-16T20:30:29.590030+0000","last_unstale":"2020-07-16T20:30:29.960978+0000","last_undegraded":"2020-07-16T20:30:29.960978+0000","last_fullsized":"2020-07-16T20:30:29.960978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970487+0000","last_change":"2020-07-16T20:30:23.564026+0000","last_active":"2020-07-16T20:30:29.970487+0000","last_peered":"2020-07-16T20:30:29.970487+0000","last_clean":"2020-07-16T20:30:29.970487+0000","last_became_active":"2020-07-16T20:30:23.563591+0000","last_became_peered":"2020-07-16T20:30:23.563591+0000","last_unstale":"2020-07-16T20:30:29.970487+0000","last_undegraded":"2020-07-16T20:30:29.970487+0000","last_fullsized":"2020-07-16T20:30:29.970487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.959365+0000","last_change":"2020-07-16T20:30:26.577657+0000","last_active":"2020-07-16T20:30:32.959365+0000","last_peered":"2020-07-16T20:30:32.959365+0000","last_clean":"2020-07-16T20:30:32.959365+0000","last_became_active":"2020-07-16T20:30:26.577264+0000","last_became_peered":"2020-07-16T20:30:26.577264+0000","last_unstale":"2020-07-16T20:30:32.959365+0000","last_undegraded":"2020-07-16T20:30:32.959365+0000","last_fullsized":"2020-07-16T20:30:32.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961017+0000","last_change":"2020-07-16T20:30:29.819730+0000","last_active":"2020-07-16T20:30:29.961017+0000","last_peered":"2020-07-16T20:30:29.961017+0000","last_clean":"2020-07-16T20:30:29.961017+0000","last_became_active":"2020-07-16T20:30:29.819079+0000","last_became_peered":"2020-07-16T20:30:29.819079+0000","last_unstale":"2020-07-16T20:30:29.961017+0000","last_undegraded":"2020-07-16T20:30:29.961017+0000","last_fullsized":"2020-07-16T20:30:29.961017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972715+0000","last_change":"2020-07-16T20:30:23.565160+0000","last_active":"2020-07-16T20:30:29.972715+0000","last_peered":"2020-07-16T20:30:29.972715+0000","last_clean":"2020-07-16T20:30:29.972715+0000","last_became_active":"2020-07-16T20:30:23.564708+0000","last_became_peered":"2020-07-16T20:30:23.564708+0000","last_unstale":"2020-07-16T20:30:29.972715+0000","last_undegraded":"2020-07-16T20:30:29.972715+0000","last_fullsized":"2020-07-16T20:30:29.972715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.956474+0000","last_change":"2020-07-16T20:30:26.576566+0000","last_active":"2020-07-16T20:30:32.956474+0000","last_peered":"2020-07-16T20:30:32.956474+0000","last_clean":"2020-07-16T20:30:32.956474+0000","last_became_active":"2020-07-16T20:30:26.576206+0000","last_became_peered":"2020-07-16T20:30:26.576206+0000","last_unstale":"2020-07-16T20:30:32.956474+0000","last_undegraded":"2020-07-16T20:30:32.956474+0000","last_fullsized":"2020-07-16T20:30:32.956474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964620+0000","last_change":"2020-07-16T20:30:29.963501+0000","last_active":"2020-07-16T20:30:29.964620+0000","last_peered":"2020-07-16T20:30:29.964620+0000","last_clean":"2020-07-16T20:30:29.964620+0000","last_became_active":"2020-07-16T20:30:29.962701+0000","last_became_peered":"2020-07-16T20:30:29.962701+0000","last_unstale":"2020-07-16T20:30:29.964620+0000","last_undegraded":"2020-07-16T20:30:29.964620+0000","last_fullsized":"2020-07-16T20:30:29.964620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960393+0000","last_change":"2020-07-16T20:30:23.563276+0000","last_active":"2020-07-16T20:30:29.960393+0000","last_peered":"2020-07-16T20:30:29.960393+0000","last_clean":"2020-07-16T20:30:29.960393+0000","last_became_active":"2020-07-16T20:30:23.562833+0000","last_became_peered":"2020-07-16T20:30:23.562833+0000","last_unstale":"2020-07-16T20:30:29.960393+0000","last_undegraded":"2020-07-16T20:30:29.960393+0000","last_fullsized":"2020-07-16T20:30:29.960393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.963350+0000","last_change":"2020-07-16T20:30:26.728399+0000","last_active":"2020-07-16T20:30:32.963350+0000","last_peered":"2020-07-16T20:30:32.963350+0000","last_clean":"2020-07-16T20:30:32.963350+0000","last_became_active":"2020-07-16T20:30:26.727822+0000","last_became_peered":"2020-07-16T20:30:26.727822+0000","last_unstale":"2020-07-16T20:30:32.963350+0000","last_undegraded":"2020-07-16T20:30:32.963350+0000","last_fullsized":"2020-07-16T20:30:32.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972314+0000","last_change":"2020-07-16T20:30:29.963087+0000","last_active":"2020-07-16T20:30:29.972314+0000","last_peered":"2020-07-16T20:30:29.972314+0000","last_clean":"2020-07-16T20:30:29.972314+0000","last_became_active":"2020-07-16T20:30:29.962463+0000","last_became_peered":"2020-07-16T20:30:29.962463+0000","last_unstale":"2020-07-16T20:30:29.972314+0000","last_undegraded":"2020-07-16T20:30:29.972314+0000","last_fullsized":"2020-07-16T20:30:29.972314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972497+0000","last_change":"2020-07-16T20:30:23.564311+0000","last_active":"2020-07-16T20:30:29.972497+0000","last_peered":"2020-07-16T20:30:29.972497+0000","last_clean":"2020-07-16T20:30:29.972497+0000","last_became_active":"2020-07-16T20:30:23.563870+0000","last_became_peered":"2020-07-16T20:30:23.563870+0000","last_unstale":"2020-07-16T20:30:29.972497+0000","last_undegraded":"2020-07-16T20:30:29.972497+0000","last_fullsized":"2020-07-16T20:30:29.972497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970024+0000","last_change":"2020-07-16T20:30:18.798690+0000","last_active":"2020-07-16T20:30:29.970024+0000","last_peered":"2020-07-16T20:30:29.970024+0000","last_clean":"2020-07-16T20:30:29.970024+0000","last_became_active":"2020-07-16T20:30:18.798374+0000","last_became_peered":"2020-07-16T20:30:18.798374+0000","last_unstale":"2020-07-16T20:30:29.970024+0000","last_undegraded":"2020-07-16T20:30:29.970024+0000","last_fullsized":"2020-07-16T20:30:29.970024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_clean_scrub_stamp":"2020-07-16T20:30:11.506317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:31.122600+0000","last_change":"2020-07-16T20:30:26.575513+0000","last_active":"2020-07-16T20:30:31.122600+0000","last_peered":"2020-07-16T20:30:31.122600+0000","last_clean":"2020-07-16T20:30:31.122600+0000","last_became_active":"2020-07-16T20:30:26.575008+0000","last_became_peered":"2020-07-16T20:30:26.575008+0000","last_unstale":"2020-07-16T20:30:31.122600+0000","last_undegraded":"2020-07-16T20:30:31.122600+0000","last_fullsized":"2020-07-16T20:30:31.122600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970256+0000","last_change":"2020-07-16T20:30:29.962769+0000","last_active":"2020-07-16T20:30:29.970256+0000","last_peered":"2020-07-16T20:30:29.970256+0000","last_clean":"2020-07-16T20:30:29.970256+0000","last_became_active":"2020-07-16T20:30:29.962094+0000","last_became_peered":"2020-07-16T20:30:29.962094+0000","last_unstale":"2020-07-16T20:30:29.970256+0000","last_undegraded":"2020-07-16T20:30:29.970256+0000","last_fullsized":"2020-07-16T20:30:29.970256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972436+0000","last_change":"2020-07-16T20:30:23.565757+0000","last_active":"2020-07-16T20:30:29.972436+0000","last_peered":"2020-07-16T20:30:29.972436+0000","last_clean":"2020-07-16T20:30:29.972436+0000","last_became_active":"2020-07-16T20:30:23.565340+0000","last_became_peered":"2020-07-16T20:30:23.565340+0000","last_unstale":"2020-07-16T20:30:29.972436+0000","last_undegraded":"2020-07-16T20:30:29.972436+0000","last_fullsized":"2020-07-16T20:30:29.972436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961060+0000","last_change":"2020-07-16T20:30:26.576938+0000","last_active":"2020-07-16T20:30:29.961060+0000","last_peered":"2020-07-16T20:30:29.961060+0000","last_clean":"2020-07-16T20:30:29.961060+0000","last_became_active":"2020-07-16T20:30:26.576529+0000","last_became_peered":"2020-07-16T20:30:26.576529+0000","last_unstale":"2020-07-16T20:30:29.961060+0000","last_undegraded":"2020-07-16T20:30:29.961060+0000","last_fullsized":"2020-07-16T20:30:29.961060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961144+0000","last_change":"2020-07-16T20:30:29.819984+0000","last_active":"2020-07-16T20:30:29.961144+0000","last_peered":"2020-07-16T20:30:29.961144+0000","last_clean":"2020-07-16T20:30:29.961144+0000","last_became_active":"2020-07-16T20:30:29.819257+0000","last_became_peered":"2020-07-16T20:30:29.819257+0000","last_unstale":"2020-07-16T20:30:29.961144+0000","last_undegraded":"2020-07-16T20:30:29.961144+0000","last_fullsized":"2020-07-16T20:30:29.961144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972741+0000","last_change":"2020-07-16T20:30:23.564144+0000","last_active":"2020-07-16T20:30:29.972741+0000","last_peered":"2020-07-16T20:30:29.972741+0000","last_clean":"2020-07-16T20:30:29.972741+0000","last_became_active":"2020-07-16T20:30:23.563690+0000","last_became_peered":"2020-07-16T20:30:23.563690+0000","last_unstale":"2020-07-16T20:30:29.972741+0000","last_undegraded":"2020-07-16T20:30:29.972741+0000","last_fullsized":"2020-07-16T20:30:29.972741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.962719+0000","last_change":"2020-07-16T20:30:26.579571+0000","last_active":"2020-07-16T20:30:32.962719+0000","last_peered":"2020-07-16T20:30:32.962719+0000","last_clean":"2020-07-16T20:30:32.962719+0000","last_became_active":"2020-07-16T20:30:26.579193+0000","last_became_peered":"2020-07-16T20:30:26.579193+0000","last_unstale":"2020-07-16T20:30:32.962719+0000","last_undegraded":"2020-07-16T20:30:32.962719+0000","last_fullsized":"2020-07-16T20:30:32.962719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970842+0000","last_change":"2020-07-16T20:30:29.962943+0000","last_active":"2020-07-16T20:30:29.970842+0000","last_peered":"2020-07-16T20:30:29.970842+0000","last_clean":"2020-07-16T20:30:29.970842+0000","last_became_active":"2020-07-16T20:30:29.962240+0000","last_became_peered":"2020-07-16T20:30:29.962240+0000","last_unstale":"2020-07-16T20:30:29.970842+0000","last_undegraded":"2020-07-16T20:30:29.970842+0000","last_fullsized":"2020-07-16T20:30:29.970842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.961561+0000","last_change":"2020-07-16T20:30:26.578033+0000","last_active":"2020-07-16T20:30:32.961561+0000","last_peered":"2020-07-16T20:30:32.961561+0000","last_clean":"2020-07-16T20:30:32.961561+0000","last_became_active":"2020-07-16T20:30:26.577510+0000","last_became_peered":"2020-07-16T20:30:26.577510+0000","last_unstale":"2020-07-16T20:30:32.961561+0000","last_undegraded":"2020-07-16T20:30:32.961561+0000","last_fullsized":"2020-07-16T20:30:32.961561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.971041+0000","last_change":"2020-07-16T20:30:23.565353+0000","last_active":"2020-07-16T20:30:29.971041+0000","last_peered":"2020-07-16T20:30:29.971041+0000","last_clean":"2020-07-16T20:30:29.971041+0000","last_became_active":"2020-07-16T20:30:23.565031+0000","last_became_peered":"2020-07-16T20:30:23.565031+0000","last_unstale":"2020-07-16T20:30:29.971041+0000","last_undegraded":"2020-07-16T20:30:29.971041+0000","last_fullsized":"2020-07-16T20:30:29.971041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964572+0000","last_change":"2020-07-16T20:30:29.962904+0000","last_active":"2020-07-16T20:30:29.964572+0000","last_peered":"2020-07-16T20:30:29.964572+0000","last_clean":"2020-07-16T20:30:29.964572+0000","last_became_active":"2020-07-16T20:30:29.962274+0000","last_became_peered":"2020-07-16T20:30:29.962274+0000","last_unstale":"2020-07-16T20:30:29.964572+0000","last_undegraded":"2020-07-16T20:30:29.964572+0000","last_fullsized":"2020-07-16T20:30:29.964572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972529+0000","last_change":"2020-07-16T20:30:23.565324+0000","last_active":"2020-07-16T20:30:29.972529+0000","last_peered":"2020-07-16T20:30:29.972529+0000","last_clean":"2020-07-16T20:30:29.972529+0000","last_became_active":"2020-07-16T20:30:23.564073+0000","last_became_peered":"2020-07-16T20:30:23.564073+0000","last_unstale":"2020-07-16T20:30:29.972529+0000","last_undegraded":"2020-07-16T20:30:29.972529+0000","last_fullsized":"2020-07-16T20:30:29.972529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.958525+0000","last_change":"2020-07-16T20:30:26.728247+0000","last_active":"2020-07-16T20:30:32.958525+0000","last_peered":"2020-07-16T20:30:32.958525+0000","last_clean":"2020-07-16T20:30:32.958525+0000","last_became_active":"2020-07-16T20:30:26.727617+0000","last_became_peered":"2020-07-16T20:30:26.727617+0000","last_unstale":"2020-07-16T20:30:32.958525+0000","last_undegraded":"2020-07-16T20:30:32.958525+0000","last_fullsized":"2020-07-16T20:30:32.958525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":112820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.569}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":110744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":111125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]}]}]}} 2020-07-16T20:30:46.219 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-07-16T20:30:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.333+0000 7fc86ca8c700 1 Processor -- start 2020-07-16T20:30:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.333+0000 7fc86ca8c700 1 -- start start 2020-07-16T20:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.333+0000 7fc86ca8c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8680b0420 0x7fc8680b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868147be0 0x7fc868148040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.337 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8680b0b70 con 0x7fc86809c5a0 2020-07-16T20:30:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc868148530 con 0x7fc8680b0420 2020-07-16T20:30:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680b0da0 con 0x7fc868147be0 2020-07-16T20:30:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8680b0420 0x7fc8680b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc8680b0420 0x7fc8680b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39378/0 (socket says 172.21.15.22:39378) 2020-07-16T20:30:46.338 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 -- 172.21.15.22:0/1095436098 learned_addr learned my addr 172.21.15.22:0/1095436098 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc866ffd700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868147be0 0x7fc868148040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 -- 172.21.15.22:0/1095436098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868147be0 msgr2=0x7fc868148040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868147be0 0x7fc868148040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.339 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 -- 172.21.15.22:0/1095436098 >> v1:172.21.15.116:6789/0 conn(0x7fc86809c5a0 legacy=0x7fc86809ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 -- 172.21.15.22:0/1095436098 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8680b1040 con 0x7fc8680b0420 2020-07-16T20:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8677fe700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8680b0420 0x7fc8680b5f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fc8600032b0 tx=0x7fc860009270).ready entity=mon.0 client_cookie=c77b8b4361fce779 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8667fc700 1 -- 172.21.15.22:0/1095436098 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc860009e60 con 0x7fc8680b0420 2020-07-16T20:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8667fc700 1 -- 172.21.15.22:0/1095436098 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000bc00 con 0x7fc8680b0420 2020-07-16T20:30:46.340 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc8667fc700 1 -- 172.21.15.22:0/1095436098 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86000bd70 con 0x7fc8680b0420 2020-07-16T20:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- 172.21.15.22:0/1095436098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8680b0420 msgr2=0x7fc8680b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8680b0420 0x7fc8680b5f70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fc8600032b0 tx=0x7fc860009270).stop 2020-07-16T20:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- 172.21.15.22:0/1095436098 shutdown_connections 2020-07-16T20:30:46.341 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc8680b0420 0x7fc8680b5f70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/1095436098 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868147be0 0x7fc868148040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- 172.21.15.22:0/1095436098 >> 172.21.15.22:0/1095436098 conn(0x7fc8680b9380 msgr2=0x7fc8680b9790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- 172.21.15.22:0/1095436098 shutdown_connections 2020-07-16T20:30:46.342 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.334+0000 7fc86ca8c700 1 -- 172.21.15.22:0/1095436098 wait complete. 2020-07-16T20:30:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.336+0000 7fc86ca8c700 1 Processor -- start 2020-07-16T20:30:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.336+0000 7fc86ca8c700 1 -- start start 2020-07-16T20:30:46.345 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc86809c5a0 0x7fc868155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fc868147be0 0x7fc868146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868090860 0x7fc868090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.350 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86809bb50 con 0x7fc86809c5a0 2020-07-16T20:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86809b8b0 con 0x7fc868147be0 2020-07-16T20:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc868158160 con 0x7fc868090860 2020-07-16T20:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc86809c5a0 0x7fc868155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc86809c5a0 0x7fc868155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39384/0 (socket says 172.21.15.22:39384) 2020-07-16T20:30:46.351 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 -- 172.21.15.22:0/2662295750 learned_addr learned my addr 172.21.15.22:0/2662295750 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc866ffd700 1 --2- 172.21.15.22:0/2662295750 >> v2:172.21.15.116:3300/0 conn(0x7fc868147be0 0x7fc868146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc867fff700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868090860 0x7fc868090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 -- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868090860 msgr2=0x7fc868090d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.352 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868090860 0x7fc868090d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 -- 172.21.15.22:0/2662295750 >> v2:172.21.15.116:3300/0 conn(0x7fc868147be0 msgr2=0x7fc868146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 --2- 172.21.15.22:0/2662295750 >> v2:172.21.15.116:3300/0 conn(0x7fc868147be0 0x7fc868146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 -- 172.21.15.22:0/2662295750 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868146f30 con 0x7fc86809c5a0 2020-07-16T20:30:46.353 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc8677fe700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc86809c5a0 0x7fc868155670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fc8680afbd0 tx=0x7fc860016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8600107a0 con 0x7fc86809c5a0 2020-07-16T20:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860010900 con 0x7fc86809c5a0 2020-07-16T20:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc868066c40 con 0x7fc86809c5a0 2020-07-16T20:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc860010c60 con 0x7fc86809c5a0 2020-07-16T20:30:46.354 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.337+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868158600 con 0x7fc86809c5a0 2020-07-16T20:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.338+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86809b700 con 0x7fc86809c5a0 2020-07-16T20:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.339+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fc860027020 con 0x7fc86809c5a0 2020-07-16T20:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.339+0000 7fc85f7fe700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 0x7fc844052430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:46.355 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.339+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc860069340 con 0x7fc86809c5a0 2020-07-16T20:30:46.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.339+0000 7fc866ffd700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 0x7fc844052430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:46.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.339+0000 7fc866ffd700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 0x7fc844052430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc85000b000 tx=0x7fc850006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:46.356 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.342+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fc860041b80 con 0x7fc86809c5a0 2020-07-16T20:30:46.505 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.504+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc868057490 con 0x7fc86809c5a0 2020-07-16T20:30:46.506 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.504+0000 7fc85f7fe700 1 -- 172.21.15.22:0/2662295750 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16350 (secure 0 0 0) 0x7fc860015020 con 0x7fc86809c5a0 2020-07-16T20:30:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:46.507 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"70778c64-6d4b-4710-8151-64d2394b5553","created":"2020-07-16T20:30:08.178905+0000","modified":"2020-07-16T20:30:30.957003+0000","last_up_change":"2020-07-16T20:30:17.004607+0000","last_in_change":"2020-07-16T20:30:17.004607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-07-16T20:30:11.371623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-07-16T20:30:21.693414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-07-16T20:30:25.164093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-07-16T20:30:27.610215+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"589d421d-97ff-46e8-8d23-96744c404e3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":23849},{"type":"v1","addr":"172.21.15.22:6809","nonce":23849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":23849},{"type":"v1","addr":"172.21.15.22:6811","nonce":23849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":23849},{"type":"v1","addr":"172.21.15.22:6815","nonce":23849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":23849},{"type":"v1","addr":"172.21.15.22:6813","nonce":23849}]},"public_addr":"172.21.15.22:6809/23849","cluster_addr":"172.21.15.22:6811/23849","heartbeat_back_addr":"172.21.15.22:6815/23849","heartbeat_front_addr":"172.21.15.22:6813/23849","state":["exists","up"]},{"osd":1,"uuid":"ad13e8a9-e5b6-4dc9-935a-b41634158602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":23850},{"type":"v1","addr":"172.21.15.22:6801","nonce":23850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":23850},{"type":"v1","addr":"172.21.15.22:6803","nonce":23850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":23850},{"type":"v1","addr":"172.21.15.22:6807","nonce":23850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":23850},{"type":"v1","addr":"172.21.15.22:6805","nonce":23850}]},"public_addr":"172.21.15.22:6801/23850","cluster_addr":"172.21.15.22:6803/23850","heartbeat_back_addr":"172.21.15.22:6807/23850","heartbeat_front_addr":"172.21.15.22:6805/23850","state":["exists","up"]},{"osd":2,"uuid":"5b2b9d45-ed43-4c75-b3c6-49b336e39c94","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":23851},{"type":"v1","addr":"172.21.15.22:6817","nonce":23851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":23851},{"type":"v1","addr":"172.21.15.22:6820","nonce":23851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":23851},{"type":"v1","addr":"172.21.15.22:6828","nonce":23851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":23851},{"type":"v1","addr":"172.21.15.22:6824","nonce":23851}]},"public_addr":"172.21.15.22:6817/23851","cluster_addr":"172.21.15.22:6820/23851","heartbeat_back_addr":"172.21.15.22:6828/23851","heartbeat_front_addr":"172.21.15.22:6824/23851","state":["exists","up"]},{"osd":3,"uuid":"d7f4bab9-7996-49ae-bcac-f1ce415ac8b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6819","nonce":23870},{"type":"v1","addr":"172.21.15.22:6821","nonce":23870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6823","nonce":23870},{"type":"v1","addr":"172.21.15.22:6825","nonce":23870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":23870},{"type":"v1","addr":"172.21.15.22:6831","nonce":23870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6827","nonce":23870},{"type":"v1","addr":"172.21.15.22:6829","nonce":23870}]},"public_addr":"172.21.15.22:6821/23870","cluster_addr":"172.21.15.22:6825/23870","heartbeat_back_addr":"172.21.15.22:6831/23870","heartbeat_front_addr":"172.21.15.22:6829/23870","state":["exists","up"]},{"osd":4,"uuid":"c17a5db4-2138-4206-9e5f-5024c7fbfea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":24113},{"type":"v1","addr":"172.21.15.116:6803","nonce":24113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":24113},{"type":"v1","addr":"172.21.15.116:6805","nonce":24113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":24113},{"type":"v1","addr":"172.21.15.116:6809","nonce":24113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":24113},{"type":"v1","addr":"172.21.15.116:6807","nonce":24113}]},"public_addr":"172.21.15.116:6803/24113","cluster_addr":"172.21.15.116:6805/24113","heartbeat_back_addr":"172.21.15.116:6809/24113","heartbeat_front_addr":"172.21.15.116:6807/24113","state":["exists","up"]},{"osd":5,"uuid":"c671f599-5dc0-4842-8efe-cbbe9a2905fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":24114},{"type":"v1","addr":"172.21.15.116:6811","nonce":24114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":24114},{"type":"v1","addr":"172.21.15.116:6813","nonce":24114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":24114},{"type":"v1","addr":"172.21.15.116:6817","nonce":24114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":24114},{"type":"v1","addr":"172.21.15.116:6815","nonce":24114}]},"public_addr":"172.21.15.116:6811/24114","cluster_addr":"172.21.15.116:6813/24114","heartbeat_back_addr":"172.21.15.116:6817/24114","heartbeat_front_addr":"172.21.15.116:6815/24114","state":["exists","up"]},{"osd":6,"uuid":"072fab5f-a44c-4162-bd12-87d991ab2823","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":24143},{"type":"v1","addr":"172.21.15.116:6819","nonce":24143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":24143},{"type":"v1","addr":"172.21.15.116:6821","nonce":24143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":24143},{"type":"v1","addr":"172.21.15.116:6825","nonce":24143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":24143},{"type":"v1","addr":"172.21.15.116:6823","nonce":24143}]},"public_addr":"172.21.15.116:6819/24143","cluster_addr":"172.21.15.116:6821/24143","heartbeat_back_addr":"172.21.15.116:6825/24143","heartbeat_front_addr":"172.21.15.116:6823/24143","state":["exists","up"]},{"osd":7,"uuid":"ee32368a-83d8-4845-bc9a-e556bc1dd5ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":24152},{"type":"v1","addr":"172.21.15.116:6827","nonce":24152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":24152},{"type":"v1","addr":"172.21.15.116:6829","nonce":24152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":24152},{"type":"v1","addr":"172.21.15.116:6833","nonce":24152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":24152},{"type":"v1","addr":"172.21.15.116:6831","nonce":24152}]},"public_addr":"172.21.15.116:6827/24152","cluster_addr":"172.21.15.116:6829/24152","heartbeat_back_addr":"172.21.15.116:6833/24152","heartbeat_front_addr":"172.21.15.116:6831/24152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.724106+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.738416+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.785026+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.743780+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.781104+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.803777+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.756063+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292837744639,"old_weight":0,"last_purged_snaps_scrub":"2020-07-16T20:30:15.799020+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-07-16T20:30:46.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 msgr2=0x7fc844052430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 0x7fc844052430 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc85000b000 tx=0x7fc850006dd0).stop 2020-07-16T20:30:46.508 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc86809c5a0 msgr2=0x7fc868155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc86809c5a0 0x7fc868155670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fc8680afbd0 tx=0x7fc860016000).stop 2020-07-16T20:30:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 shutdown_connections 2020-07-16T20:30:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fc84404ff70 0x7fc844052430 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.509 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc86809c5a0 0x7fc868155670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.518 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc868090860 0x7fc868090d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.518 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 --2- 172.21.15.22:0/2662295750 >> v2:172.21.15.116:3300/0 conn(0x7fc868147be0 0x7fc868146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:46.519 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 >> 172.21.15.22:0/2662295750 conn(0x7fc8680b9380 msgr2=0x7fc868143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:46.519 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 shutdown_connections 2020-07-16T20:30:46.519 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:46.506+0000 7fc86ca8c700 1 -- 172.21.15.22:0/2662295750 wait complete. 2020-07-16T20:30:47.522 INFO:tasks.ceph:Scrubbing osd.0 2020-07-16T20:30:47.523 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:47.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.653+0000 7f4f4d8ff700 1 Processor -- start 2020-07-16T20:30:47.655 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.653+0000 7f4f4d8ff700 1 -- start start 2020-07-16T20:30:47.663 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f480b87b0 0x7f4f480b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f480b7560 0x7f4f480b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.664 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4f4809cea0 0x7f4f4809d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4809e030 con 0x7f4f480b7560 2020-07-16T20:30:47.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4809daf0 con 0x7f4f4809cea0 2020-07-16T20:30:47.665 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f4d8ff700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4809dd90 con 0x7f4f480b87b0 2020-07-16T20:30:47.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f480b7560 0x7f4f480b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.666 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f480b7560 0x7f4f480b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39394/0 (socket says 172.21.15.22:39394) 2020-07-16T20:30:47.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 -- 172.21.15.22:0/3078108619 learned_addr learned my addr 172.21.15.22:0/3078108619 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:47.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f477fe700 1 --2- 172.21.15.22:0/3078108619 >> v2:172.21.15.116:3300/0 conn(0x7f4f4809cea0 0x7f4f4809d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.667 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f46ffd700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f480b87b0 0x7f4f480b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 -- 172.21.15.22:0/3078108619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f480b87b0 msgr2=0x7f4f480b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:47.668 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f480b87b0 0x7f4f480b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 -- 172.21.15.22:0/3078108619 >> v2:172.21.15.116:3300/0 conn(0x7f4f4809cea0 msgr2=0x7f4f4809d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:47.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 --2- 172.21.15.22:0/3078108619 >> v2:172.21.15.116:3300/0 conn(0x7f4f4809cea0 0x7f4f4809d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.669 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 -- 172.21.15.22:0/3078108619 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480b7eb0 con 0x7f4f480b7560 2020-07-16T20:30:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.654+0000 7f4f467fc700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f480b7560 0x7f4f480b79c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4f38002f30 tx=0x7f4f38006e90).ready entity=mon.0 client_cookie=8019798f10939f47 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.670 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f45ffb700 1 -- 172.21.15.22:0/3078108619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f38009920 con 0x7f4f480b7560 2020-07-16T20:30:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f45ffb700 1 -- 172.21.15.22:0/3078108619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38009a80 con 0x7f4f480b7560 2020-07-16T20:30:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f45ffb700 1 -- 172.21.15.22:0/3078108619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f38009de0 con 0x7f4f480b7560 2020-07-16T20:30:47.671 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/3078108619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f480b7560 msgr2=0x7f4f480b79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f480b7560 0x7f4f480b79c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f4f38002f30 tx=0x7f4f38006e90).stop 2020-07-16T20:30:47.672 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/3078108619 shutdown_connections 2020-07-16T20:30:47.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/3078108619 >> v2:172.21.15.116:3300/0 conn(0x7f4f4809cea0 0x7f4f4809d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f480b87b0 0x7f4f480b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.673 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/3078108619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f480b7560 0x7f4f480b79c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/3078108619 >> 172.21.15.22:0/3078108619 conn(0x7f4f480b9660 msgr2=0x7f4f480b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/3078108619 shutdown_connections 2020-07-16T20:30:47.674 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.655+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/3078108619 wait complete. 2020-07-16T20:30:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.656+0000 7f4f4d8ff700 1 Processor -- start 2020-07-16T20:30:47.675 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 -- start start 2020-07-16T20:30:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f4809cea0 0x7f4f48146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4f48065af0 0x7f4f481459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.676 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f48066070 con 0x7f4f480b87b0 2020-07-16T20:30:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f48146fb0 con 0x7f4f48065af0 2020-07-16T20:30:47.677 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f4d8ff700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f48066310 con 0x7f4f4809cea0 2020-07-16T20:30:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f46ffd700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f4809cea0 0x7f4f48146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f477fe700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4f48065af0 0x7f4f481459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.678 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f467fc700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f4f480b87b0 0x7f4f48140c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42458/0 (socket says 172.21.15.22:42458) 2020-07-16T20:30:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.657+0000 7f4f467fc700 1 -- 172.21.15.22:0/1071906228 learned_addr learned my addr 172.21.15.22:0/1071906228 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:47.679 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f477fe700 1 -- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f4809cea0 msgr2=0x7f4f48146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362626172 0 0) 0x7f4f48066070 con 0x7f4f480b87b0 2020-07-16T20:30:47.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f477fe700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f4809cea0 0x7f4f48146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.680 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f477fe700 1 -- 172.21.15.22:0/1071906228 >> v1:172.21.15.116:6789/0 conn(0x7f4f480b87b0 legacy=0x7f4f48140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f477fe700 1 -- 172.21.15.22:0/1071906228 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480665b0 con 0x7f4f48065af0 2020-07-16T20:30:47.681 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f46ffd700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4f4809cea0 0x7f4f48146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:47.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f477fe700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f48065af0 0x7f4f481459b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4f480658b0 tx=0x7f4f40008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40009980 con 0x7f4f48065af0 2020-07-16T20:30:47.682 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40009ae0 con 0x7f4f48065af0 2020-07-16T20:30:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f40009e40 con 0x7f4f48065af0 2020-07-16T20:30:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f481442f0 con 0x7f4f48065af0 2020-07-16T20:30:47.683 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.658+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f48145ea0 con 0x7f4f48065af0 2020-07-16T20:30:47.684 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.659+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f4805f320 con 0x7f4f48065af0 2020-07-16T20:30:47.684 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.659+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f4f40013480 con 0x7f4f48065af0 2020-07-16T20:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f2effd700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4f2404fd50 0x7f4f24052210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4f40068540 con 0x7f4f48065af0 2020-07-16T20:30:47.685 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f2effd700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f4f24057840 0x7f4f24059c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 --> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f2405a2b0 con 0x7f4f24057840 2020-07-16T20:30:47.686 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f46ffd700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4f2404fd50 0x7f4f24052210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f4006abb0 con 0x7f4f48065af0 2020-07-16T20:30:47.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f467fc700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f4f24057840 0x7f4f24059c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.687 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f46ffd700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4f2404fd50 0x7f4f24052210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4f3c00d000 tx=0x7f4f3c006f50).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.660+0000 7f4f467fc700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f4f24057840 0x7f4f24059c60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.688 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.661+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== osd.0 v2:172.21.15.22:6808/23849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f4f2405a2b0 con 0x7f4f24057840 2020-07-16T20:30:47.691 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.678+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 --> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4f481463b0 con 0x7f4f24057840 2020-07-16T20:30:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.678+0000 7f4f2effd700 1 -- 172.21.15.22:0/1071906228 <== osd.0 v2:172.21.15.22:6808/23849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4f481463b0 con 0x7f4f24057840 2020-07-16T20:30:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.678+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f4f24057840 msgr2=0x7f4f24059c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.692 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.678+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.22:6808/23849,v1:172.21.15.22:6809/23849] conn(0x7f4f24057840 0x7f4f24059c60 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.693 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4f2404fd50 msgr2=0x7f4f24052210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.693 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4f2404fd50 0x7f4f24052210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4f3c00d000 tx=0x7f4f3c006f50).stop 2020-07-16T20:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f48065af0 msgr2=0x7f4f481459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f48065af0 0x7f4f481459b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f4f480658b0 tx=0x7f4f40008040).stop 2020-07-16T20:30:47.694 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f477fe700 1 -- 172.21.15.22:0/1071906228 reap_dead start 2020-07-16T20:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 shutdown_connections 2020-07-16T20:30:47.695 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 --2- 172.21.15.22:0/1071906228 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4f48065af0 0x7f4f481459b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 >> 172.21.15.22:0/1071906228 conn(0x7f4f480b9660 msgr2=0x7f4f480b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 shutdown_connections 2020-07-16T20:30:47.696 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.679+0000 7f4f4d8ff700 1 -- 172.21.15.22:0/1071906228 wait complete. 2020-07-16T20:30:47.697 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:47.697 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:47.698 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:47.698 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2020-07-16T20:30:47.823 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.813+0000 7fb6602ad700 1 Processor -- start 2020-07-16T20:30:47.824 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.813+0000 7fb6602ad700 1 -- start start 2020-07-16T20:30:47.831 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.813+0000 7fb6602ad700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 0x7fb65809d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.832 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.813+0000 7fb6602ad700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb658143260 0x7fb65809deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.832 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb6602ad700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6580b5610 con 0x7fb658063130 2020-07-16T20:30:47.832 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb6602ad700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580b5400 con 0x7fb658143260 2020-07-16T20:30:47.833 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb6602ad700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b58b0 con 0x7fb658063510 2020-07-16T20:30:47.833 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e049700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb658063130 0x7fb658142b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40116/0 (socket says 172.21.15.22:40116) 2020-07-16T20:30:47.833 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e049700 1 -- 172.21.15.22:0/2778364324 learned_addr learned my addr 172.21.15.22:0/2778364324 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:47.834 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 --2- 172.21.15.22:0/2778364324 >> v2:172.21.15.116:3300/0 conn(0x7fb658143260 0x7fb65809deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.834 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d848700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 0x7fb65809d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.835 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178774373 0 0) 0x7fb6580b5610 con 0x7fb658063130 2020-07-16T20:30:47.835 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb640003240 con 0x7fb658063130 2020-07-16T20:30:47.835 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3428977131 0 0) 0x7fb640003240 con 0x7fb658063130 2020-07-16T20:30:47.836 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 -- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 msgr2=0x7fb65809d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:47.836 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 0x7fb65809d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.836 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 -- 172.21.15.22:0/2778364324 >> v1:172.21.15.22:6789/0 conn(0x7fb658063130 legacy=0x7fb658142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.837 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 -- 172.21.15.22:0/2778364324 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580b5d50 con 0x7fb658143260 2020-07-16T20:30:47.837 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d848700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 0x7fb65809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:47.837 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65e84a700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb658143260 0x7fb65809deb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb648001870 tx=0x7fb650006dd0).ready entity=mon.1 client_cookie=e805dc591176fcdc server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.837 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6480016d0 con 0x7fb658143260 2020-07-16T20:30:47.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000d570 con 0x7fb658143260 2020-07-16T20:30:47.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.814+0000 7fb65d047700 1 -- 172.21.15.22:0/2778364324 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65000d6e0 con 0x7fb658143260 2020-07-16T20:30:47.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 -- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb658143260 msgr2=0x7fb65809deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb658143260 0x7fb65809deb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb648001870 tx=0x7fb650006dd0).stop 2020-07-16T20:30:47.838 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 -- 172.21.15.22:0/2778364324 shutdown_connections 2020-07-16T20:30:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb658143260 0x7fb65809deb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 --2- 172.21.15.22:0/2778364324 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb658063510 0x7fb65809d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 -- 172.21.15.22:0/2778364324 >> 172.21.15.22:0/2778364324 conn(0x7fb6580b9530 msgr2=0x7fb6580b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.839 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 -- 172.21.15.22:0/2778364324 shutdown_connections 2020-07-16T20:30:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.815+0000 7fb6602ad700 1 -- 172.21.15.22:0/2778364324 wait complete. 2020-07-16T20:30:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.816+0000 7fb6602ad700 1 Processor -- start 2020-07-16T20:30:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.816+0000 7fb6602ad700 1 -- start start 2020-07-16T20:30:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6602ad700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb65813e410 0x7fb65813e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.840 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6602ad700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6581436b0 con 0x7fb658063510 2020-07-16T20:30:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6602ad700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6580aedc0 con 0x7fb658063130 2020-07-16T20:30:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6602ad700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65813ed30 con 0x7fb65813e410 2020-07-16T20:30:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65d848700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb658063510 0x7fb6580ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40126/0 (socket says 172.21.15.22:40126) 2020-07-16T20:30:47.841 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65d848700 1 -- 172.21.15.22:0/4127395795 learned_addr learned my addr 172.21.15.22:0/4127395795 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65e84a700 1 --2- 172.21.15.22:0/4127395795 >> v2:172.21.15.116:3300/0 conn(0x7fb65813e410 0x7fb65813e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564055746 0 0) 0x7fb6581436b0 con 0x7fb658063510 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb630003240 con 0x7fb658063510 2020-07-16T20:30:47.842 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177642787 0 0) 0x7fb6580aedc0 con 0x7fb658063130 2020-07-16T20:30:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6581436b0 con 0x7fb658063130 2020-07-16T20:30:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65e84a700 1 -- 172.21.15.22:0/4127395795 >> v1:172.21.15.116:6789/0 conn(0x7fb658063130 legacy=0x7fb658145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65e84a700 1 -- 172.21.15.22:0/4127395795 >> v1:172.21.15.22:6789/0 conn(0x7fb658063510 legacy=0x7fb6580ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.843 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65e84a700 1 -- 172.21.15.22:0/4127395795 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580af010 con 0x7fb65813e410 2020-07-16T20:30:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.817+0000 7fb65e84a700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65813e410 0x7fb65813e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb648001870 tx=0x7fb650015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb650011c00 con 0x7fb65813e410 2020-07-16T20:30:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650011d60 con 0x7fb65813e410 2020-07-16T20:30:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6581438e0 con 0x7fb65813e410 2020-07-16T20:30:47.844 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb65001e650 con 0x7fb65813e410 2020-07-16T20:30:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb658147580 con 0x7fb65813e410 2020-07-16T20:30:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.818+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb658142510 con 0x7fb65813e410 2020-07-16T20:30:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.819+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb650025030 con 0x7fb65813e410 2020-07-16T20:30:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.819+0000 7fb6467fc700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 0x7fb630052930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.819+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb650068f00 con 0x7fb65813e410 2020-07-16T20:30:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.819+0000 7fb65e049700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 0x7fb630052930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.820+0000 7fb65e049700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 0x7fb630052930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb648000fa0 tx=0x7fb648001e00).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.823+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb650041610 con 0x7fb65813e410 2020-07-16T20:30:47.978 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.977+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb658143a70 con 0x7fb630050470 2020-07-16T20:30:47.979 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.977+0000 7fb6467fc700 1 -- 172.21.15.22:0/4127395795 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb658143a70 con 0x7fb630050470 2020-07-16T20:30:47.980 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 msgr2=0x7fb630052930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 0x7fb630052930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fb648000fa0 tx=0x7fb648001e00).stop 2020-07-16T20:30:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65813e410 msgr2=0x7fb65813e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:47.981 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65813e410 0x7fb65813e840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb648001870 tx=0x7fb650015000).stop 2020-07-16T20:30:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 shutdown_connections 2020-07-16T20:30:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb630050470 0x7fb630052930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 --2- 172.21.15.22:0/4127395795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb65813e410 0x7fb65813e840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:47.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 >> 172.21.15.22:0/4127395795 conn(0x7fb6580b9530 msgr2=0x7fb6580b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:47.983 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 shutdown_connections 2020-07-16T20:30:47.984 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:47.979+0000 7fb6602ad700 1 -- 172.21.15.22:0/4127395795 wait complete. 2020-07-16T20:30:47.985 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2020-07-16T20:30:47.991 INFO:tasks.ceph:Scrubbing osd.1 2020-07-16T20:30:47.991 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:48.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.108+0000 7f13ec769700 1 Processor -- start 2020-07-16T20:30:48.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.108+0000 7f13ec769700 1 -- start start 2020-07-16T20:30:48.118 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 0x7f13e414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.123 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13e4148030 0x7f13e40ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e4066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e4141870 con 0x7f13e4148030 2020-07-16T20:30:48.124 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e414b810 con 0x7f13e4147c50 2020-07-16T20:30:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13ec769700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e4147510 con 0x7f13e40ba9a0 2020-07-16T20:30:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13e9d04700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13e4148030 0x7f13e40ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.125 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13e9d04700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f13e4148030 0x7f13e40ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39422/0 (socket says 172.21.15.22:39422) 2020-07-16T20:30:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.109+0000 7f13e9d04700 1 -- 172.21.15.22:0/4156606236 learned_addr learned my addr 172.21.15.22:0/4156606236 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ead06700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e4066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ea505700 1 --2- 172.21.15.22:0/4156606236 >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 0x7f13e414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.126 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 -- 172.21.15.22:0/4156606236 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 msgr2=0x7f13e4066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e4066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 -- 172.21.15.22:0/4156606236 >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 msgr2=0x7f13e414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 --2- 172.21.15.22:0/4156606236 >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 0x7f13e414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.127 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 -- 172.21.15.22:0/4156606236 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e41477b0 con 0x7f13e4148030 2020-07-16T20:30:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ea505700 1 --2- 172.21.15.22:0/4156606236 >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 0x7f13e414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:30:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9d04700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4148030 0x7f13e40ba4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f13e0002f30 tx=0x7f13e0006e90).ready entity=mon.0 client_cookie=8d7cfa87da565ffd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9503700 1 -- 172.21.15.22:0/4156606236 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0009920 con 0x7f13e4148030 2020-07-16T20:30:48.128 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9503700 1 -- 172.21.15.22:0/4156606236 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e0009a80 con 0x7f13e4148030 2020-07-16T20:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13e9503700 1 -- 172.21.15.22:0/4156606236 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0009de0 con 0x7f13e4148030 2020-07-16T20:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 -- 172.21.15.22:0/4156606236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4148030 msgr2=0x7f13e40ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4148030 0x7f13e40ba4b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f13e0002f30 tx=0x7f13e0006e90).stop 2020-07-16T20:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 -- 172.21.15.22:0/4156606236 shutdown_connections 2020-07-16T20:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e4066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 --2- 172.21.15.22:0/4156606236 >> v2:172.21.15.116:3300/0 conn(0x7f13e4147c50 0x7f13e414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 --2- 172.21.15.22:0/4156606236 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4148030 0x7f13e40ba4b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 -- 172.21.15.22:0/4156606236 >> 172.21.15.22:0/4156606236 conn(0x7f13e4060070 msgr2=0x7f13e405b890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 -- 172.21.15.22:0/4156606236 shutdown_connections 2020-07-16T20:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.110+0000 7f13ec769700 1 -- 172.21.15.22:0/4156606236 wait complete. 2020-07-16T20:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.111+0000 7f13ec769700 1 Processor -- start 2020-07-16T20:30:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 -- start start 2020-07-16T20:30:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e41461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13e409de70 0x7f13e4143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e40a0420 con 0x7f13e4147c50 2020-07-16T20:30:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e40a3270 con 0x7f13e409de70 2020-07-16T20:30:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ec769700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e40a3510 con 0x7f13e40ba9a0 2020-07-16T20:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ead06700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f13e409de70 0x7f13e4143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13e9d04700 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f13e4147c50 0x7f13e413cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.22:42484/0 (socket says 172.21.15.22:42484) 2020-07-16T20:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13e9d04700 1 -- 172.21.15.22:0/2412484114 learned_addr learned my addr 172.21.15.22:0/2412484114 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.112+0000 7f13ea505700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e41461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ea505700 1 -- 172.21.15.22:0/2412484114 >> v2:172.21.15.116:3300/0 conn(0x7f13e409de70 msgr2=0x7f13e4143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ea505700 1 --2- 172.21.15.22:0/2412484114 >> v2:172.21.15.116:3300/0 conn(0x7f13e409de70 0x7f13e4143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ea505700 1 -- 172.21.15.22:0/2412484114 >> v1:172.21.15.116:6789/0 conn(0x7f13e4147c50 legacy=0x7f13e413cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498860662 0 0) 0x7f13e40a0420 con 0x7f13e4147c50 2020-07-16T20:30:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ea505700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e40a37b0 con 0x7f13e40ba9a0 2020-07-16T20:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ead06700 1 --2- 172.21.15.22:0/2412484114 >> v2:172.21.15.116:3300/0 conn(0x7f13e409de70 0x7f13e4143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ea505700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e41461d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13d4007000 tx=0x7f13d4008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13d400e570 con 0x7f13e40ba9a0 2020-07-16T20:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d400c030 con 0x7f13e40ba9a0 2020-07-16T20:30:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e413d620 con 0x7f13e40ba9a0 2020-07-16T20:30:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13d400e8c0 con 0x7f13e40ba9a0 2020-07-16T20:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.113+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e4142ee0 con 0x7f13e40ba9a0 2020-07-16T20:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.114+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13e405f320 con 0x7f13e40ba9a0 2020-07-16T20:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.114+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f13d4019030 con 0x7f13e40ba9a0 2020-07-16T20:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13d27fc700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f13bc04fe10 0x7f13bc0522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f13d4067500 con 0x7f13e40ba9a0 2020-07-16T20:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13e9d04700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f13bc04fe10 0x7f13bc0522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13d27fc700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f13bc057900 0x7f13bc059d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13bc05a370 con 0x7f13bc057900 2020-07-16T20:30:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d4069b70 con 0x7f13e40ba9a0 2020-07-16T20:30:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13ead06700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f13bc057900 0x7f13bc059d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13e9d04700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f13bc04fe10 0x7f13bc0522d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f13e0006e90 tx=0x7f13e0015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.115+0000 7f13ead06700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f13bc057900 0x7f13bc059d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.116+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== osd.1 v2:172.21.15.22:6800/23850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f13bc05a370 con 0x7f13bc057900 2020-07-16T20:30:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.132+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 --> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f13e40b48e0 con 0x7f13bc057900 2020-07-16T20:30:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13d27fc700 1 -- 172.21.15.22:0/2412484114 <== osd.1 v2:172.21.15.22:6800/23850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f13e40b48e0 con 0x7f13bc057900 2020-07-16T20:30:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f13bc057900 msgr2=0x7f13bc059d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.22:6800/23850,v1:172.21.15.22:6801/23850] conn(0x7f13bc057900 0x7f13bc059d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f13bc04fe10 msgr2=0x7f13bc0522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f13bc04fe10 0x7f13bc0522d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f13e0006e90 tx=0x7f13e0015000).stop 2020-07-16T20:30:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 msgr2=0x7f13e41461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 --2- 172.21.15.22:0/2412484114 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f13e40ba9a0 0x7f13e41461d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13d4007000 tx=0x7f13d4008040).stop 2020-07-16T20:30:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ead06700 1 -- 172.21.15.22:0/2412484114 reap_dead start 2020-07-16T20:30:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 shutdown_connections 2020-07-16T20:30:48.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 >> 172.21.15.22:0/2412484114 conn(0x7f13e4060070 msgr2=0x7f13e414adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 shutdown_connections 2020-07-16T20:30:48.154 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.133+0000 7f13ec769700 1 -- 172.21.15.22:0/2412484114 wait complete. 2020-07-16T20:30:48.154 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:48.154 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:48.155 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:48.155 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2020-07-16T20:30:48.270 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.269+0000 7f688b685700 1 Processor -- start 2020-07-16T20:30:48.271 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.269+0000 7f688b685700 1 -- start start 2020-07-16T20:30:48.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f688b685700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6884063130 0x7f6884142b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f688b685700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6884143040 0x7f6884147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.273 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f688b685700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840b5370 con 0x7f6884063510 2020-07-16T20:30:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f688b685700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6884143560 con 0x7f6884063130 2020-07-16T20:30:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f688b685700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68840b5610 con 0x7f6884143040 2020-07-16T20:30:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6884063130 0x7f6884142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6884063130 0x7f6884142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39436/0 (socket says 172.21.15.22:39436) 2020-07-16T20:30:48.274 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 -- 172.21.15.22:0/3948503697 learned_addr learned my addr 172.21.15.22:0/3948503697 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889c22700 1 --2- 172.21.15.22:0/3948503697 >> v2:172.21.15.116:3300/0 conn(0x7f6884143040 0x7f6884147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 -- 172.21.15.22:0/3948503697 >> v2:172.21.15.116:3300/0 conn(0x7f6884143040 msgr2=0x7f6884147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 --2- 172.21.15.22:0/3948503697 >> v2:172.21.15.116:3300/0 conn(0x7f6884143040 0x7f6884147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.275 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 -- 172.21.15.22:0/3948503697 >> v1:172.21.15.116:6789/0 conn(0x7f6884063510 legacy=0x7f6884146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 -- 172.21.15.22:0/3948503697 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840b58b0 con 0x7f6884063130 2020-07-16T20:30:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.270+0000 7f6889421700 1 --2- 172.21.15.22:0/3948503697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6884063130 0x7f6884142b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f688409d8d0 tx=0x7f6874006e90).ready entity=mon.0 client_cookie=48a9b33657c3c0bd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f6873fff700 1 -- 172.21.15.22:0/3948503697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6874009980 con 0x7f6884063130 2020-07-16T20:30:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f6873fff700 1 -- 172.21.15.22:0/3948503697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874009ae0 con 0x7f6884063130 2020-07-16T20:30:48.276 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f6873fff700 1 -- 172.21.15.22:0/3948503697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6874009e40 con 0x7f6884063130 2020-07-16T20:30:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 -- 172.21.15.22:0/3948503697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6884063130 msgr2=0x7f6884142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 --2- 172.21.15.22:0/3948503697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6884063130 0x7f6884142b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f688409d8d0 tx=0x7f6874006e90).stop 2020-07-16T20:30:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 -- 172.21.15.22:0/3948503697 shutdown_connections 2020-07-16T20:30:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 --2- 172.21.15.22:0/3948503697 >> v2:172.21.15.116:3300/0 conn(0x7f6884143040 0x7f6884147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.277 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 --2- 172.21.15.22:0/3948503697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6884063130 0x7f6884142b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 -- 172.21.15.22:0/3948503697 >> 172.21.15.22:0/3948503697 conn(0x7f68840b9530 msgr2=0x7f68840b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 -- 172.21.15.22:0/3948503697 shutdown_connections 2020-07-16T20:30:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.271+0000 7f688b685700 1 -- 172.21.15.22:0/3948503697 wait complete. 2020-07-16T20:30:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.272+0000 7f688b685700 1 Processor -- start 2020-07-16T20:30:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.272+0000 7f688b685700 1 -- start start 2020-07-16T20:30:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f688b685700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f68840b3010 0x7f68841593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f688b685700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840b07b0 con 0x7f6884143040 2020-07-16T20:30:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f688b685700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68840b0a50 con 0x7f6884063510 2020-07-16T20:30:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f688b685700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6884147320 con 0x7f68840b3010 2020-07-16T20:30:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f6888c20700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6884143040 0x7f68840b2900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40150/0 (socket says 172.21.15.22:40150) 2020-07-16T20:30:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f6888c20700 1 -- 172.21.15.22:0/4065506278 learned_addr learned my addr 172.21.15.22:0/4065506278 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f6889c22700 1 --2- 172.21.15.22:0/4065506278 >> v2:172.21.15.22:3300/0 conn(0x7f68840b3010 0x7f68841593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463910225 0 0) 0x7f68840b07b0 con 0x7f6884143040 2020-07-16T20:30:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.273+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f685c003240 con 0x7f6884143040 2020-07-16T20:30:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f6889c22700 1 -- 172.21.15.22:0/4065506278 >> v1:172.21.15.116:6789/0 conn(0x7f6884063510 legacy=0x7f6884146c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f6889c22700 1 -- 172.21.15.22:0/4065506278 >> v1:172.21.15.22:6789/0 conn(0x7f6884143040 legacy=0x7f68840b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f6889c22700 1 -- 172.21.15.22:0/4065506278 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884147460 con 0x7f68840b3010 2020-07-16T20:30:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f6889c22700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68840b3010 0x7f68841593c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f687c00a000 tx=0x7f687c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c011940 con 0x7f68840b3010 2020-07-16T20:30:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c011aa0 con 0x7f68840b3010 2020-07-16T20:30:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68840b0ef0 con 0x7f68840b3010 2020-07-16T20:30:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f687c011e00 con 0x7f68840b3010 2020-07-16T20:30:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.274+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840aef40 con 0x7f68840b3010 2020-07-16T20:30:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.275+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6884142610 con 0x7f68840b3010 2020-07-16T20:30:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.276+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f687c012420 con 0x7f68840b3010 2020-07-16T20:30:48.285 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.276+0000 7f68717fa700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 0x7f685c052880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.276+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f687c068740 con 0x7f68840b3010 2020-07-16T20:30:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.276+0000 7f6889421700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 0x7f685c052880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.276+0000 7f6889421700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 0x7f685c052880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6884067570 tx=0x7f6874015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.286 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.279+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f687c040e70 con 0x7f68840b3010 2020-07-16T20:30:48.436 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.435+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6884159950 con 0x7f685c0503c0 2020-07-16T20:30:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.435+0000 7f68717fa700 1 -- 172.21.15.22:0/4065506278 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6874006920 con 0x7f685c0503c0 2020-07-16T20:30:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 msgr2=0x7f685c052880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 0x7f685c052880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f6884067570 tx=0x7f6874015000).stop 2020-07-16T20:30:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68840b3010 msgr2=0x7f68841593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68840b3010 0x7f68841593c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f687c00a000 tx=0x7f687c008040).stop 2020-07-16T20:30:48.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 shutdown_connections 2020-07-16T20:30:48.440 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f685c0503c0 0x7f685c052880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 --2- 172.21.15.22:0/4065506278 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f68840b3010 0x7f68841593c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.441 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 >> 172.21.15.22:0/4065506278 conn(0x7f68840b9530 msgr2=0x7f68841418b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 shutdown_connections 2020-07-16T20:30:48.442 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.437+0000 7f688b685700 1 -- 172.21.15.22:0/4065506278 wait complete. 2020-07-16T20:30:48.442 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2020-07-16T20:30:48.449 INFO:tasks.ceph:Scrubbing osd.2 2020-07-16T20:30:48.450 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:48.570 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.568+0000 7fb69338d700 1 Processor -- start 2020-07-16T20:30:48.570 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 -- start start 2020-07-16T20:30:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb68c148030 0x7fb68c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c0ba9a0 0x7fb68c066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb68c14b810 con 0x7fb68c147c50 2020-07-16T20:30:48.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c141870 con 0x7fb68c148030 2020-07-16T20:30:48.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb69338d700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c147510 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb690928700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb68c148030 0x7fb68c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb691129700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb68c147c50 0x7fb68c14adc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40156/0 (socket says 172.21.15.22:40156) 2020-07-16T20:30:48.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.569+0000 7fb691129700 1 -- 172.21.15.22:0/1963496003 learned_addr learned my addr 172.21.15.22:0/1963496003 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:48.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69192a700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c0ba9a0 0x7fb68c066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb690928700 1 -- 172.21.15.22:0/1963496003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c0ba9a0 msgr2=0x7fb68c066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb690928700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c0ba9a0 0x7fb68c066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb690928700 1 -- 172.21.15.22:0/1963496003 >> v1:172.21.15.22:6789/0 conn(0x7fb68c147c50 legacy=0x7fb68c14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb68bfff700 1 -- 172.21.15.22:0/1963496003 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522079538 0 0) 0x7fb68c14b810 con 0x7fb68c147c50 2020-07-16T20:30:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb690928700 1 -- 172.21.15.22:0/1963496003 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c1477b0 con 0x7fb68c148030 2020-07-16T20:30:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb690928700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c148030 0x7fb68c0ba4b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb680002f30 tx=0x7fb680006dd0).ready entity=mon.0 client_cookie=dc0f28a3de311d9f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb68bfff700 1 -- 172.21.15.22:0/1963496003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6800097f0 con 0x7fb68c148030 2020-07-16T20:30:48.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb68bfff700 1 -- 172.21.15.22:0/1963496003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680009950 con 0x7fb68c148030 2020-07-16T20:30:48.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb68bfff700 1 -- 172.21.15.22:0/1963496003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb680009cb0 con 0x7fb68c148030 2020-07-16T20:30:48.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 -- 172.21.15.22:0/1963496003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c148030 msgr2=0x7fb68c0ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c148030 0x7fb68c0ba4b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb680002f30 tx=0x7fb680006dd0).stop 2020-07-16T20:30:48.577 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 -- 172.21.15.22:0/1963496003 shutdown_connections 2020-07-16T20:30:48.586 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c0ba9a0 0x7fb68c066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 --2- 172.21.15.22:0/1963496003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c148030 0x7fb68c0ba4b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.587 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 -- 172.21.15.22:0/1963496003 >> 172.21.15.22:0/1963496003 conn(0x7fb68c060070 msgr2=0x7fb68c05b890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 -- 172.21.15.22:0/1963496003 shutdown_connections 2020-07-16T20:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.570+0000 7fb69338d700 1 -- 172.21.15.22:0/1963496003 wait complete. 2020-07-16T20:30:48.588 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 Processor -- start 2020-07-16T20:30:48.589 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 -- start start 2020-07-16T20:30:48.593 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb68c0ba9a0 0x7fb68c0a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb68c147c50 0x7fb68c144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c13f1c0 0x7fb68c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.602 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0a3980 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.603 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c144830 con 0x7fb68c147c50 2020-07-16T20:30:48.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.572+0000 7fb69338d700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c144b60 con 0x7fb68c13f1c0 2020-07-16T20:30:48.604 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb68c0ba9a0 0x7fb68c0a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb68c0ba9a0 0x7fb68c0a3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39456/0 (socket says 172.21.15.22:39456) 2020-07-16T20:30:48.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 -- 172.21.15.22:0/1521833532 learned_addr learned my addr 172.21.15.22:0/1521833532 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:48.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb690928700 1 --2- 172.21.15.22:0/1521833532 >> v2:172.21.15.116:3300/0 conn(0x7fb68c147c50 0x7fb68c144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.605 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb69192a700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c13f1c0 0x7fb68c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.606 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 -- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c13f1c0 msgr2=0x7fb68c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.617 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c13f1c0 0x7fb68c15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 -- 172.21.15.22:0/1521833532 >> v2:172.21.15.116:3300/0 conn(0x7fb68c147c50 msgr2=0x7fb68c144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 --2- 172.21.15.22:0/1521833532 >> v2:172.21.15.116:3300/0 conn(0x7fb68c147c50 0x7fb68c144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 -- 172.21.15.22:0/1521833532 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c15b0c0 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb69192a700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb68c13f1c0 0x7fb68c15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:48.618 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb691129700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c0ba9a0 0x7fb68c0a3490 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fb67c000e90 tx=0x7fb67c007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c0072e0 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c007440 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c15b360 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.619 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c0057e0 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.573+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c15aab0 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.574+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb68c05f320 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.574+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb67c01a060 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb6897fa700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb66404ffd0 0x7fb664052490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.620 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb67c067580 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.621 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb6897fa700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7fb664057c40 0x7fb66405a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.621 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 --> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb66405a6b0 con 0x7fb664057c40 2020-07-16T20:30:48.621 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb67c069b50 con 0x7fb68c0ba9a0 2020-07-16T20:30:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb690928700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb66404ffd0 0x7fb664052490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb69192a700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7fb664057c40 0x7fb66405a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb690928700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb66404ffd0 0x7fb664052490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb68001c000 tx=0x7fb680015000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.575+0000 7fb69192a700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7fb664057c40 0x7fb66405a060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.576+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== osd.2 v2:172.21.15.22:6816/23851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fb66405a6b0 con 0x7fb664057c40 2020-07-16T20:30:48.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.592+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 --> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb68c0b48e0 con 0x7fb664057c40 2020-07-16T20:30:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb6897fa700 1 -- 172.21.15.22:0/1521833532 <== osd.2 v2:172.21.15.22:6816/23851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb68c0b48e0 con 0x7fb664057c40 2020-07-16T20:30:48.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7fb664057c40 msgr2=0x7fb66405a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:6816/23851,v1:172.21.15.22:6817/23851] conn(0x7fb664057c40 0x7fb66405a060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb66404ffd0 msgr2=0x7fb664052490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb66404ffd0 0x7fb664052490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fb68001c000 tx=0x7fb680015000).stop 2020-07-16T20:30:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c0ba9a0 msgr2=0x7fb68c0a3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.626 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c0ba9a0 0x7fb68c0a3490 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fb67c000e90 tx=0x7fb67c007a00).stop 2020-07-16T20:30:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69192a700 1 -- 172.21.15.22:0/1521833532 reap_dead start 2020-07-16T20:30:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 shutdown_connections 2020-07-16T20:30:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 --2- 172.21.15.22:0/1521833532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb68c0ba9a0 0x7fb68c0a3490 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 >> 172.21.15.22:0/1521833532 conn(0x7fb68c060070 msgr2=0x7fb68c14ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 shutdown_connections 2020-07-16T20:30:48.628 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.593+0000 7fb69338d700 1 -- 172.21.15.22:0/1521833532 wait complete. 2020-07-16T20:30:48.628 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:48.628 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:48.628 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:48.629 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2020-07-16T20:30:48.751 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.743+0000 7fb1d99f1700 1 Processor -- start 2020-07-16T20:30:48.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.743+0000 7fb1d99f1700 1 -- start start 2020-07-16T20:30:48.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d99f1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1d4142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.752 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d99f1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40b42d0 con 0x7fb1d4142f90 2020-07-16T20:30:48.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d99f1700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d40b5550 con 0x7fb1d4067c50 2020-07-16T20:30:48.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d99f1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b57f0 con 0x7fb1d40b3b50 2020-07-16T20:30:48.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d91f0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1d4142f90 0x7fb1d40b7f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40172/0 (socket says 172.21.15.22:40172) 2020-07-16T20:30:48.753 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d91f0700 1 -- 172.21.15.22:0/2076656919 learned_addr learned my addr 172.21.15.22:0/2076656919 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:48.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d3fff700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1d4142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23906422 0 0) 0x7fb1d40b42d0 con 0x7fb1d4142f90 2020-07-16T20:30:48.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b4003240 con 0x7fb1d4142f90 2020-07-16T20:30:48.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3763079765 0 0) 0x7fb1b4003240 con 0x7fb1d4142f90 2020-07-16T20:30:48.754 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 msgr2=0x7fb1d4142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1d4142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 >> v1:172.21.15.116:6789/0 conn(0x7fb1d4067c50 legacy=0x7fb1d40626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4143420 con 0x7fb1d4142f90 2020-07-16T20:30:48.755 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fb1bc0016d0 con 0x7fb1d4142f90 2020-07-16T20:30:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 >> v1:172.21.15.22:6789/0 conn(0x7fb1d4142f90 legacy=0x7fb1d40b7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1b4003760 0x7fb1b4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1b40040a0 0x7fb1b4004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1b4004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.756 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d40b57f0 con 0x7fb1b4003760 2020-07-16T20:30:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4005120 con 0x7fb1b40040a0 2020-07-16T20:30:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40052e0 con 0x7fb1d40b3b50 2020-07-16T20:30:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1b4003760 0x7fb1b4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d91f0700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1b4004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.757 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.744+0000 7fb1d3fff700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1b40040a0 0x7fb1b4004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 -- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 msgr2=0x7fb1b4004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d40b3b50 0x7fb1b4004be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 -- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1b40040a0 msgr2=0x7fb1b4004580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:48.758 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1b40040a0 0x7fb1b4004580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 -- 172.21.15.22:0/2076656919 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4003240 con 0x7fb1b4003760 2020-07-16T20:30:48.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1b4003760 0x7fb1b4003b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb1cc001360 tx=0x7fb1cc007ed0).ready entity=mon.0 client_cookie=343545945a01d347 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1cc00cc00 con 0x7fb1b4003760 2020-07-16T20:30:48.759 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc00cd60 con 0x7fb1b4003760 2020-07-16T20:30:48.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d37fe700 1 -- 172.21.15.22:0/2076656919 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1cc013600 con 0x7fb1b4003760 2020-07-16T20:30:48.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 -- 172.21.15.22:0/2076656919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1b4003760 msgr2=0x7fb1b4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/2076656919 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1b4003760 0x7fb1b4003b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb1cc001360 tx=0x7fb1cc007ed0).stop 2020-07-16T20:30:48.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d91f0700 1 -- 172.21.15.22:0/2076656919 reap_dead start 2020-07-16T20:30:48.760 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 -- 172.21.15.22:0/2076656919 shutdown_connections 2020-07-16T20:30:48.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 -- 172.21.15.22:0/2076656919 >> 172.21.15.22:0/2076656919 conn(0x7fb1d40b9390 msgr2=0x7fb1d40b97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 -- 172.21.15.22:0/2076656919 shutdown_connections 2020-07-16T20:30:48.761 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.745+0000 7fb1d99f1700 1 -- 172.21.15.22:0/2076656919 wait complete. 2020-07-16T20:30:48.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 Processor -- start 2020-07-16T20:30:48.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 -- start start 2020-07-16T20:30:48.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d4066770 0x7fb1d4066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1d4065ca0 0x7fb1d409b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.764 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d4152ff0 con 0x7fb1d4091b60 2020-07-16T20:30:48.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d4067120 con 0x7fb1d4065ca0 2020-07-16T20:30:48.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.747+0000 7fb1d99f1700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d4152c70 con 0x7fb1d4066770 2020-07-16T20:30:48.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb1d4065ca0 0x7fb1d409b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.765 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d91f0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb1d4091b60 0x7fb1d4091f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40186/0 (socket says 172.21.15.22:40186) 2020-07-16T20:30:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d91f0700 1 -- 172.21.15.22:0/3700033571 learned_addr learned my addr 172.21.15.22:0/3700033571 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d4066770 0x7fb1d4066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 -- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d4066770 msgr2=0x7fb1d4066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d4066770 0x7fb1d4066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.766 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 -- 172.21.15.22:0/3700033571 >> v1:172.21.15.22:6789/0 conn(0x7fb1d4091b60 legacy=0x7fb1d4091f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175256466 0 0) 0x7fb1d4152ff0 con 0x7fb1d4091b60 2020-07-16T20:30:48.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 -- 172.21.15.22:0/3700033571 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d408fd30 con 0x7fb1d4065ca0 2020-07-16T20:30:48.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d3fff700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1d4065ca0 0x7fb1d409b4d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb1c4008000 tx=0x7fb1c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.767 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c400f910 con 0x7fb1d4065ca0 2020-07-16T20:30:48.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400fa70 con 0x7fb1d4065ca0 2020-07-16T20:30:48.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d409b9c0 con 0x7fb1d4065ca0 2020-07-16T20:30:48.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1c400fdd0 con 0x7fb1d4065ca0 2020-07-16T20:30:48.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.748+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d4064ac0 con 0x7fb1d4065ca0 2020-07-16T20:30:48.768 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.749+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d4152de0 con 0x7fb1d4065ca0 2020-07-16T20:30:48.769 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.749+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb1c4014440 con 0x7fb1d4065ca0 2020-07-16T20:30:48.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.749+0000 7fb1d0ff9700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 0x7fb1b0052240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:48.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.750+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb1c4068550 con 0x7fb1d4065ca0 2020-07-16T20:30:48.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.750+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 0x7fb1b0052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:48.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.750+0000 7fb1d89ef700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 0x7fb1b0052240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb1cc01c000 tx=0x7fb1cc016000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:48.770 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.753+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fb1c4040c00 con 0x7fb1d4065ca0 2020-07-16T20:30:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.910+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1d4057490 con 0x7fb1b004fd80 2020-07-16T20:30:48.912 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.910+0000 7fb1d0ff9700 1 -- 172.21.15.22:0/3700033571 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1d4057490 con 0x7fb1b004fd80 2020-07-16T20:30:48.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 msgr2=0x7fb1b0052240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 0x7fb1b0052240 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb1cc01c000 tx=0x7fb1cc016000).stop 2020-07-16T20:30:48.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1d4065ca0 msgr2=0x7fb1d409b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:48.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1d4065ca0 0x7fb1d409b4d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb1c4008000 tx=0x7fb1c4008040).stop 2020-07-16T20:30:48.915 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 shutdown_connections 2020-07-16T20:30:48.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb1b004fd80 0x7fb1b0052240 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1d4066770 0x7fb1d4066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.916 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 --2- 172.21.15.22:0/3700033571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1d4065ca0 0x7fb1d409b4d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:48.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 >> 172.21.15.22:0/3700033571 conn(0x7fb1d40b9390 msgr2=0x7fb1d40626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:48.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 shutdown_connections 2020-07-16T20:30:48.917 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:48.912+0000 7fb1d99f1700 1 -- 172.21.15.22:0/3700033571 wait complete. 2020-07-16T20:30:48.918 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2020-07-16T20:30:48.924 INFO:tasks.ceph:Scrubbing osd.3 2020-07-16T20:30:48.925 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:49.062 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.043+0000 7fb44a296700 1 Processor -- start 2020-07-16T20:30:49.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.043+0000 7fb44a296700 1 -- start start 2020-07-16T20:30:49.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb44a296700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb4440b8670 0x7fb4440b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb44a296700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440b8ff0 con 0x7fb44409d720 2020-07-16T20:30:49.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb44a296700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440b3de0 con 0x7fb4440b4990 2020-07-16T20:30:49.063 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb44a296700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44409f700 con 0x7fb4440b8670 2020-07-16T20:30:49.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb4437fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb44409d720 0x7fb4440b4280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40190/0 (socket says 172.21.15.22:40190) 2020-07-16T20:30:49.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb4437fe700 1 -- 172.21.15.22:0/1958365870 learned_addr learned my addr 172.21.15.22:0/1958365870 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb443fff700 1 --2- 172.21.15.22:0/1958365870 >> v2:172.21.15.116:3300/0 conn(0x7fb4440b8670 0x7fb4440b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.064 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.044+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660997861 0 0) 0x7fb4440b8ff0 con 0x7fb44409d720 2020-07-16T20:30:49.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb430003240 con 0x7fb44409d720 2020-07-16T20:30:49.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1937056595 0 0) 0x7fb430003240 con 0x7fb44409d720 2020-07-16T20:30:49.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 >> v2:172.21.15.116:3300/0 conn(0x7fb4440b8670 msgr2=0x7fb4440b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.065 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 --2- 172.21.15.22:0/1958365870 >> v2:172.21.15.116:3300/0 conn(0x7fb4440b8670 0x7fb4440b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 >> v1:172.21.15.116:6789/0 conn(0x7fb4440b4990 legacy=0x7fb444147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440b56f0 con 0x7fb44409d720 2020-07-16T20:30:49.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fb4380016d0 con 0x7fb44409d720 2020-07-16T20:30:49.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb443fff700 1 --2- 172.21.15.22:0/1958365870 >> v2:172.21.15.116:3300/0 conn(0x7fb4440b8670 0x7fb4440b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:49.066 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 >> v1:172.21.15.22:6789/0 conn(0x7fb44409d720 legacy=0x7fb4440b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb430003730 0x7fb430003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 0x7fb430004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb430004e50 0x7fb43000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.067 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44409f700 con 0x7fb4300044e0 2020-07-16T20:30:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb430004350 con 0x7fb430004e50 2020-07-16T20:30:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43000de60 con 0x7fb430003730 2020-07-16T20:30:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 0x7fb430004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb448833700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb430004e50 0x7fb43000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.068 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb443fff700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb430003730 0x7fb430003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 -- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb430003730 msgr2=0x7fb430003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb430003730 0x7fb430003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 -- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb430004e50 msgr2=0x7fb43000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.069 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb430004e50 0x7fb43000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 -- 172.21.15.22:0/1958365870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430003240 con 0x7fb4300044e0 2020-07-16T20:30:49.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb448833700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb430004e50 0x7fb43000b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-07-16T20:30:49.070 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb448833700 1 -- 172.21.15.22:0/1958365870 reap_dead start 2020-07-16T20:30:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.045+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 0x7fb430004960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb4380013e0 tx=0x7fb4380076d0).ready entity=mon.0 client_cookie=589e178d83c198e6 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4380070d0 con 0x7fb4300044e0 2020-07-16T20:30:49.071 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438007230 con 0x7fb4300044e0 2020-07-16T20:30:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb442ffd700 1 -- 172.21.15.22:0/1958365870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4380055f0 con 0x7fb4300044e0 2020-07-16T20:30:49.072 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 -- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 msgr2=0x7fb430004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 0x7fb430004960 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb4380013e0 tx=0x7fb4380076d0).stop 2020-07-16T20:30:49.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 -- 172.21.15.22:0/1958365870 shutdown_connections 2020-07-16T20:30:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 --2- 172.21.15.22:0/1958365870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb4300044e0 0x7fb430004960 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 -- 172.21.15.22:0/1958365870 >> 172.21.15.22:0/1958365870 conn(0x7fb4440b9660 msgr2=0x7fb4440b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.075 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 -- 172.21.15.22:0/1958365870 shutdown_connections 2020-07-16T20:30:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.046+0000 7fb44a296700 1 -- 172.21.15.22:0/1958365870 wait complete. 2020-07-16T20:30:49.076 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.047+0000 7fb44a296700 1 Processor -- start 2020-07-16T20:30:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.047+0000 7fb44a296700 1 -- start start 2020-07-16T20:30:49.077 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb44a296700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb444146d20 0x7fb444066f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb44a296700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb444156e20 con 0x7fb444066ba0 2020-07-16T20:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb44a296700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4441570c0 con 0x7fb444157800 2020-07-16T20:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb44a296700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb444157ce0 con 0x7fb444146d20 2020-07-16T20:30:49.078 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb443fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb444066ba0 0x7fb44415a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40202/0 (socket says 172.21.15.22:40202) 2020-07-16T20:30:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb443fff700 1 -- 172.21.15.22:0/1906684810 learned_addr learned my addr 172.21.15.22:0/1906684810 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1906684810 >> v2:172.21.15.22:3300/0 conn(0x7fb444146d20 0x7fb444066f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137700696 0 0) 0x7fb444156e20 con 0x7fb444066ba0 2020-07-16T20:30:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb41c003240 con 0x7fb444066ba0 2020-07-16T20:30:49.079 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb4437fe700 1 -- 172.21.15.22:0/1906684810 >> v1:172.21.15.116:6789/0 conn(0x7fb444157800 legacy=0x7fb444150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629514678 0 0) 0x7fb4441570c0 con 0x7fb444157800 2020-07-16T20:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb4437fe700 1 -- 172.21.15.22:0/1906684810 >> v1:172.21.15.22:6789/0 conn(0x7fb444066ba0 legacy=0x7fb44415a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.048+0000 7fb4437fe700 1 -- 172.21.15.22:0/1906684810 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444157360 con 0x7fb444146d20 2020-07-16T20:30:49.080 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb4437fe700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb444146d20 0x7fb444066f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb4380013e0 tx=0x7fb438015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4380070d0 con 0x7fb444146d20 2020-07-16T20:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438013850 con 0x7fb444146d20 2020-07-16T20:30:49.081 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44415b070 con 0x7fb444146d20 2020-07-16T20:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438013bb0 con 0x7fb444146d20 2020-07-16T20:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.049+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb444140290 con 0x7fb444146d20 2020-07-16T20:30:49.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4441511e0 con 0x7fb444146d20 2020-07-16T20:30:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fb438010070 con 0x7fb444146d20 2020-07-16T20:30:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb41c050310 0x7fb41c0527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.083 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb438069510 con 0x7fb444146d20 2020-07-16T20:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7fb41c057d00 0x7fb41c05a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 --> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb41c05a770 con 0x7fb41c057d00 2020-07-16T20:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb43806bb80 con 0x7fb444146d20 2020-07-16T20:30:49.084 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.050+0000 7fb443fff700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb41c050310 0x7fb41c0527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.051+0000 7fb448833700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7fb41c057d00 0x7fb41c05a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.051+0000 7fb443fff700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb41c050310 0x7fb41c0527d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb43400c000 tx=0x7fb434008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.051+0000 7fb448833700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7fb41c057d00 0x7fb41c05a120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.085 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.052+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== osd.3 v2:172.21.15.22:6819/23870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fb41c05a770 con 0x7fb41c057d00 2020-07-16T20:30:49.088 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.068+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 --> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4440afc40 con 0x7fb41c057d00 2020-07-16T20:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.068+0000 7fb423fff700 1 -- 172.21.15.22:0/1906684810 <== osd.3 v2:172.21.15.22:6819/23870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb4440afc40 con 0x7fb41c057d00 2020-07-16T20:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7fb41c057d00 msgr2=0x7fb41c05a120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:6819/23870,v1:172.21.15.22:6821/23870] conn(0x7fb41c057d00 0x7fb41c05a120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb41c050310 msgr2=0x7fb41c0527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fb41c050310 0x7fb41c0527d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb43400c000 tx=0x7fb434008040).stop 2020-07-16T20:30:49.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb444146d20 msgr2=0x7fb444066f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb444146d20 0x7fb444066f80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb4380013e0 tx=0x7fb438015000).stop 2020-07-16T20:30:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb448833700 1 -- 172.21.15.22:0/1906684810 reap_dead start 2020-07-16T20:30:49.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 shutdown_connections 2020-07-16T20:30:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 --2- 172.21.15.22:0/1906684810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb444146d20 0x7fb444066f80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 >> 172.21.15.22:0/1906684810 conn(0x7fb4440b9660 msgr2=0x7fb4440b6950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 shutdown_connections 2020-07-16T20:30:49.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.069+0000 7fb44a296700 1 -- 172.21.15.22:0/1906684810 wait complete. 2020-07-16T20:30:49.096 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:49.097 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:49.097 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:49.098 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2020-07-16T20:30:49.214 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.213+0000 7f984337d700 1 Processor -- start 2020-07-16T20:30:49.215 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.213+0000 7f984337d700 1 -- start start 2020-07-16T20:30:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984337d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f983c09cce0 0x7f983c146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984337d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f983c062ed0 0x7f983c09e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984337d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c144e80 con 0x7f983c146e10 2020-07-16T20:30:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984337d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c1472c0 con 0x7f983c062ed0 2020-07-16T20:30:49.218 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984337d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c144be0 con 0x7f983c09cce0 2020-07-16T20:30:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f9840918700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f983c146e10 0x7f983c0627c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40214/0 (socket says 172.21.15.22:40214) 2020-07-16T20:30:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f9840918700 1 -- 172.21.15.22:0/3316711607 learned_addr learned my addr 172.21.15.22:0/3316711607 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 --2- 172.21.15.22:0/3316711607 >> v2:172.21.15.22:3300/0 conn(0x7f983c062ed0 0x7f983c09e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.219 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f9841119700 1 --2- 172.21.15.22:0/3316711607 >> v2:172.21.15.116:3300/0 conn(0x7f983c09cce0 0x7f983c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f982bfff700 1 -- 172.21.15.22:0/3316711607 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114386379 0 0) 0x7f983c144e80 con 0x7f983c146e10 2020-07-16T20:30:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f982bfff700 1 -- 172.21.15.22:0/3316711607 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003240 con 0x7f983c146e10 2020-07-16T20:30:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 -- 172.21.15.22:0/3316711607 >> v2:172.21.15.116:3300/0 conn(0x7f983c09cce0 msgr2=0x7f983c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 --2- 172.21.15.22:0/3316711607 >> v2:172.21.15.116:3300/0 conn(0x7f983c09cce0 0x7f983c146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.220 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 -- 172.21.15.22:0/3316711607 >> v1:172.21.15.22:6789/0 conn(0x7f983c146e10 legacy=0x7f983c0627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 -- 172.21.15.22:0/3316711607 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c09e430 con 0x7f983c062ed0 2020-07-16T20:30:49.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.214+0000 7f984191a700 1 --2- 172.21.15.22:0/3316711607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c062ed0 0x7f983c09e8d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f98340032b0 tx=0x7f98340091d0).ready entity=mon.0 client_cookie=7f3ab92253b7f639 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f982bfff700 1 -- 172.21.15.22:0/3316711607 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983400b9a0 con 0x7f983c062ed0 2020-07-16T20:30:49.222 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f982bfff700 1 -- 172.21.15.22:0/3316711607 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400bb00 con 0x7f983c062ed0 2020-07-16T20:30:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f982bfff700 1 -- 172.21.15.22:0/3316711607 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983400bc70 con 0x7f983c062ed0 2020-07-16T20:30:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 -- 172.21.15.22:0/3316711607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c062ed0 msgr2=0x7f983c09e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 --2- 172.21.15.22:0/3316711607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c062ed0 0x7f983c09e8d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f98340032b0 tx=0x7f98340091d0).stop 2020-07-16T20:30:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 -- 172.21.15.22:0/3316711607 shutdown_connections 2020-07-16T20:30:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 --2- 172.21.15.22:0/3316711607 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c062ed0 0x7f983c09e8d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 --2- 172.21.15.22:0/3316711607 >> v2:172.21.15.116:3300/0 conn(0x7f983c09cce0 0x7f983c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 -- 172.21.15.22:0/3316711607 >> 172.21.15.22:0/3316711607 conn(0x7f983c0b9530 msgr2=0x7f983c0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.224 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 -- 172.21.15.22:0/3316711607 shutdown_connections 2020-07-16T20:30:49.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.215+0000 7f984337d700 1 -- 172.21.15.22:0/3316711607 wait complete. 2020-07-16T20:30:49.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.216+0000 7f984337d700 1 Processor -- start 2020-07-16T20:30:49.225 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.216+0000 7f984337d700 1 -- start start 2020-07-16T20:30:49.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984337d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f983c138470 0x7f983c15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984337d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f983c13f8d0 0x7f983c135840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984337d700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c13a0d0 con 0x7f983c146e10 2020-07-16T20:30:49.228 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984337d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c1389a0 con 0x7f983c13f8d0 2020-07-16T20:30:49.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984337d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c139dc0 con 0x7f983c138470 2020-07-16T20:30:49.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984191a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f983c13f8d0 0x7f983c135840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984191a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f983c13f8d0 0x7f983c135840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39514/0 (socket says 172.21.15.22:39514) 2020-07-16T20:30:49.229 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f984191a700 1 -- 172.21.15.22:0/217242861 learned_addr learned my addr 172.21.15.22:0/217242861 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:49.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.217+0000 7f9840918700 1 --2- 172.21.15.22:0/217242861 >> v2:172.21.15.116:3300/0 conn(0x7f983c138470 0x7f983c15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984191a700 1 -- 172.21.15.22:0/217242861 >> v2:172.21.15.116:3300/0 conn(0x7f983c138470 msgr2=0x7f983c15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984191a700 1 --2- 172.21.15.22:0/217242861 >> v2:172.21.15.116:3300/0 conn(0x7f983c138470 0x7f983c15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984191a700 1 -- 172.21.15.22:0/217242861 >> v1:172.21.15.116:6789/0 conn(0x7f983c146e10 legacy=0x7f983c09eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.230 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984191a700 1 -- 172.21.15.22:0/217242861 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0b6c40 con 0x7f983c13f8d0 2020-07-16T20:30:49.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984191a700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c13f8d0 0x7f983c135840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f983c141810 tx=0x7f9834016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98340107a0 con 0x7f983c13f8d0 2020-07-16T20:30:49.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834010900 con 0x7f983c13f8d0 2020-07-16T20:30:49.231 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c135d30 con 0x7f983c13f8d0 2020-07-16T20:30:49.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9834010c60 con 0x7f983c13f8d0 2020-07-16T20:30:49.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.218+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c13a570 con 0x7f983c13f8d0 2020-07-16T20:30:49.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.219+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c05f320 con 0x7f983c13f8d0 2020-07-16T20:30:49.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.219+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f9834027030 con 0x7f983c13f8d0 2020-07-16T20:30:49.232 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.219+0000 7f98297fa700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 0x7f9814052400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.219+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f9834069000 con 0x7f983c13f8d0 2020-07-16T20:30:49.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.219+0000 7f9841119700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 0x7f9814052400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.220+0000 7f9841119700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 0x7f9814052400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f983c139410 tx=0x7f982c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.233 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.223+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f98340417d0 con 0x7f983c13f8d0 2020-07-16T20:30:49.386 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.384+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f983c0b6e30 con 0x7f981404ff40 2020-07-16T20:30:49.387 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.385+0000 7f98297fa700 1 -- 172.21.15.22:0/217242861 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f983c0b6e30 con 0x7f981404ff40 2020-07-16T20:30:49.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.386+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 msgr2=0x7f9814052400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.386+0000 7f984337d700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 0x7f9814052400 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f983c139410 tx=0x7f982c008040).stop 2020-07-16T20:30:49.389 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.386+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c13f8d0 msgr2=0x7f983c135840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.386+0000 7f984337d700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c13f8d0 0x7f983c135840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f983c141810 tx=0x7f9834016000).stop 2020-07-16T20:30:49.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 shutdown_connections 2020-07-16T20:30:49.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f981404ff40 0x7f9814052400 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.392 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 --2- 172.21.15.22:0/217242861 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f983c13f8d0 0x7f983c135840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.393 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 --2- 172.21.15.22:0/217242861 >> v2:172.21.15.116:3300/0 conn(0x7f983c138470 0x7f983c15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.393 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 >> 172.21.15.22:0/217242861 conn(0x7f983c0b9530 msgr2=0x7f983c137890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.395 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 shutdown_connections 2020-07-16T20:30:49.396 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.387+0000 7f984337d700 1 -- 172.21.15.22:0/217242861 wait complete. 2020-07-16T20:30:49.396 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2020-07-16T20:30:49.399 INFO:tasks.ceph:Scrubbing osd.4 2020-07-16T20:30:49.399 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:49.519 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.518+0000 7fd35328f700 1 Processor -- start 2020-07-16T20:30:49.520 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.518+0000 7fd35328f700 1 -- start start 2020-07-16T20:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c0b8670 0x7fd34c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c09db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd34c0b4280 0x7fd34c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0b4bc0 con 0x7fd34c0b4280 2020-07-16T20:30:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c0b8ff0 con 0x7fd34c09d720 2020-07-16T20:30:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35328f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0b3de0 con 0x7fd34c0b8670 2020-07-16T20:30:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd34c0b4280 0x7fd34c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd34c0b4280 0x7fd34c0b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39518/0 (socket says 172.21.15.22:39518) 2020-07-16T20:30:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 -- 172.21.15.22:0/68028003 learned_addr learned my addr 172.21.15.22:0/68028003 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35082a700 1 --2- 172.21.15.22:0/68028003 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c09db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35102b700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c0b8670 0x7fd34c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 -- 172.21.15.22:0/68028003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c0b8670 msgr2=0x7fd34c0b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c0b8670 0x7fd34c0b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 -- 172.21.15.22:0/68028003 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 msgr2=0x7fd34c09db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 --2- 172.21.15.22:0/68028003 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c09db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 -- 172.21.15.22:0/68028003 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c09f700 con 0x7fd34c0b4280 2020-07-16T20:30:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35082a700 1 --2- 172.21.15.22:0/68028003 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-07-16T20:30:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.519+0000 7fd35182c700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd34c0b4280 0x7fd34c0b46d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd3440032b0 tx=0x7fd344009270).ready entity=mon.0 client_cookie=652d559471e76a74 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd33bfff700 1 -- 172.21.15.22:0/68028003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34400bc00 con 0x7fd34c0b4280 2020-07-16T20:30:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd33bfff700 1 -- 172.21.15.22:0/68028003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34400bd60 con 0x7fd34c0b4280 2020-07-16T20:30:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd33bfff700 1 -- 172.21.15.22:0/68028003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd344011400 con 0x7fd34c0b4280 2020-07-16T20:30:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 -- 172.21.15.22:0/68028003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd34c0b4280 msgr2=0x7fd34c0b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd34c0b4280 0x7fd34c0b46d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fd3440032b0 tx=0x7fd344009270).stop 2020-07-16T20:30:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 -- 172.21.15.22:0/68028003 shutdown_connections 2020-07-16T20:30:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd34c0b4280 0x7fd34c0b46d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 --2- 172.21.15.22:0/68028003 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c0b8670 0x7fd34c0b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 --2- 172.21.15.22:0/68028003 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 -- 172.21.15.22:0/68028003 >> 172.21.15.22:0/68028003 conn(0x7fd34c0b9660 msgr2=0x7fd34c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 -- 172.21.15.22:0/68028003 shutdown_connections 2020-07-16T20:30:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.520+0000 7fd35328f700 1 -- 172.21.15.22:0/68028003 wait complete. 2020-07-16T20:30:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.521+0000 7fd35328f700 1 Processor -- start 2020-07-16T20:30:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.521+0000 7fd35328f700 1 -- start start 2020-07-16T20:30:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35328f700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35328f700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd34c141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35328f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c13e980 con 0x7fd34c0b8670 2020-07-16T20:30:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35328f700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c067440 con 0x7fd34c09d720 2020-07-16T20:30:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35328f700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c064f30 con 0x7fd34c066bc0 2020-07-16T20:30:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35082a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd34c0b8670 0x7fd34c13e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40234/0 (socket says 172.21.15.22:40234) 2020-07-16T20:30:49.553 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35082a700 1 -- 172.21.15.22:0/1173868636 learned_addr learned my addr 172.21.15.22:0/1173868636 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249019119 0 0) 0x7fd34c13e980 con 0x7fd34c0b8670 2020-07-16T20:30:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35102b700 1 --2- 172.21.15.22:0/1173868636 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd324003240 con 0x7fd34c0b8670 2020-07-16T20:30:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.522+0000 7fd35182c700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd34c141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1676216372 0 0) 0x7fd324003240 con 0x7fd34c0b8670 2020-07-16T20:30:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd34c13e980 con 0x7fd34c0b8670 2020-07-16T20:30:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fd3480012a0 con 0x7fd34c0b8670 2020-07-16T20:30:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 msgr2=0x7fd34c141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd34c141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.556 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 msgr2=0x7fd34c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.556 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> v2:172.21.15.116:3300/0 conn(0x7fd34c09d720 0x7fd34c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.557 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 >> v1:172.21.15.22:6789/0 conn(0x7fd34c0b8670 legacy=0x7fd34c13e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.557 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd324003800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.558 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd324003d10 0x7fd3240044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.558 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 0x7fd324004e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.558 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c067440 con 0x7fd3240049d0 2020-07-16T20:30:49.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c064f30 con 0x7fd324003d10 2020-07-16T20:30:49.559 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324004350 con 0x7fd34c066bc0 2020-07-16T20:30:49.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 0x7fd324004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35102b700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd324003800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.560 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35082a700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd324003d10 0x7fd3240044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 msgr2=0x7fd324003800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd34c066bc0 0x7fd324003800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd324003d10 msgr2=0x7fd3240044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd324003d10 0x7fd3240044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.561 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0651d0 con 0x7fd3240049d0 2020-07-16T20:30:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c141780 con 0x7fd3240049d0 2020-07-16T20:30:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c0b26b0 con 0x7fd3240049d0 2020-07-16T20:30:49.562 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd35182c700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 0x7fd324004e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fd34401b000 tx=0x7fd344016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd344010870 con 0x7fd3240049d0 2020-07-16T20:30:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3440109d0 con 0x7fd3240049d0 2020-07-16T20:30:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.523+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd344010d30 con 0x7fd3240049d0 2020-07-16T20:30:49.563 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.524+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd34c15b3c0 con 0x7fd3240049d0 2020-07-16T20:30:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.524+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fd34400f070 con 0x7fd3240049d0 2020-07-16T20:30:49.564 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 0x7fd32405a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd344069390 con 0x7fd3240049d0 2020-07-16T20:30:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd35102b700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 0x7fd32405a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.565 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd3397fa700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7fd32405fc90 0x7fd3240620b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.566 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd324062790 con 0x7fd32405fc90 2020-07-16T20:30:49.566 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34406ba00 con 0x7fd3240049d0 2020-07-16T20:30:49.566 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd35082a700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7fd32405fc90 0x7fd3240620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.567 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.525+0000 7fd35102b700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 0x7fd32405a680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd33c00c000 tx=0x7fd33c008040).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.526+0000 7fd35082a700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7fd32405fc90 0x7fd3240620b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.568 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.526+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== osd.4 v2:172.21.15.116:6802/24113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7fd324062790 con 0x7fd32405fc90 2020-07-16T20:30:49.571 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.543+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 --> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd34c0b2b90 con 0x7fd32405fc90 2020-07-16T20:30:49.571 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd3397fa700 1 -- 172.21.15.22:0/1173868636 <== osd.4 v2:172.21.15.116:6802/24113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd34c0b2b90 con 0x7fd32405fc90 2020-07-16T20:30:49.572 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7fd32405fc90 msgr2=0x7fd3240620b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.572 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6802/24113,v1:172.21.15.116:6803/24113] conn(0x7fd32405fc90 0x7fd3240620b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35182c700 1 -- 172.21.15.22:0/1173868636 reap_dead start 2020-07-16T20:30:49.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 msgr2=0x7fd32405a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.573 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 0x7fd32405a680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fd33c00c000 tx=0x7fd33c008040).stop 2020-07-16T20:30:49.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 msgr2=0x7fd324004e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.544+0000 7fd35328f700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 0x7fd324004e50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fd34401b000 tx=0x7fd344016000).stop 2020-07-16T20:30:49.574 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 shutdown_connections 2020-07-16T20:30:49.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3240049d0 0x7fd324004e50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 --2- 172.21.15.22:0/1173868636 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fd3240581c0 0x7fd32405a680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.575 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 >> 172.21.15.22:0/1173868636 conn(0x7fd34c0b9660 msgr2=0x7fd34c0af060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 shutdown_connections 2020-07-16T20:30:49.576 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.545+0000 7fd35328f700 1 -- 172.21.15.22:0/1173868636 wait complete. 2020-07-16T20:30:49.576 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:49.577 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:49.577 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:49.578 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2020-07-16T20:30:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.695+0000 7feaeb64b700 1 Processor -- start 2020-07-16T20:30:49.697 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feaeb64b700 1 -- start start 2020-07-16T20:30:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feaeb64b700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feae409e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feaeb64b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40b5610 con 0x7feae4063130 2020-07-16T20:30:49.701 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feaeb64b700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40b58b0 con 0x7feae4063510 2020-07-16T20:30:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feaeb64b700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae40b5400 con 0x7feae4143260 2020-07-16T20:30:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feae93e7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feae4063130 0x7feae4142b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40248/0 (socket says 172.21.15.22:40248) 2020-07-16T20:30:49.708 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.696+0000 7feae93e7700 1 -- 172.21.15.22:0/2141942538 learned_addr learned my addr 172.21.15.22:0/2141942538 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae9be8700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feae409e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214030222 0 0) 0x7feae40b5610 con 0x7feae4063130 2020-07-16T20:30:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feacc003240 con 0x7feae4063130 2020-07-16T20:30:49.709 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2284456777 0 0) 0x7feacc003240 con 0x7feae4063130 2020-07-16T20:30:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 msgr2=0x7feae409e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feae409e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 >> v1:172.21.15.116:6789/0 conn(0x7feae4063510 legacy=0x7feae409d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40b5d50 con 0x7feae4063130 2020-07-16T20:30:49.710 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fead80016d0 con 0x7feae4063130 2020-07-16T20:30:49.711 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 >> v1:172.21.15.22:6789/0 conn(0x7feae4063130 legacy=0x7feae4142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.711 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feacc003760 0x7feacc003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.711 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feacc0044e0 0x7feacc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.712 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feacc004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae40b5400 con 0x7feacc0044e0 2020-07-16T20:30:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc005390 con 0x7feacc003760 2020-07-16T20:30:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc004320 con 0x7feae4143260 2020-07-16T20:30:49.714 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae8be6700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feacc0044e0 0x7feacc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.714 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae93e7700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feacc003760 0x7feacc003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.714 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae9be8700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feacc004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.714 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae8be6700 1 -- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 msgr2=0x7feacc004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.697+0000 7feae8be6700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7feae4143260 0x7feacc004e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feae8be6700 1 -- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feacc003760 msgr2=0x7feacc003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:49.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feae8be6700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7feacc003760 0x7feacc003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feae8be6700 1 -- 172.21.15.22:0/2141942538 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc003240 con 0x7feacc0044e0 2020-07-16T20:30:49.715 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feae8be6700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feacc0044e0 0x7feacc004960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7feae40b9150 tx=0x7feae0007ef0).ready entity=mon.0 client_cookie=8d2e5ff50a84782e server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000c9a0 con 0x7feacc0044e0 2020-07-16T20:30:49.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000cb00 con 0x7feacc0044e0 2020-07-16T20:30:49.716 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7fead7fff700 1 -- 172.21.15.22:0/2141942538 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000ce60 con 0x7feacc0044e0 2020-07-16T20:30:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 -- 172.21.15.22:0/2141942538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feacc0044e0 msgr2=0x7feacc004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 --2- 172.21.15.22:0/2141942538 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feacc0044e0 0x7feacc004960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7feae40b9150 tx=0x7feae0007ef0).stop 2020-07-16T20:30:49.723 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feae9be8700 1 -- 172.21.15.22:0/2141942538 reap_dead start 2020-07-16T20:30:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 -- 172.21.15.22:0/2141942538 shutdown_connections 2020-07-16T20:30:49.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 -- 172.21.15.22:0/2141942538 >> 172.21.15.22:0/2141942538 conn(0x7feae40b9530 msgr2=0x7feae40b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.725 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 -- 172.21.15.22:0/2141942538 shutdown_connections 2020-07-16T20:30:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.698+0000 7feaeb64b700 1 -- 172.21.15.22:0/2141942538 wait complete. 2020-07-16T20:30:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.699+0000 7feaeb64b700 1 Processor -- start 2020-07-16T20:30:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.699+0000 7feaeb64b700 1 -- start start 2020-07-16T20:30:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feaeb64b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7feae415a860 0x7feae413a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feaeb64b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40af1b0 con 0x7feae415a480 2020-07-16T20:30:49.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feaeb64b700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae40af450 con 0x7feae413a820 2020-07-16T20:30:49.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feaeb64b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae40aef00 con 0x7feae415a860 2020-07-16T20:30:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feae8be6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7feae415a860 0x7feae413a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feae93e7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7feae415a480 0x7feae415acb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40258/0 (socket says 172.21.15.22:40258) 2020-07-16T20:30:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.700+0000 7feae93e7700 1 -- 172.21.15.22:0/2752904897 learned_addr learned my addr 172.21.15.22:0/2752904897 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feae8be6700 1 -- 172.21.15.22:0/2752904897 >> v1:172.21.15.116:6789/0 conn(0x7feae413a820 legacy=0x7feae4064db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feae8be6700 1 -- 172.21.15.22:0/2752904897 >> v1:172.21.15.22:6789/0 conn(0x7feae415a480 legacy=0x7feae415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934972124 0 0) 0x7feae40af1b0 con 0x7feae415a480 2020-07-16T20:30:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feae8be6700 1 -- 172.21.15.22:0/2752904897 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40663d0 con 0x7feae415a860 2020-07-16T20:30:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feae8be6700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae415a860 0x7feae413a330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7feae40b9150 tx=0x7feae0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae001f670 con 0x7feae415a860 2020-07-16T20:30:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae001f7d0 con 0x7feae415a860 2020-07-16T20:30:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae4141890 con 0x7feae415a860 2020-07-16T20:30:49.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae001fb30 con 0x7feae415a860 2020-07-16T20:30:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.701+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae4065700 con 0x7feae415a860 2020-07-16T20:30:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.702+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae4141b70 con 0x7feae415a860 2020-07-16T20:30:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.702+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7feae0026030 con 0x7feae415a860 2020-07-16T20:30:49.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.702+0000 7fead57fa700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 0x7feabc052440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:49.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.703+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7feae0069e00 con 0x7feae415a860 2020-07-16T20:30:49.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.703+0000 7feae93e7700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 0x7feabc052440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:49.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.703+0000 7feae93e7700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 0x7feabc052440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fead80013e0 tx=0x7feae40b57a0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:49.743 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.706+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7feae4141b70 con 0x7feae415a860 2020-07-16T20:30:49.868 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.861+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7feae40af040 con 0x7feabc04ff80 2020-07-16T20:30:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.861+0000 7fead57fa700 1 -- 172.21.15.22:0/2752904897 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feae40af040 con 0x7feabc04ff80 2020-07-16T20:30:49.869 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 msgr2=0x7feabc052440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.870 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 0x7feabc052440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fead80013e0 tx=0x7feae40b57a0).stop 2020-07-16T20:30:49.870 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae415a860 msgr2=0x7feae413a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:49.870 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae415a860 0x7feae413a330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7feae40b9150 tx=0x7feae0016000).stop 2020-07-16T20:30:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 shutdown_connections 2020-07-16T20:30:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7feabc04ff80 0x7feabc052440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.871 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 --2- 172.21.15.22:0/2752904897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feae415a860 0x7feae413a330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:49.872 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 >> 172.21.15.22:0/2752904897 conn(0x7feae40b9530 msgr2=0x7feae40b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 shutdown_connections 2020-07-16T20:30:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.863+0000 7feaeb64b700 1 -- 172.21.15.22:0/2752904897 wait complete. 2020-07-16T20:30:49.873 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 4 to deep-scrub 2020-07-16T20:30:49.875 INFO:tasks.ceph:Scrubbing osd.5 2020-07-16T20:30:49.875 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:49.994 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 Processor -- start 2020-07-16T20:30:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 -- start start 2020-07-16T20:30:50.009 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 0x7f4d4c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0b8ff0 con 0x7f4d4c0b8670 2020-07-16T20:30:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c0b3de0 con 0x7f4d4c0b8a50 2020-07-16T20:30:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.993+0000 7f4d5415a700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c09de30 con 0x7f4d4c0b4990 2020-07-16T20:30:50.010 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d51ef6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4d4c0b8670 0x7f4d4c09d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40266/0 (socket says 172.21.15.22:40266) 2020-07-16T20:30:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d51ef6700 1 -- 172.21.15.22:0/776293475 learned_addr learned my addr 172.21.15.22:0/776293475 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.011 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d526f7700 1 --2- 172.21.15.22:0/776293475 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 0x7f4d4c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323932259 0 0) 0x7f4d4c0b8ff0 con 0x7f4d4c0b8670 2020-07-16T20:30:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d34003240 con 0x7f4d4c0b8670 2020-07-16T20:30:50.012 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051438495 0 0) 0x7f4d4c0b3de0 con 0x7f4d4c0b8a50 2020-07-16T20:30:50.013 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d4c0b8ff0 con 0x7f4d4c0b8a50 2020-07-16T20:30:50.013 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1459508315 0 0) 0x7f4d34003240 con 0x7f4d4c0b8670 2020-07-16T20:30:50.013 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d526f7700 1 -- 172.21.15.22:0/776293475 >> v1:172.21.15.116:6789/0 conn(0x7f4d4c0b8a50 legacy=0x7f4d4c0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.013 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d526f7700 1 -- 172.21.15.22:0/776293475 >> v1:172.21.15.22:6789/0 conn(0x7f4d4c0b8670 legacy=0x7f4d4c09d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d526f7700 1 -- 172.21.15.22:0/776293475 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c09f700 con 0x7f4d4c0b4990 2020-07-16T20:30:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d526f7700 1 --2- 172.21.15.22:0/776293475 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 0x7f4d4c14ec30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4d400010d0 tx=0x7f4d440091d0).ready entity=mon.2 client_cookie=2d59739562019b88 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d400016d0 con 0x7f4d4c0b4990 2020-07-16T20:30:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4400b7e0 con 0x7f4d4c0b4990 2020-07-16T20:30:50.014 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d50ef4700 1 -- 172.21.15.22:0/776293475 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4400b950 con 0x7f4d4c0b4990 2020-07-16T20:30:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d5415a700 1 -- 172.21.15.22:0/776293475 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 msgr2=0x7f4d4c14ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.994+0000 7f4d5415a700 1 --2- 172.21.15.22:0/776293475 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 0x7f4d4c14ec30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4d400010d0 tx=0x7f4d440091d0).stop 2020-07-16T20:30:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.995+0000 7f4d5415a700 1 -- 172.21.15.22:0/776293475 shutdown_connections 2020-07-16T20:30:50.015 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.995+0000 7f4d5415a700 1 --2- 172.21.15.22:0/776293475 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d4c0b4990 0x7f4d4c14ec30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.016 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.995+0000 7f4d5415a700 1 -- 172.21.15.22:0/776293475 >> 172.21.15.22:0/776293475 conn(0x7f4d4c0b9660 msgr2=0x7f4d4c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.016 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.995+0000 7f4d5415a700 1 -- 172.21.15.22:0/776293475 shutdown_connections 2020-07-16T20:30:50.016 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.995+0000 7f4d5415a700 1 -- 172.21.15.22:0/776293475 wait complete. 2020-07-16T20:30:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.996+0000 7f4d5415a700 1 Processor -- start 2020-07-16T20:30:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.996+0000 7f4d5415a700 1 -- start start 2020-07-16T20:30:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d5415a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d4c0b8670 0x7f4d4c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d5415a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c15a9b0 con 0x7f4d4c14bc20 2020-07-16T20:30:50.017 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d5415a700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c15abe0 con 0x7f4d4c0b8a50 2020-07-16T20:30:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d5415a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c14c650 con 0x7f4d4c0b8670 2020-07-16T20:30:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d51ef6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d4c0b8670 0x7f4d4c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d526f7700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4d4c14bc20 0x7f4d4c143b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40274/0 (socket says 172.21.15.22:40274) 2020-07-16T20:30:50.018 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d526f7700 1 -- 172.21.15.22:0/1587470929 learned_addr learned my addr 172.21.15.22:0/1587470929 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d51ef6700 1 -- 172.21.15.22:0/1587470929 >> v1:172.21.15.116:6789/0 conn(0x7f4d4c0b8a50 legacy=0x7f4d4c15b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d51ef6700 1 -- 172.21.15.22:0/1587470929 >> v1:172.21.15.22:6789/0 conn(0x7f4d4c14bc20 legacy=0x7f4d4c143b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d51ef6700 1 -- 172.21.15.22:0/1587470929 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c15ae80 con 0x7f4d4c0b8670 2020-07-16T20:30:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594593106 0 0) 0x7f4d4c15a9b0 con 0x7f4d4c14bc20 2020-07-16T20:30:50.019 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d51ef6700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d4c0b8670 0x7f4d4c157ea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4d40000fa0 tx=0x7f4d40001a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d40007170 con 0x7f4d4c0b8670 2020-07-16T20:30:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d400072d0 con 0x7f4d4c0b8670 2020-07-16T20:30:50.020 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.997+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c13c8c0 con 0x7f4d4c0b8670 2020-07-16T20:30:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.998+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4000a960 con 0x7f4d4c0b8670 2020-07-16T20:30:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.998+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c13cdb0 con 0x7f4d4c0b8670 2020-07-16T20:30:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.998+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d4c13d090 con 0x7f4d4c0b8670 2020-07-16T20:30:50.021 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f4d40010070 con 0x7f4d4c0b8670 2020-07-16T20:30:50.022 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d2404fe10 0x7f4d240522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.023 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4d40067a40 con 0x7f4d4c0b8670 2020-07-16T20:30:50.023 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f4d24057900 0x7f4d24059d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.023 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 --> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d2405a370 con 0x7f4d24057900 2020-07-16T20:30:50.023 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d4006c220 con 0x7f4d4c0b8670 2020-07-16T20:30:50.024 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d516f5700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d2404fe10 0x7f4d240522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.024 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d526f7700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f4d24057900 0x7f4d24059d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.024 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:49.999+0000 7f4d516f5700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d2404fe10 0x7f4d240522d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4d4c15ad70 tx=0x7f4d48007650).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.024 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.000+0000 7f4d526f7700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f4d24057900 0x7f4d24059d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.024 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.000+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== osd.5 v2:172.21.15.116:6810/24114 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f4d2405a370 con 0x7f4d24057900 2020-07-16T20:30:50.026 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.017+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 --> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d4c13d650 con 0x7f4d24057900 2020-07-16T20:30:50.026 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d3dffb700 1 -- 172.21.15.22:0/1587470929 <== osd.5 v2:172.21.15.116:6810/24114 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d4c13d650 con 0x7f4d24057900 2020-07-16T20:30:50.026 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f4d24057900 msgr2=0x7f4d24059d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.027 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6810/24114,v1:172.21.15.116:6811/24114] conn(0x7f4d24057900 0x7f4d24059d20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.027 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d2404fe10 msgr2=0x7f4d240522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.027 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d2404fe10 0x7f4d240522d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f4d4c15ad70 tx=0x7f4d48007650).stop 2020-07-16T20:30:50.027 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d4c0b8670 msgr2=0x7f4d4c157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.028 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d4c0b8670 0x7f4d4c157ea0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4d40000fa0 tx=0x7f4d40001a60).stop 2020-07-16T20:30:50.028 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d526f7700 1 -- 172.21.15.22:0/1587470929 reap_dead start 2020-07-16T20:30:50.028 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 shutdown_connections 2020-07-16T20:30:50.028 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 --2- 172.21.15.22:0/1587470929 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d4c0b8670 0x7f4d4c157ea0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.028 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 >> 172.21.15.22:0/1587470929 conn(0x7f4d4c0b9660 msgr2=0x7f4d4c0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.029 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 shutdown_connections 2020-07-16T20:30:50.029 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.018+0000 7f4d5415a700 1 -- 172.21.15.22:0/1587470929 wait complete. 2020-07-16T20:30:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:50.029 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:50.029 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:50.030 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2020-07-16T20:30:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.145+0000 7f8cd2856700 1 Processor -- start 2020-07-16T20:30:50.147 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.145+0000 7f8cd2856700 1 -- start start 2020-07-16T20:30:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8cd2856700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8ccc09d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8cd2856700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0b5610 con 0x7f8ccc063130 2020-07-16T20:30:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8cd2856700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0b58b0 con 0x7f8ccc143260 2020-07-16T20:30:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8cd2856700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b5400 con 0x7f8ccc063510 2020-07-16T20:30:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccbfff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8ccc063130 0x7f8ccc142b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40282/0 (socket says 172.21.15.22:40282) 2020-07-16T20:30:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccbfff700 1 -- 172.21.15.22:0/2240547140 learned_addr learned my addr 172.21.15.22:0/2240547140 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8ccc09d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594587402 0 0) 0x7f8ccc0b5610 con 0x7f8ccc063130 2020-07-16T20:30:50.153 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cac003240 con 0x7f8ccc063130 2020-07-16T20:30:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2764125570 0 0) 0x7f8cac003240 con 0x7f8ccc063130 2020-07-16T20:30:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 msgr2=0x7f8ccc09d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.161 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8ccc09d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 >> v1:172.21.15.116:6789/0 conn(0x7f8ccc143260 legacy=0x7f8ccc09deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0b5d50 con 0x7f8ccc063130 2020-07-16T20:30:50.162 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f8cbc0016d0 con 0x7f8ccc063130 2020-07-16T20:30:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 >> v1:172.21.15.22:6789/0 conn(0x7f8ccc063130 legacy=0x7f8ccc142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cac003760 0x7f8cac003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cac0040a0 0x7f8cac004580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8cac004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.163 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b5400 con 0x7f8cac0040a0 2020-07-16T20:30:50.164 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac005150 con 0x7f8cac003760 2020-07-16T20:30:50.164 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.146+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac005310 con 0x7f8ccc063510 2020-07-16T20:30:50.164 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cac0040a0 0x7f8cac004580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.164 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8ccbfff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cac003760 0x7f8cac003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.164 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd0df3700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8cac004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.165 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 -- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 msgr2=0x7f8cac004be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.165 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8ccc063510 0x7f8cac004be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.165 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 -- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cac003760 msgr2=0x7f8cac003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.165 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8cac003760 0x7f8cac003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.166 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 -- 172.21.15.22:0/2240547140 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac003240 con 0x7f8cac0040a0 2020-07-16T20:30:50.166 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cac0040a0 0x7f8cac004580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8cb400c000 tx=0x7f8cb4006dd0).ready entity=mon.0 client_cookie=394026ea6075fd4f server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.166 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb400ea90 con 0x7f8cac0040a0 2020-07-16T20:30:50.166 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb400ebf0 con 0x7f8cac0040a0 2020-07-16T20:30:50.166 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8ccb7fe700 1 -- 172.21.15.22:0/2240547140 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb400b2d0 con 0x7f8cac0040a0 2020-07-16T20:30:50.167 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 -- 172.21.15.22:0/2240547140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cac0040a0 msgr2=0x7f8cac004580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.167 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 --2- 172.21.15.22:0/2240547140 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8cac0040a0 0x7f8cac004580 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8cb400c000 tx=0x7f8cb4006dd0).stop 2020-07-16T20:30:50.167 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd0df3700 1 -- 172.21.15.22:0/2240547140 reap_dead start 2020-07-16T20:30:50.167 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 -- 172.21.15.22:0/2240547140 shutdown_connections 2020-07-16T20:30:50.168 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 -- 172.21.15.22:0/2240547140 >> 172.21.15.22:0/2240547140 conn(0x7f8ccc0b9530 msgr2=0x7f8ccc0b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.168 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 -- 172.21.15.22:0/2240547140 shutdown_connections 2020-07-16T20:30:50.168 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.147+0000 7f8cd2856700 1 -- 172.21.15.22:0/2240547140 wait complete. 2020-07-16T20:30:50.168 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.149+0000 7f8cd2856700 1 Processor -- start 2020-07-16T20:30:50.168 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.149+0000 7f8cd2856700 1 -- start start 2020-07-16T20:30:50.169 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.149+0000 7f8cd2856700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ccc067000 0x7f8ccc146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.169 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.149+0000 7f8cd2856700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8ccc0673e0 0x7f8ccc144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.169 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cd2856700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc0668b0 con 0x7f8ccc146170 2020-07-16T20:30:50.169 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cd2856700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0666a0 con 0x7f8ccc067000 2020-07-16T20:30:50.169 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cd2856700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0645d0 con 0x7f8ccc0673e0 2020-07-16T20:30:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ccc067000 0x7f8ccc146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8ccc067000 0x7f8ccc146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39586/0 (socket says 172.21.15.22:39586) 2020-07-16T20:30:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 -- 172.21.15.22:0/743124384 learned_addr learned my addr 172.21.15.22:0/743124384 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:50.170 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/743124384 >> v2:172.21.15.116:3300/0 conn(0x7f8ccc0673e0 0x7f8ccc144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.171 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 -- 172.21.15.22:0/743124384 >> v2:172.21.15.116:3300/0 conn(0x7f8ccc0673e0 msgr2=0x7f8ccc144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.171 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 --2- 172.21.15.22:0/743124384 >> v2:172.21.15.116:3300/0 conn(0x7f8ccc0673e0 0x7f8ccc144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.171 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 -- 172.21.15.22:0/743124384 >> v1:172.21.15.116:6789/0 conn(0x7f8ccc146170 legacy=0x7f8ccc145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.171 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 -- 172.21.15.22:0/743124384 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc066330 con 0x7f8ccc067000 2020-07-16T20:30:50.172 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8ccbfff700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc067000 0x7f8ccc146d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8ccc0644e0 tx=0x7f8ccc0b57a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.172 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cbc00fa50 con 0x7f8ccc067000 2020-07-16T20:30:50.172 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc00fbb0 con 0x7f8ccc067000 2020-07-16T20:30:50.172 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ccc145c50 con 0x7f8ccc067000 2020-07-16T20:30:50.173 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cbc012350 con 0x7f8ccc067000 2020-07-16T20:30:50.173 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.150+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc064aa0 con 0x7f8ccc067000 2020-07-16T20:30:50.174 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.151+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f8cbc01b030 con 0x7f8ccc067000 2020-07-16T20:30:50.174 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.151+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc064800 con 0x7f8ccc067000 2020-07-16T20:30:50.174 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.152+0000 7f8cc8ff9700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 0x7f8ca8052500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.175 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.152+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f8cbc067630 con 0x7f8ccc067000 2020-07-16T20:30:50.175 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.152+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 0x7f8ca8052500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.175 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.152+0000 7f8cc3fff700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 0x7f8ca8052500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8cb400c000 tx=0x7f8cb4019000).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.175 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.155+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f8ccc064800 con 0x7f8ccc067000 2020-07-16T20:30:50.311 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.309+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ccc064800 con 0x7f8ca8050040 2020-07-16T20:30:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.310+0000 7f8cc8ff9700 1 -- 172.21.15.22:0/743124384 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8ccc064800 con 0x7f8ca8050040 2020-07-16T20:30:50.314 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 msgr2=0x7f8ca8052500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.315 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 0x7f8ca8052500 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8cb400c000 tx=0x7f8cb4019000).stop 2020-07-16T20:30:50.315 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc067000 msgr2=0x7f8ccc146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.315 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc067000 0x7f8ccc146d30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8ccc0644e0 tx=0x7f8ccc0b57a0).stop 2020-07-16T20:30:50.316 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 shutdown_connections 2020-07-16T20:30:50.316 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f8ca8050040 0x7f8ca8052500 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.316 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 --2- 172.21.15.22:0/743124384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc067000 0x7f8ccc146d30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.317 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 --2- 172.21.15.22:0/743124384 >> v2:172.21.15.116:3300/0 conn(0x7f8ccc0673e0 0x7f8ccc144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.317 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 >> 172.21.15.22:0/743124384 conn(0x7f8ccc0b9530 msgr2=0x7f8ccc05f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.311+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 shutdown_connections 2020-07-16T20:30:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.312+0000 7f8cd2856700 1 -- 172.21.15.22:0/743124384 wait complete. 2020-07-16T20:30:50.318 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 5 to deep-scrub 2020-07-16T20:30:50.323 INFO:tasks.ceph:Scrubbing osd.6 2020-07-16T20:30:50.324 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:50.451 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.450+0000 7f466295d700 1 Processor -- start 2020-07-16T20:30:50.452 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.450+0000 7f466295d700 1 -- start start 2020-07-16T20:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c0b8670 0x7f465c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.456 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f465c09d720 0x7f465c09dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0b8ff0 con 0x7f465c0b4280 2020-07-16T20:30:50.457 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0b3de0 con 0x7f465c0b8670 2020-07-16T20:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c09f700 con 0x7f465c09d720 2020-07-16T20:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c0b8670 0x7f465c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c0b8670 0x7f465c0b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39594/0 (socket says 172.21.15.22:39594) 2020-07-16T20:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 -- 172.21.15.22:0/2443208293 learned_addr learned my addr 172.21.15.22:0/2443208293 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:50.458 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465b7fe700 1 --2- 172.21.15.22:0/2443208293 >> v2:172.21.15.116:3300/0 conn(0x7f465c09d720 0x7f465c09dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 -- 172.21.15.22:0/2443208293 >> v2:172.21.15.116:3300/0 conn(0x7f465c09d720 msgr2=0x7f465c09dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 --2- 172.21.15.22:0/2443208293 >> v2:172.21.15.116:3300/0 conn(0x7f465c09d720 0x7f465c09dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 -- 172.21.15.22:0/2443208293 >> v1:172.21.15.116:6789/0 conn(0x7f465c0b4280 legacy=0x7f465c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.459 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 -- 172.21.15.22:0/2443208293 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0b56f0 con 0x7f465c0b8670 2020-07-16T20:30:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465bfff700 1 --2- 172.21.15.22:0/2443208293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c0b8670 0x7f465c0b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f464c002f30 tx=0x7f464c006e90).ready entity=mon.0 client_cookie=f4b82fe3fdc35110 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465affd700 1 -- 172.21.15.22:0/2443208293 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c009850 con 0x7f465c0b8670 2020-07-16T20:30:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465affd700 1 -- 172.21.15.22:0/2443208293 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c0099b0 con 0x7f465c0b8670 2020-07-16T20:30:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f465affd700 1 -- 172.21.15.22:0/2443208293 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c009d10 con 0x7f465c0b8670 2020-07-16T20:30:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- 172.21.15.22:0/2443208293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c0b8670 msgr2=0x7f465c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 --2- 172.21.15.22:0/2443208293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c0b8670 0x7f465c0b8a50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f464c002f30 tx=0x7f464c006e90).stop 2020-07-16T20:30:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- 172.21.15.22:0/2443208293 shutdown_connections 2020-07-16T20:30:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 --2- 172.21.15.22:0/2443208293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c0b8670 0x7f465c0b8a50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 --2- 172.21.15.22:0/2443208293 >> v2:172.21.15.116:3300/0 conn(0x7f465c09d720 0x7f465c09dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.451+0000 7f466295d700 1 -- 172.21.15.22:0/2443208293 >> 172.21.15.22:0/2443208293 conn(0x7f465c0b9660 msgr2=0x7f465c0b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.452+0000 7f466295d700 1 -- 172.21.15.22:0/2443208293 shutdown_connections 2020-07-16T20:30:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.452+0000 7f466295d700 1 -- 172.21.15.22:0/2443208293 wait complete. 2020-07-16T20:30:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.453+0000 7f466295d700 1 Processor -- start 2020-07-16T20:30:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.453+0000 7f466295d700 1 -- start start 2020-07-16T20:30:50.464 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c09d720 0x7f465c153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.464 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f465c0b4280 0x7f465c0af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.464 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f465c143960 0x7f465c143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.464 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0633b0 con 0x7f465c09d720 2020-07-16T20:30:50.465 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c153fa0 con 0x7f465c143960 2020-07-16T20:30:50.465 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c067240 con 0x7f465c0b4280 2020-07-16T20:30:50.465 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c09d720 0x7f465c153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f465c09d720 0x7f465c153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39600/0 (socket says 172.21.15.22:39600) 2020-07-16T20:30:50.479 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 -- 172.21.15.22:0/3634837569 learned_addr learned my addr 172.21.15.22:0/3634837569 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:50.480 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465b7fe700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f465c0b4280 0x7f465c0af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.480 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f4660efa700 1 --2- 172.21.15.22:0/3634837569 >> v2:172.21.15.116:3300/0 conn(0x7f465c143960 0x7f465c143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.480 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 -- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f465c0b4280 msgr2=0x7f465c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f465c0b4280 0x7f465c0af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 -- 172.21.15.22:0/3634837569 >> v2:172.21.15.116:3300/0 conn(0x7f465c143960 msgr2=0x7f465c143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 --2- 172.21.15.22:0/3634837569 >> v2:172.21.15.116:3300/0 conn(0x7f465c143960 0x7f465c143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.481 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 -- 172.21.15.22:0/3634837569 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c0674e0 con 0x7f465c09d720 2020-07-16T20:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f465bfff700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c09d720 0x7f465c153ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f465c145090 tx=0x7f464c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c011e00 con 0x7f465c09d720 2020-07-16T20:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c01d5d0 con 0x7f465c09d720 2020-07-16T20:30:50.482 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0afc50 con 0x7f465c09d720 2020-07-16T20:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464c01d930 con 0x7f465c09d720 2020-07-16T20:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.454+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c1442c0 con 0x7f465c09d720 2020-07-16T20:30:50.483 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.455+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f465c0b7ba0 con 0x7f465c09d720 2020-07-16T20:30:50.486 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f464c025030 con 0x7f465c09d720 2020-07-16T20:30:50.486 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4634050000 0x7f46340524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.487 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f464c069ae0 con 0x7f465c09d720 2020-07-16T20:30:50.487 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7f4634057c70 0x7f463405a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.487 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 --> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f463405a6e0 con 0x7f4634057c70 2020-07-16T20:30:50.487 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f464c069ea0 con 0x7f465c09d720 2020-07-16T20:30:50.488 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.456+0000 7f465b7fe700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4634050000 0x7f46340524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.488 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.457+0000 7f4660efa700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7f4634057c70 0x7f463405a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.488 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.457+0000 7f465b7fe700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4634050000 0x7f46340524c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f465000b000 tx=0x7f4650006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.488 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.457+0000 7f4660efa700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7f4634057c70 0x7f463405a090 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.488 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.458+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== osd.6 v2:172.21.15.116:6818/24143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f463405a6e0 con 0x7f4634057c70 2020-07-16T20:30:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.475+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 --> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f465c1447f0 con 0x7f4634057c70 2020-07-16T20:30:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.475+0000 7f463bfff700 1 -- 172.21.15.22:0/3634837569 <== osd.6 v2:172.21.15.116:6818/24143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4654002710 con 0x7f4634057c70 2020-07-16T20:30:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7f4634057c70 msgr2=0x7f463405a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.489 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6818/24143,v1:172.21.15.116:6819/24143] conn(0x7f4634057c70 0x7f463405a090 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4634050000 msgr2=0x7f46340524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4634050000 0x7f46340524c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f465000b000 tx=0x7f4650006dd0).stop 2020-07-16T20:30:50.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c09d720 msgr2=0x7f465c153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.494 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c09d720 0x7f465c153ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f465c145090 tx=0x7f464c015000).stop 2020-07-16T20:30:50.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f4660efa700 1 -- 172.21.15.22:0/3634837569 reap_dead start 2020-07-16T20:30:50.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 shutdown_connections 2020-07-16T20:30:50.495 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 --2- 172.21.15.22:0/3634837569 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f465c09d720 0x7f465c153ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 >> 172.21.15.22:0/3634837569 conn(0x7f465c0b9660 msgr2=0x7f465c0b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 shutdown_connections 2020-07-16T20:30:50.496 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.476+0000 7f466295d700 1 -- 172.21.15.22:0/3634837569 wait complete. 2020-07-16T20:30:50.496 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:50.497 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:50.497 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:50.499 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2020-07-16T20:30:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.614+0000 7fcebe025700 1 Processor -- start 2020-07-16T20:30:50.616 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.614+0000 7fcebe025700 1 -- start start 2020-07-16T20:30:50.621 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fcebe025700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fceb809cce0 0x7fceb8146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fcebe025700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb8144e80 con 0x7fceb8062ed0 2020-07-16T20:30:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fcebe025700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb8144be0 con 0x7fceb8146e10 2020-07-16T20:30:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fcebe025700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb81472c0 con 0x7fceb809cce0 2020-07-16T20:30:50.622 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fceb7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fceb8062ed0 0x7fceb809e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40322/0 (socket says 172.21.15.22:40322) 2020-07-16T20:30:50.623 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fceb7fff700 1 -- 172.21.15.22:0/1413593307 learned_addr learned my addr 172.21.15.22:0/1413593307 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.623 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fceb77fe700 1 --2- 172.21.15.22:0/1413593307 >> v2:172.21.15.116:3300/0 conn(0x7fceb809cce0 0x7fceb8146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.623 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.615+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662277642 0 0) 0x7fceb8144e80 con 0x7fceb8062ed0 2020-07-16T20:30:50.623 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea4003240 con 0x7fceb8062ed0 2020-07-16T20:30:50.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3444126895 0 0) 0x7fcea4003240 con 0x7fceb8062ed0 2020-07-16T20:30:50.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 >> v2:172.21.15.116:3300/0 conn(0x7fceb809cce0 msgr2=0x7fceb8146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 --2- 172.21.15.22:0/1413593307 >> v2:172.21.15.116:3300/0 conn(0x7fceb809cce0 0x7fceb8146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 >> v1:172.21.15.116:6789/0 conn(0x7fceb8146e10 legacy=0x7fceb80627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.624 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb809e430 con 0x7fceb8062ed0 2020-07-16T20:30:50.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7fceb0001a50 con 0x7fceb8062ed0 2020-07-16T20:30:50.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 >> v1:172.21.15.22:6789/0 conn(0x7fceb8062ed0 legacy=0x7fceb809e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcea4003730 0x7fcea4003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.625 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcea40044e0 0x7fcea4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.627 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 0x7fcea400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.628 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb81472c0 con 0x7fcea4004e50 2020-07-16T20:30:50.629 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4004350 con 0x7fcea40044e0 2020-07-16T20:30:50.629 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea400bc50 con 0x7fcea4003730 2020-07-16T20:30:50.629 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 0x7fcea400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.630 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb6ffd700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcea40044e0 0x7fcea4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.630 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb77fe700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcea4003730 0x7fcea4003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.630 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 -- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcea4003730 msgr2=0x7fcea4003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.630 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcea4003730 0x7fcea4003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.631 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 -- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcea40044e0 msgr2=0x7fcea4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.631 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcea40044e0 0x7fcea4004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.631 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 -- 172.21.15.22:0/1413593307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4003240 con 0x7fcea4004e50 2020-07-16T20:30:50.631 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 -- 172.21.15.22:0/1413593307 reap_dead start 2020-07-16T20:30:50.631 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb7fff700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 0x7fcea400b730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fceb0001760 tx=0x7fceb8143ec0).ready entity=mon.0 client_cookie=5cb0546b062c8d9a server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.632 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb0005b80 con 0x7fcea4004e50 2020-07-16T20:30:50.632 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0005ce0 con 0x7fcea4004e50 2020-07-16T20:30:50.632 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.616+0000 7fceb67fc700 1 -- 172.21.15.22:0/1413593307 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb00072c0 con 0x7fcea4004e50 2020-07-16T20:30:50.632 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 -- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 msgr2=0x7fcea400b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.633 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 0x7fcea400b730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fceb0001760 tx=0x7fceb8143ec0).stop 2020-07-16T20:30:50.633 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 -- 172.21.15.22:0/1413593307 shutdown_connections 2020-07-16T20:30:50.633 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 --2- 172.21.15.22:0/1413593307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcea4004e50 0x7fcea400b730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.633 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 -- 172.21.15.22:0/1413593307 >> 172.21.15.22:0/1413593307 conn(0x7fceb80b9530 msgr2=0x7fceb80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.633 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 -- 172.21.15.22:0/1413593307 shutdown_connections 2020-07-16T20:30:50.634 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.617+0000 7fcebe025700 1 -- 172.21.15.22:0/1413593307 wait complete. 2020-07-16T20:30:50.634 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.618+0000 7fcebe025700 1 Processor -- start 2020-07-16T20:30:50.634 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.618+0000 7fcebe025700 1 -- start start 2020-07-16T20:30:50.634 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fcebe025700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fceb8140780 0x7fceb80b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.635 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fcebe025700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb8065d00 con 0x7fceb8140b60 2020-07-16T20:30:50.635 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fcebe025700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb8065fa0 con 0x7fceb80666e0 2020-07-16T20:30:50.635 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fcebe025700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb8066b40 con 0x7fceb8140780 2020-07-16T20:30:50.635 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fceb8140780 0x7fceb80b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.635 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb6ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fceb8140b60 0x7fceb81307e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40332/0 (socket says 172.21.15.22:40332) 2020-07-16T20:30:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb6ffd700 1 -- 172.21.15.22:0/3298494277 learned_addr learned my addr 172.21.15.22:0/3298494277 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb77fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fceb8140780 0x7fceb80b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39622/0 (socket says 172.21.15.22:39622) 2020-07-16T20:30:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb77fe700 1 -- 172.21.15.22:0/3298494277 >> v1:172.21.15.116:6789/0 conn(0x7fceb80666e0 legacy=0x7fceb80ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb77fe700 1 -- 172.21.15.22:0/3298494277 >> v1:172.21.15.22:6789/0 conn(0x7fceb8140b60 legacy=0x7fceb81307e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.636 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fceb77fe700 1 -- 172.21.15.22:0/3298494277 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8066240 con 0x7fceb8140780 2020-07-16T20:30:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.619+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486468410 0 0) 0x7fceb8065d00 con 0x7fceb8140b60 2020-07-16T20:30:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fceb77fe700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fceb8140780 0x7fceb80b1db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fceb8141300 tx=0x7fcea8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcea8014680 con 0x7fceb8140780 2020-07-16T20:30:50.637 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea80147e0 con 0x7fceb8140780 2020-07-16T20:30:50.638 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb80659f0 con 0x7fceb8140780 2020-07-16T20:30:50.638 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcea8014b40 con 0x7fceb8140780 2020-07-16T20:30:50.639 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.620+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb81310b0 con 0x7fceb8140780 2020-07-16T20:30:50.640 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7fcea8014d70 con 0x7fceb8140780 2020-07-16T20:30:50.640 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb80663d0 con 0x7fceb8140780 2020-07-16T20:30:50.640 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fce977fe700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 0x7fce90052370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcea8068070 con 0x7fceb8140780 2020-07-16T20:30:50.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fceb6ffd700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 0x7fce90052370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.621+0000 7fceb6ffd700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 0x7fce90052370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fceac008000 tx=0x7fceac007b70).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.641 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.625+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7fcea8040800 con 0x7fceb8140780 2020-07-16T20:30:50.782 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.780+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fceb805f320 con 0x7fce9004feb0 2020-07-16T20:30:50.783 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.781+0000 7fce977fe700 1 -- 172.21.15.22:0/3298494277 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fceb805f320 con 0x7fce9004feb0 2020-07-16T20:30:50.784 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 msgr2=0x7fce90052370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.784 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 0x7fce90052370 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fceac008000 tx=0x7fceac007b70).stop 2020-07-16T20:30:50.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fceb8140780 msgr2=0x7fceb80b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fceb8140780 0x7fceb80b1db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fceb8141300 tx=0x7fcea8008040).stop 2020-07-16T20:30:50.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 shutdown_connections 2020-07-16T20:30:50.785 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7fce9004feb0 0x7fce90052370 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 --2- 172.21.15.22:0/3298494277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fceb8140780 0x7fceb80b1db0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 >> 172.21.15.22:0/3298494277 conn(0x7fceb80b9530 msgr2=0x7fceb813da50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 shutdown_connections 2020-07-16T20:30:50.786 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.783+0000 7fcebe025700 1 -- 172.21.15.22:0/3298494277 wait complete. 2020-07-16T20:30:50.787 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 6 to deep-scrub 2020-07-16T20:30:50.794 INFO:tasks.ceph:Scrubbing osd.7 2020-07-16T20:30:50.795 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-07-16T20:30:50.913 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.912+0000 7f6e07663700 1 Processor -- start 2020-07-16T20:30:50.914 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.912+0000 7f6e07663700 1 -- start start 2020-07-16T20:30:50.921 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.912+0000 7f6e07663700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e0014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.922 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6e0014b2b0 0x7f6e00066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.922 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0014b810 con 0x7f6e00148030 2020-07-16T20:30:50.922 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e00141870 con 0x7f6e0014b2b0 2020-07-16T20:30:50.922 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00147510 con 0x7f6e00147c50 2020-07-16T20:30:50.923 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6e0014b2b0 0x7f6e00066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.923 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6e0014b2b0 0x7f6e00066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39634/0 (socket says 172.21.15.22:39634) 2020-07-16T20:30:50.923 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 -- 172.21.15.22:0/854347068 learned_addr learned my addr 172.21.15.22:0/854347068 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:50.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e053ff700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e0014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 -- 172.21.15.22:0/854347068 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 msgr2=0x7f6e0014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:50.927 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e0014adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.928 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 -- 172.21.15.22:0/854347068 >> v1:172.21.15.116:6789/0 conn(0x7f6e00148030 legacy=0x7f6e000ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 -- 172.21.15.22:0/854347068 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e001477b0 con 0x7f6e0014b2b0 2020-07-16T20:30:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e05c00700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e0014b2b0 0x7f6e00066b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6df80032b0 tx=0x7f6df8009270).ready entity=mon.0 client_cookie=840dd9174219d8a5 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.929 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6deffff700 1 -- 172.21.15.22:0/854347068 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df8009e60 con 0x7f6e0014b2b0 2020-07-16T20:30:50.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6deffff700 1 -- 172.21.15.22:0/854347068 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df800bc00 con 0x7f6e0014b2b0 2020-07-16T20:30:50.930 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6deffff700 1 -- 172.21.15.22:0/854347068 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df800bd70 con 0x7f6e0014b2b0 2020-07-16T20:30:50.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- 172.21.15.22:0/854347068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e0014b2b0 msgr2=0x7f6e00066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e0014b2b0 0x7f6e00066b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6df80032b0 tx=0x7f6df8009270).stop 2020-07-16T20:30:50.931 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- 172.21.15.22:0/854347068 shutdown_connections 2020-07-16T20:30:50.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e0014b2b0 0x7f6e00066b50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 --2- 172.21.15.22:0/854347068 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e0014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.913+0000 7f6e07663700 1 -- 172.21.15.22:0/854347068 >> 172.21.15.22:0/854347068 conn(0x7f6e00060070 msgr2=0x7f6e0005b890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.932 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.914+0000 7f6e07663700 1 -- 172.21.15.22:0/854347068 shutdown_connections 2020-07-16T20:30:50.933 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.914+0000 7f6e07663700 1 -- 172.21.15.22:0/854347068 wait complete. 2020-07-16T20:30:50.933 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.915+0000 7f6e07663700 1 Processor -- start 2020-07-16T20:30:50.933 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.915+0000 7f6e07663700 1 -- start start 2020-07-16T20:30:50.934 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e07663700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e000a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.934 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e07663700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6e00148030 0x7f6e00157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.934 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e07663700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0009f5c0 con 0x7f6e000a2ba0 2020-07-16T20:30:50.935 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e07663700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0009f3b0 con 0x7f6e00148030 2020-07-16T20:30:50.935 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e07663700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0009eb70 con 0x7f6e00147c50 2020-07-16T20:30:50.935 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6e00148030 0x7f6e00157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e05c00700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6e000a2ba0 0x7f6e00157b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40346/0 (socket says 172.21.15.22:40346) 2020-07-16T20:30:50.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e053ff700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e000a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.936 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e05c00700 1 -- 172.21.15.22:0/3923273619 learned_addr learned my addr 172.21.15.22:0/3923273619 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:50.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 -- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 msgr2=0x7f6e000a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.937 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e00147c50 0x7f6e000a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 -- 172.21.15.22:0/3923273619 >> v1:172.21.15.22:6789/0 conn(0x7f6e000a2ba0 legacy=0x7f6e00157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.939 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 -- 172.21.15.22:0/3923273619 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0009f860 con 0x7f6e00148030 2020-07-16T20:30:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828131331 0 0) 0x7f6e0009f5c0 con 0x7f6e000a2ba0 2020-07-16T20:30:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.916+0000 7f6e04bfe700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e00148030 0x7f6e00157670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6e00147b30 tx=0x7f6df0007b70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.940 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.917+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df000e4a0 con 0x7f6e00148030 2020-07-16T20:30:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.917+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000e600 con 0x7f6e00148030 2020-07-16T20:30:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.917+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0009fd00 con 0x7f6e00148030 2020-07-16T20:30:50.941 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.917+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df000e960 con 0x7f6e00148030 2020-07-16T20:30:50.942 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.917+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0009f0d0 con 0x7f6e00148030 2020-07-16T20:30:50.942 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e0005f320 con 0x7f6e00148030 2020-07-16T20:30:50.943 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f6df0019020 con 0x7f6e00148030 2020-07-16T20:30:50.943 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6dd804fe60 0x7f6dd8052320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f6df0067650 con 0x7f6e00148030 2020-07-16T20:30:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f6dd80579d0 0x7f6dd8059df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 --> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6dd805a440 con 0x7f6dd80579d0 2020-07-16T20:30:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6df0069cc0 con 0x7f6e00148030 2020-07-16T20:30:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.918+0000 7f6e053ff700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6dd804fe60 0x7f6dd8052320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.919+0000 7f6e05c00700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f6dd80579d0 0x7f6dd8059df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.919+0000 7f6e053ff700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6dd804fe60 0x7f6dd8052320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6dfc00b000 tx=0x7f6dfc006dd0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.919+0000 7f6e05c00700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f6dd80579d0 0x7f6dd8059df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.920+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== osd.7 v2:172.21.15.116:6826/24152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23416 (crc 0 0 0) 0x7f6dd805a440 con 0x7f6dd80579d0 2020-07-16T20:30:50.950 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.936+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 --> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6e000b48e0 con 0x7f6dd80579d0 2020-07-16T20:30:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6ded7fa700 1 -- 172.21.15.22:0/3923273619 <== osd.7 v2:172.21.15.116:6826/24152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6e000b48e0 con 0x7f6dd80579d0 2020-07-16T20:30:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f6dd80579d0 msgr2=0x7f6dd8059df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6826/24152,v1:172.21.15.116:6827/24152] conn(0x7f6dd80579d0 0x7f6dd8059df0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.951 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6dd804fe60 msgr2=0x7f6dd8052320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f6dd804fe60 0x7f6dd8052320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f6dfc00b000 tx=0x7f6dfc006dd0).stop 2020-07-16T20:30:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e00148030 msgr2=0x7f6e00157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e00148030 0x7f6e00157670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f6e00147b30 tx=0x7f6df0007b70).stop 2020-07-16T20:30:50.952 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e05c00700 1 -- 172.21.15.22:0/3923273619 reap_dead start 2020-07-16T20:30:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 shutdown_connections 2020-07-16T20:30:50.953 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 --2- 172.21.15.22:0/3923273619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6e00148030 0x7f6e00157670 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:50.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 >> 172.21.15.22:0/3923273619 conn(0x7f6e00060070 msgr2=0x7f6e000b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:50.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 shutdown_connections 2020-07-16T20:30:50.954 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:50.937+0000 7f6e07663700 1 -- 172.21.15.22:0/3923273619 wait complete. 2020-07-16T20:30:50.955 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2020-07-16T20:30:50.955 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-07-16T20:30:50.956 INFO:teuthology.orchestra.run.smithi022.stdout:} 2020-07-16T20:30:50.956 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2020-07-16T20:30:51.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.071+0000 7f283bd95700 1 Processor -- start 2020-07-16T20:30:51.073 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.071+0000 7f283bd95700 1 -- start start 2020-07-16T20:30:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f283bd95700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f283409cce0 0x7f2834146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.089 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f283bd95700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f283bd95700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2834147290 con 0x7f2834062cb0 2020-07-16T20:30:51.090 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f283bd95700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2834144e80 con 0x7f283409cce0 2020-07-16T20:30:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f283bd95700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2834144be0 con 0x7f2834146e10 2020-07-16T20:30:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f2839b31700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f283409cce0 0x7f2834146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.091 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f2839b31700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f283409cce0 0x7f2834146920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39646/0 (socket says 172.21.15.22:39646) 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f2839b31700 1 -- 172.21.15.22:0/37312456 learned_addr learned my addr 172.21.15.22:0/37312456 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.072+0000 7f2839330700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.092 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2839b31700 1 -- 172.21.15.22:0/37312456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 msgr2=0x7f28340627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2839b31700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.093 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2839b31700 1 -- 172.21.15.22:0/37312456 >> v1:172.21.15.116:6789/0 conn(0x7f2834062cb0 legacy=0x7f283409e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2839b31700 1 -- 172.21.15.22:0/37312456 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283409e430 con 0x7f283409cce0 2020-07-16T20:30:51.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2839b31700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f283409cce0 0x7f2834146920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f2834063650 tx=0x7f2824006e90).ready entity=mon.0 client_cookie=c2d1fe8cc5f8d270 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.094 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2838b2f700 1 -- 172.21.15.22:0/37312456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28240098e0 con 0x7f283409cce0 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2838b2f700 1 -- 172.21.15.22:0/37312456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2824009a40 con 0x7f283409cce0 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f2838b2f700 1 -- 172.21.15.22:0/37312456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2824009de0 con 0x7f283409cce0 2020-07-16T20:30:51.095 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 -- 172.21.15.22:0/37312456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f283409cce0 msgr2=0x7f2834146920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f283409cce0 0x7f2834146920 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f2834063650 tx=0x7f2824006e90).stop 2020-07-16T20:30:51.096 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 -- 172.21.15.22:0/37312456 shutdown_connections 2020-07-16T20:30:51.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f283409cce0 0x7f2834146920 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 --2- 172.21.15.22:0/37312456 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340627c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.097 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 -- 172.21.15.22:0/37312456 >> 172.21.15.22:0/37312456 conn(0x7f28340b9530 msgr2=0x7f28340b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.098 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 -- 172.21.15.22:0/37312456 shutdown_connections 2020-07-16T20:30:51.098 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.073+0000 7f283bd95700 1 -- 172.21.15.22:0/37312456 wait complete. 2020-07-16T20:30:51.099 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.074+0000 7f283bd95700 1 Processor -- start 2020-07-16T20:30:51.099 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.074+0000 7f283bd95700 1 -- start start 2020-07-16T20:30:51.099 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283bd95700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2834062cb0 0x7f28340ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.100 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283bd95700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.100 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283bd95700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2834156c60 con 0x7f283414e410 2020-07-16T20:30:51.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283bd95700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2834156e90 con 0x7f2834062cb0 2020-07-16T20:30:51.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283bd95700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2834067720 con 0x7f2834146e10 2020-07-16T20:30:51.101 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283a332700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f283414e410 0x7f283413d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40362/0 (socket says 172.21.15.22:40362) 2020-07-16T20:30:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f283a332700 1 -- 172.21.15.22:0/1204652198 learned_addr learned my addr 172.21.15.22:0/1204652198 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f2839330700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281215507 0 0) 0x7f2834156c60 con 0x7f283414e410 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.075+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c003240 con 0x7f283414e410 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 --2- 172.21.15.22:0/1204652198 >> v2:172.21.15.116:3300/0 conn(0x7f2834062cb0 0x7f28340ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 861698523 0 0) 0x7f280c003240 con 0x7f283414e410 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 --> v1:172.21.15.22:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2834156c60 con 0x7f283414e410 2020-07-16T20:30:51.103 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1586096928 0 0) 0x7f282c001b10 con 0x7f283414e410 2020-07-16T20:30:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 msgr2=0x7f28340b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f28340b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 >> v2:172.21.15.116:3300/0 conn(0x7f2834062cb0 msgr2=0x7f28340ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> v2:172.21.15.116:3300/0 conn(0x7f2834062cb0 0x7f28340ae570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 >> v1:172.21.15.22:6789/0 conn(0x7f283414e410 legacy=0x7f283413d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c003800 0x7f280c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f280c0044e0 0x7f280c004920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f280c004e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834156e90 con 0x7f280c003800 2020-07-16T20:30:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2834067720 con 0x7f280c0044e0 2020-07-16T20:30:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c005300 con 0x7f2834146e10 2020-07-16T20:30:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c003800 0x7f280c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f283a332700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f280c004e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839330700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f280c0044e0 0x7f280c004920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 -- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 msgr2=0x7f280c004e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2834146e10 0x7f280c004e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 -- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f280c0044e0 msgr2=0x7f280c004920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.107 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f280c0044e0 0x7f280c004920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283414e990 con 0x7f280c003800 2020-07-16T20:30:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283413ded0 con 0x7f280c003800 2020-07-16T20:30:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.076+0000 7f2839b31700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c003800 0x7f280c003c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f282401c000 tx=0x7f2824015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.077+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28340b73a0 con 0x7f280c003800 2020-07-16T20:30:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.077+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f282401f650 con 0x7f280c003800 2020-07-16T20:30:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.077+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282401f7b0 con 0x7f280c003800 2020-07-16T20:30:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.077+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f282401fb10 con 0x7f280c003800 2020-07-16T20:30:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.077+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283405f320 con 0x7f280c003800 2020-07-16T20:30:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.078+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f282401a040 con 0x7f280c003800 2020-07-16T20:30:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.078+0000 7f2821ffb700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f280c058130 0x7f280c05a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.078+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f282406a110 con 0x7f280c003800 2020-07-16T20:30:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.078+0000 7f2839330700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f280c058130 0x7f280c05a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.078+0000 7f2839330700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f280c058130 0x7f280c05a5f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f283000d000 tx=0x7f2830006f90).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.111 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.081+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f28240462d0 con 0x7f280c003800 2020-07-16T20:30:51.238 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.237+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f2834043fd0 con 0x7f280c058130 2020-07-16T20:30:51.239 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.238+0000 7f2821ffb700 1 -- 172.21.15.22:0/1204652198 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2834043fd0 con 0x7f280c058130 2020-07-16T20:30:51.241 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f280c058130 msgr2=0x7f280c05a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.242 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f280c058130 0x7f280c05a5f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f283000d000 tx=0x7f2830006f90).stop 2020-07-16T20:30:51.242 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c003800 msgr2=0x7f280c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.242 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 --2- 172.21.15.22:0/1204652198 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f280c003800 0x7f280c003c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f282401c000 tx=0x7f2824015000).stop 2020-07-16T20:30:51.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283a332700 1 -- 172.21.15.22:0/1204652198 reap_dead start 2020-07-16T20:30:51.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 shutdown_connections 2020-07-16T20:30:51.243 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 >> 172.21.15.22:0/1204652198 conn(0x7f28340b9530 msgr2=0x7f283414ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.239+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 shutdown_connections 2020-07-16T20:30:51.244 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.240+0000 7f283bd95700 1 -- 172.21.15.22:0/1204652198 wait complete. 2020-07-16T20:30:51.245 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 7 to deep-scrub 2020-07-16T20:30:51.251 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:30:51.366 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.364+0000 7f4d90543700 1 Processor -- start 2020-07-16T20:30:51.367 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.364+0000 7f4d90543700 1 -- start start 2020-07-16T20:30:51.378 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d90543700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8809e050 0x7f4d88144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d90543700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d88144780 0x7f4d880b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.382 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d90543700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d88147ed0 con 0x7f4d8809dc70 2020-07-16T20:30:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d90543700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d88148170 con 0x7f4d88144780 2020-07-16T20:30:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d90543700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8809cb10 con 0x7f4d8809e050 2020-07-16T20:30:51.383 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d8eae0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d88144780 0x7f4d880b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d8eae0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d88144780 0x7f4d880b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39664/0 (socket says 172.21.15.22:39664) 2020-07-16T20:30:51.384 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d8eae0700 1 -- 172.21.15.22:0/3662076097 learned_addr learned my addr 172.21.15.22:0/3662076097 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:30:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.365+0000 7f4d8dade700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8809e050 0x7f4d88144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8eae0700 1 -- 172.21.15.22:0/3662076097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8809e050 msgr2=0x7f4d88144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.385 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8eae0700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8809e050 0x7f4d88144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8eae0700 1 -- 172.21.15.22:0/3662076097 >> v1:172.21.15.116:6789/0 conn(0x7f4d8809dc70 legacy=0x7f4d881475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:30:51.390 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8eae0700 1 -- 172.21.15.22:0/3662076097 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8809cc80 con 0x7f4d88144780 2020-07-16T20:30:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8eae0700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d88144780 0x7f4d880b4e00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f4d88062390 tx=0x7f4d80009270).ready entity=mon.0 client_cookie=9c097291f05e3fcd server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8d2dd700 1 -- 172.21.15.22:0/3662076097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8000bbc0 con 0x7f4d88144780 2020-07-16T20:30:51.391 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8d2dd700 1 -- 172.21.15.22:0/3662076097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8000bd20 con 0x7f4d88144780 2020-07-16T20:30:51.398 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d8d2dd700 1 -- 172.21.15.22:0/3662076097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d80011400 con 0x7f4d88144780 2020-07-16T20:30:51.398 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 -- 172.21.15.22:0/3662076097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d88144780 msgr2=0x7f4d880b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d88144780 0x7f4d880b4e00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f4d88062390 tx=0x7f4d80009270).stop 2020-07-16T20:30:51.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 -- 172.21.15.22:0/3662076097 shutdown_connections 2020-07-16T20:30:51.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d88144780 0x7f4d880b4e00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.399 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 --2- 172.21.15.22:0/3662076097 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4d8809e050 0x7f4d88144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 -- 172.21.15.22:0/3662076097 >> 172.21.15.22:0/3662076097 conn(0x7f4d880b9530 msgr2=0x7f4d880b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 -- 172.21.15.22:0/3662076097 shutdown_connections 2020-07-16T20:30:51.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.366+0000 7f4d90543700 1 -- 172.21.15.22:0/3662076097 wait complete. 2020-07-16T20:30:51.400 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.367+0000 7f4d90543700 1 Processor -- start 2020-07-16T20:30:51.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d90543700 1 -- start start 2020-07-16T20:30:51.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d90543700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f4d8809e050 0x7f4d88157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.401 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d90543700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8813e5f0 con 0x7f4d88140c60 2020-07-16T20:30:51.402 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d90543700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8813e890 con 0x7f4d8809dc70 2020-07-16T20:30:51.403 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d90543700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d880b1ec0 con 0x7f4d8809e050 2020-07-16T20:30:51.403 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d8eae0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4d88140c60 0x7f4d88160440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40380/0 (socket says 172.21.15.22:40380) 2020-07-16T20:30:51.403 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d8eae0700 1 -- 172.21.15.22:0/1905199183 learned_addr learned my addr 172.21.15.22:0/1905199183 (peer_addr_for_me v1:172.21.15.22:0/0) 2020-07-16T20:30:51.404 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.368+0000 7f4d8dade700 1 --2- 172.21.15.22:0/1905199183 >> v2:172.21.15.116:3300/0 conn(0x7f4d8809e050 0x7f4d88157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.404 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019152517 0 0) 0x7f4d8813e5f0 con 0x7f4d88140c60 2020-07-16T20:30:51.404 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d60003240 con 0x7f4d88140c60 2020-07-16T20:30:51.404 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105570177 0 0) 0x7f4d8813e890 con 0x7f4d8809dc70 2020-07-16T20:30:51.405 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d8813e5f0 con 0x7f4d8809dc70 2020-07-16T20:30:51.405 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3946133638 0 0) 0x7f4d60003240 con 0x7f4d88140c60 2020-07-16T20:30:51.405 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d8dade700 1 -- 172.21.15.22:0/1905199183 >> v1:172.21.15.116:6789/0 conn(0x7f4d8809dc70 legacy=0x7f4d880b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.405 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d8dade700 1 -- 172.21.15.22:0/1905199183 >> v1:172.21.15.22:6789/0 conn(0x7f4d88140c60 legacy=0x7f4d88160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.406 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d8dade700 1 -- 172.21.15.22:0/1905199183 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8813e270 con 0x7f4d8809e050 2020-07-16T20:30:51.406 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d8dade700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d8809e050 0x7f4d88157960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f4d800033f0 tx=0x7f4d84008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8000bbc0 con 0x7f4d8809e050 2020-07-16T20:30:51.407 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400f690 con 0x7f4d8809e050 2020-07-16T20:30:51.408 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d880af8c0 con 0x7f4d8809e050 2020-07-16T20:30:51.408 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8400f9f0 con 0x7f4d8809e050 2020-07-16T20:30:51.409 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.369+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8813f190 con 0x7f4d8809e050 2020-07-16T20:30:51.409 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.370+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8805f320 con 0x7f4d8809e050 2020-07-16T20:30:51.409 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.370+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f4d8401a030 con 0x7f4d8809e050 2020-07-16T20:30:51.409 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.371+0000 7f4d767fc700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 0x7f4d60052910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:30:51.410 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.371+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4d84067450 con 0x7f4d8809e050 2020-07-16T20:30:51.410 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.371+0000 7f4d8e2df700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 0x7f4d60052910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:30:51.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.371+0000 7f4d8e2df700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 0x7f4d60052910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4d78000f20 tx=0x7f4d78007840).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:30:51.411 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.375+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f4d8403fb00 con 0x7f4d8809e050 2020-07-16T20:30:51.529 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.527+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d8813eca0 con 0x7f4d60050450 2020-07-16T20:30:51.534 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.531+0000 7f4d767fc700 1 -- 172.21.15.22:0/1905199183 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82349 (secure 0 0 0) 0x7f4d8813eca0 con 0x7f4d60050450 2020-07-16T20:30:51.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 msgr2=0x7f4d60052910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 0x7f4d60052910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4d78000f20 tx=0x7f4d78007840).stop 2020-07-16T20:30:51.535 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d8809e050 msgr2=0x7f4d88157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:30:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d8809e050 0x7f4d88157960 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f4d800033f0 tx=0x7f4d84008040).stop 2020-07-16T20:30:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 shutdown_connections 2020-07-16T20:30:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f4d60050450 0x7f4d60052910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 --2- 172.21.15.22:0/1905199183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d8809e050 0x7f4d88157960 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:30:51.536 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 >> 172.21.15.22:0/1905199183 conn(0x7f4d880b9530 msgr2=0x7f4d88146b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:30:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 shutdown_connections 2020-07-16T20:30:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:30:51.532+0000 7f4d90543700 1 -- 172.21.15.22:0/1905199183 wait complete. 2020-07-16T20:30:51.537 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2020-07-16T20:30:51.538 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:30:51.557 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2020-07-16T20:30:51.332760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":889008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002784"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960978+0000","last_change":"2020-07-16T20:30:29.590733+0000","last_active":"2020-07-16T20:30:29.960978+0000","last_peered":"2020-07-16T20:30:29.960978+0000","last_clean":"2020-07-16T20:30:29.960978+0000","last_became_active":"2020-07-16T20:30:29.590030+0000","last_became_peered":"2020-07-16T20:30:29.590030+0000","last_unstale":"2020-07-16T20:30:29.960978+0000","last_undegraded":"2020-07-16T20:30:29.960978+0000","last_fullsized":"2020-07-16T20:30:29.960978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970487+0000","last_change":"2020-07-16T20:30:23.564026+0000","last_active":"2020-07-16T20:30:29.970487+0000","last_peered":"2020-07-16T20:30:29.970487+0000","last_clean":"2020-07-16T20:30:29.970487+0000","last_became_active":"2020-07-16T20:30:23.563591+0000","last_became_peered":"2020-07-16T20:30:23.563591+0000","last_unstale":"2020-07-16T20:30:29.970487+0000","last_undegraded":"2020-07-16T20:30:29.970487+0000","last_fullsized":"2020-07-16T20:30:29.970487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.959365+0000","last_change":"2020-07-16T20:30:26.577657+0000","last_active":"2020-07-16T20:30:32.959365+0000","last_peered":"2020-07-16T20:30:32.959365+0000","last_clean":"2020-07-16T20:30:32.959365+0000","last_became_active":"2020-07-16T20:30:26.577264+0000","last_became_peered":"2020-07-16T20:30:26.577264+0000","last_unstale":"2020-07-16T20:30:32.959365+0000","last_undegraded":"2020-07-16T20:30:32.959365+0000","last_fullsized":"2020-07-16T20:30:32.959365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961017+0000","last_change":"2020-07-16T20:30:29.819730+0000","last_active":"2020-07-16T20:30:29.961017+0000","last_peered":"2020-07-16T20:30:29.961017+0000","last_clean":"2020-07-16T20:30:29.961017+0000","last_became_active":"2020-07-16T20:30:29.819079+0000","last_became_peered":"2020-07-16T20:30:29.819079+0000","last_unstale":"2020-07-16T20:30:29.961017+0000","last_undegraded":"2020-07-16T20:30:29.961017+0000","last_fullsized":"2020-07-16T20:30:29.961017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972715+0000","last_change":"2020-07-16T20:30:23.565160+0000","last_active":"2020-07-16T20:30:29.972715+0000","last_peered":"2020-07-16T20:30:29.972715+0000","last_clean":"2020-07-16T20:30:29.972715+0000","last_became_active":"2020-07-16T20:30:23.564708+0000","last_became_peered":"2020-07-16T20:30:23.564708+0000","last_unstale":"2020-07-16T20:30:29.972715+0000","last_undegraded":"2020-07-16T20:30:29.972715+0000","last_fullsized":"2020-07-16T20:30:29.972715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.956474+0000","last_change":"2020-07-16T20:30:26.576566+0000","last_active":"2020-07-16T20:30:32.956474+0000","last_peered":"2020-07-16T20:30:32.956474+0000","last_clean":"2020-07-16T20:30:32.956474+0000","last_became_active":"2020-07-16T20:30:26.576206+0000","last_became_peered":"2020-07-16T20:30:26.576206+0000","last_unstale":"2020-07-16T20:30:32.956474+0000","last_undegraded":"2020-07-16T20:30:32.956474+0000","last_fullsized":"2020-07-16T20:30:32.956474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964620+0000","last_change":"2020-07-16T20:30:29.963501+0000","last_active":"2020-07-16T20:30:29.964620+0000","last_peered":"2020-07-16T20:30:29.964620+0000","last_clean":"2020-07-16T20:30:29.964620+0000","last_became_active":"2020-07-16T20:30:29.962701+0000","last_became_peered":"2020-07-16T20:30:29.962701+0000","last_unstale":"2020-07-16T20:30:29.964620+0000","last_undegraded":"2020-07-16T20:30:29.964620+0000","last_fullsized":"2020-07-16T20:30:29.964620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.960393+0000","last_change":"2020-07-16T20:30:23.563276+0000","last_active":"2020-07-16T20:30:29.960393+0000","last_peered":"2020-07-16T20:30:29.960393+0000","last_clean":"2020-07-16T20:30:29.960393+0000","last_became_active":"2020-07-16T20:30:23.562833+0000","last_became_peered":"2020-07-16T20:30:23.562833+0000","last_unstale":"2020-07-16T20:30:29.960393+0000","last_undegraded":"2020-07-16T20:30:29.960393+0000","last_fullsized":"2020-07-16T20:30:29.960393+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.963350+0000","last_change":"2020-07-16T20:30:26.728399+0000","last_active":"2020-07-16T20:30:32.963350+0000","last_peered":"2020-07-16T20:30:32.963350+0000","last_clean":"2020-07-16T20:30:32.963350+0000","last_became_active":"2020-07-16T20:30:26.727822+0000","last_became_peered":"2020-07-16T20:30:26.727822+0000","last_unstale":"2020-07-16T20:30:32.963350+0000","last_undegraded":"2020-07-16T20:30:32.963350+0000","last_fullsized":"2020-07-16T20:30:32.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972314+0000","last_change":"2020-07-16T20:30:29.963087+0000","last_active":"2020-07-16T20:30:29.972314+0000","last_peered":"2020-07-16T20:30:29.972314+0000","last_clean":"2020-07-16T20:30:29.972314+0000","last_became_active":"2020-07-16T20:30:29.962463+0000","last_became_peered":"2020-07-16T20:30:29.962463+0000","last_unstale":"2020-07-16T20:30:29.972314+0000","last_undegraded":"2020-07-16T20:30:29.972314+0000","last_fullsized":"2020-07-16T20:30:29.972314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972497+0000","last_change":"2020-07-16T20:30:23.564311+0000","last_active":"2020-07-16T20:30:29.972497+0000","last_peered":"2020-07-16T20:30:29.972497+0000","last_clean":"2020-07-16T20:30:29.972497+0000","last_became_active":"2020-07-16T20:30:23.563870+0000","last_became_peered":"2020-07-16T20:30:23.563870+0000","last_unstale":"2020-07-16T20:30:29.972497+0000","last_undegraded":"2020-07-16T20:30:29.972497+0000","last_fullsized":"2020-07-16T20:30:29.972497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'2","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970024+0000","last_change":"2020-07-16T20:30:18.798690+0000","last_active":"2020-07-16T20:30:29.970024+0000","last_peered":"2020-07-16T20:30:29.970024+0000","last_clean":"2020-07-16T20:30:29.970024+0000","last_became_active":"2020-07-16T20:30:18.798374+0000","last_became_peered":"2020-07-16T20:30:18.798374+0000","last_unstale":"2020-07-16T20:30:29.970024+0000","last_undegraded":"2020-07-16T20:30:29.970024+0000","last_fullsized":"2020-07-16T20:30:29.970024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:11.506317+0000","last_clean_scrub_stamp":"2020-07-16T20:30:11.506317+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"14","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:31.122600+0000","last_change":"2020-07-16T20:30:26.575513+0000","last_active":"2020-07-16T20:30:31.122600+0000","last_peered":"2020-07-16T20:30:31.122600+0000","last_clean":"2020-07-16T20:30:31.122600+0000","last_became_active":"2020-07-16T20:30:26.575008+0000","last_became_peered":"2020-07-16T20:30:26.575008+0000","last_unstale":"2020-07-16T20:30:31.122600+0000","last_undegraded":"2020-07-16T20:30:31.122600+0000","last_fullsized":"2020-07-16T20:30:31.122600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970256+0000","last_change":"2020-07-16T20:30:29.962769+0000","last_active":"2020-07-16T20:30:29.970256+0000","last_peered":"2020-07-16T20:30:29.970256+0000","last_clean":"2020-07-16T20:30:29.970256+0000","last_became_active":"2020-07-16T20:30:29.962094+0000","last_became_peered":"2020-07-16T20:30:29.962094+0000","last_unstale":"2020-07-16T20:30:29.970256+0000","last_undegraded":"2020-07-16T20:30:29.970256+0000","last_fullsized":"2020-07-16T20:30:29.970256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972436+0000","last_change":"2020-07-16T20:30:23.565757+0000","last_active":"2020-07-16T20:30:29.972436+0000","last_peered":"2020-07-16T20:30:29.972436+0000","last_clean":"2020-07-16T20:30:29.972436+0000","last_became_active":"2020-07-16T20:30:23.565340+0000","last_became_peered":"2020-07-16T20:30:23.565340+0000","last_unstale":"2020-07-16T20:30:29.972436+0000","last_undegraded":"2020-07-16T20:30:29.972436+0000","last_fullsized":"2020-07-16T20:30:29.972436+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"13","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961060+0000","last_change":"2020-07-16T20:30:26.576938+0000","last_active":"2020-07-16T20:30:29.961060+0000","last_peered":"2020-07-16T20:30:29.961060+0000","last_clean":"2020-07-16T20:30:29.961060+0000","last_became_active":"2020-07-16T20:30:26.576529+0000","last_became_peered":"2020-07-16T20:30:26.576529+0000","last_unstale":"2020-07-16T20:30:29.961060+0000","last_undegraded":"2020-07-16T20:30:29.961060+0000","last_fullsized":"2020-07-16T20:30:29.961060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.961144+0000","last_change":"2020-07-16T20:30:29.819984+0000","last_active":"2020-07-16T20:30:29.961144+0000","last_peered":"2020-07-16T20:30:29.961144+0000","last_clean":"2020-07-16T20:30:29.961144+0000","last_became_active":"2020-07-16T20:30:29.819257+0000","last_became_peered":"2020-07-16T20:30:29.819257+0000","last_unstale":"2020-07-16T20:30:29.961144+0000","last_undegraded":"2020-07-16T20:30:29.961144+0000","last_fullsized":"2020-07-16T20:30:29.961144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972741+0000","last_change":"2020-07-16T20:30:23.564144+0000","last_active":"2020-07-16T20:30:29.972741+0000","last_peered":"2020-07-16T20:30:29.972741+0000","last_clean":"2020-07-16T20:30:29.972741+0000","last_became_active":"2020-07-16T20:30:23.563690+0000","last_became_peered":"2020-07-16T20:30:23.563690+0000","last_unstale":"2020-07-16T20:30:29.972741+0000","last_undegraded":"2020-07-16T20:30:29.972741+0000","last_fullsized":"2020-07-16T20:30:29.972741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.962719+0000","last_change":"2020-07-16T20:30:26.579571+0000","last_active":"2020-07-16T20:30:32.962719+0000","last_peered":"2020-07-16T20:30:32.962719+0000","last_clean":"2020-07-16T20:30:32.962719+0000","last_became_active":"2020-07-16T20:30:26.579193+0000","last_became_peered":"2020-07-16T20:30:26.579193+0000","last_unstale":"2020-07-16T20:30:32.962719+0000","last_undegraded":"2020-07-16T20:30:32.962719+0000","last_fullsized":"2020-07-16T20:30:32.962719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.970842+0000","last_change":"2020-07-16T20:30:29.962943+0000","last_active":"2020-07-16T20:30:29.970842+0000","last_peered":"2020-07-16T20:30:29.970842+0000","last_clean":"2020-07-16T20:30:29.970842+0000","last_became_active":"2020-07-16T20:30:29.962240+0000","last_became_peered":"2020-07-16T20:30:29.962240+0000","last_unstale":"2020-07-16T20:30:29.970842+0000","last_undegraded":"2020-07-16T20:30:29.970842+0000","last_fullsized":"2020-07-16T20:30:29.970842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.961561+0000","last_change":"2020-07-16T20:30:26.578033+0000","last_active":"2020-07-16T20:30:32.961561+0000","last_peered":"2020-07-16T20:30:32.961561+0000","last_clean":"2020-07-16T20:30:32.961561+0000","last_became_active":"2020-07-16T20:30:26.577510+0000","last_became_peered":"2020-07-16T20:30:26.577510+0000","last_unstale":"2020-07-16T20:30:32.961561+0000","last_undegraded":"2020-07-16T20:30:32.961561+0000","last_fullsized":"2020-07-16T20:30:32.961561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.971041+0000","last_change":"2020-07-16T20:30:23.565353+0000","last_active":"2020-07-16T20:30:29.971041+0000","last_peered":"2020-07-16T20:30:29.971041+0000","last_clean":"2020-07-16T20:30:29.971041+0000","last_became_active":"2020-07-16T20:30:23.565031+0000","last_became_peered":"2020-07-16T20:30:23.565031+0000","last_unstale":"2020-07-16T20:30:29.971041+0000","last_undegraded":"2020-07-16T20:30:29.971041+0000","last_fullsized":"2020-07-16T20:30:29.971041+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964572+0000","last_change":"2020-07-16T20:30:29.962904+0000","last_active":"2020-07-16T20:30:29.964572+0000","last_peered":"2020-07-16T20:30:29.964572+0000","last_clean":"2020-07-16T20:30:29.964572+0000","last_became_active":"2020-07-16T20:30:29.962274+0000","last_became_peered":"2020-07-16T20:30:29.962274+0000","last_unstale":"2020-07-16T20:30:29.964572+0000","last_undegraded":"2020-07-16T20:30:29.964572+0000","last_fullsized":"2020-07-16T20:30:29.964572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.972529+0000","last_change":"2020-07-16T20:30:23.565324+0000","last_active":"2020-07-16T20:30:29.972529+0000","last_peered":"2020-07-16T20:30:29.972529+0000","last_clean":"2020-07-16T20:30:29.972529+0000","last_became_active":"2020-07-16T20:30:23.564073+0000","last_became_peered":"2020-07-16T20:30:23.564073+0000","last_unstale":"2020-07-16T20:30:29.972529+0000","last_undegraded":"2020-07-16T20:30:29.972529+0000","last_fullsized":"2020-07-16T20:30:29.972529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:22.553821+0000","last_clean_scrub_stamp":"2020-07-16T20:30:22.553821+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:32.958525+0000","last_change":"2020-07-16T20:30:26.728247+0000","last_active":"2020-07-16T20:30:32.958525+0000","last_peered":"2020-07-16T20:30:32.958525+0000","last_clean":"2020-07-16T20:30:32.958525+0000","last_became_active":"2020-07-16T20:30:26.727617+0000","last_became_peered":"2020-07-16T20:30:26.727617+0000","last_unstale":"2020-07-16T20:30:32.958525+0000","last_undegraded":"2020-07-16T20:30:32.958525+0000","last_fullsized":"2020-07-16T20:30:32.958525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:25.562679+0000","last_clean_scrub_stamp":"2020-07-16T20:30:25.562679+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":112820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":110744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":111125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]}]}} 2020-07-16T20:30:51.572 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.572 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.573 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.574 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.574 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.575 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.575 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.576 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.578 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.579 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.579 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.580 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-07-16T20:30:11.506317+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=11, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.580 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.581 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.581 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.582 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.583 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.583 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.586 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.586 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.588 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.588 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.589 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.589 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-07-16T20:30:22.553821+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=22, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.590 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-07-16T20:30:25.562679+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=25, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:30:51.590 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-07-16T20:31:04.005 INFO:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:31:04.009 INFO:teuthology.orchestra.run.smithi116:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-07-16T20:31:11.592 INFO:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-07-16T20:31:11.721 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 Processor -- start 2020-07-16T20:31:11.722 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 -- start start 2020-07-16T20:31:11.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d809e050 0x7f51d8144290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 0x7f51d80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.727 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d8147ed0 con 0x7f51d809dc70 2020-07-16T20:31:11.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d8148170 con 0x7f51d809e050 2020-07-16T20:31:11.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.720+0000 7f51dee85700 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d809cb10 con 0x7f51d8144780 2020-07-16T20:31:11.728 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d809e050 0x7f51d8144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d809e050 0x7f51d8144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39680/0 (socket says 172.21.15.22:39680) 2020-07-16T20:31:11.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 -- 172.21.15.22:0/3648327636 learned_addr learned my addr 172.21.15.22:0/3648327636 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:31:11.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dd422700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 0x7f51d80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.729 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 -- 172.21.15.22:0/3648327636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 msgr2=0x7f51d80b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 0x7f51d80b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 -- 172.21.15.22:0/3648327636 >> v1:172.21.15.116:6789/0 conn(0x7f51d809dc70 legacy=0x7f51d81475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-07-16T20:31:11.730 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 -- 172.21.15.22:0/3648327636 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d809cc80 con 0x7f51d809e050 2020-07-16T20:31:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dd422700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 0x7f51d80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-07-16T20:31:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d7fff700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d809e050 0x7f51d8144290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f51c8002f30 tx=0x7f51c8006e90).ready entity=mon.0 client_cookie=1733d62f3b9691af server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d77fe700 1 -- 172.21.15.22:0/3648327636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c8009850 con 0x7f51d809e050 2020-07-16T20:31:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d77fe700 1 -- 172.21.15.22:0/3648327636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c80099b0 con 0x7f51d809e050 2020-07-16T20:31:11.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51d77fe700 1 -- 172.21.15.22:0/3648327636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c8009d10 con 0x7f51d809e050 2020-07-16T20:31:11.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 -- 172.21.15.22:0/3648327636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d809e050 msgr2=0x7f51d8144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d809e050 0x7f51d8144290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f51c8002f30 tx=0x7f51c8006e90).stop 2020-07-16T20:31:11.732 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 -- 172.21.15.22:0/3648327636 shutdown_connections 2020-07-16T20:31:11.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f51d8144780 0x7f51d80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 --2- 172.21.15.22:0/3648327636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d809e050 0x7f51d8144290 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 -- 172.21.15.22:0/3648327636 >> 172.21.15.22:0/3648327636 conn(0x7f51d80b9530 msgr2=0x7f51d80b9940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 -- 172.21.15.22:0/3648327636 shutdown_connections 2020-07-16T20:31:11.733 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.721+0000 7f51dee85700 1 -- 172.21.15.22:0/3648327636 wait complete. 2020-07-16T20:31:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.723+0000 7f51dee85700 1 Processor -- start 2020-07-16T20:31:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.723+0000 7f51dee85700 1 -- start start 2020-07-16T20:31:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dee85700 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f51d809dc70 0x7f51d8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dee85700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d8144780 0x7f51d8066c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dee85700 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d8157f10 con 0x7f51d80b86a0 2020-07-16T20:31:11.735 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dee85700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d8157040 con 0x7f51d8144780 2020-07-16T20:31:11.736 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dee85700 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d81572e0 con 0x7f51d809dc70 2020-07-16T20:31:11.736 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d8144780 0x7f51d8066c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51d8144780 0x7f51d8066c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39682/0 (socket says 172.21.15.22:39682) 2020-07-16T20:31:11.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 -- 172.21.15.22:0/1681777664 learned_addr learned my addr 172.21.15.22:0/1681777664 (peer_addr_for_me v2:172.21.15.22:0/0) 2020-07-16T20:31:11.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51dcc21700 1 --2- 172.21.15.22:0/1681777664 >> v2:172.21.15.116:3300/0 conn(0x7f51d809dc70 0x7f51d8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.737 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 -- 172.21.15.22:0/1681777664 >> v2:172.21.15.116:3300/0 conn(0x7f51d809dc70 msgr2=0x7f51d8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 --2- 172.21.15.22:0/1681777664 >> v2:172.21.15.116:3300/0 conn(0x7f51d809dc70 0x7f51d8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 -- 172.21.15.22:0/1681777664 >> v1:172.21.15.116:6789/0 conn(0x7f51d80b86a0 legacy=0x7f51d80b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 -- 172.21.15.22:0/1681777664 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8157580 con 0x7f51d8144780 2020-07-16T20:31:11.738 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d7fff700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d8144780 0x7f51d8066c40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f51c8002f30 tx=0x7f51c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.724+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c8011e80 con 0x7f51d8144780 2020-07-16T20:31:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.725+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c801d5d0 con 0x7f51d8144780 2020-07-16T20:31:11.739 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.725+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d8067130 con 0x7f51d8144780 2020-07-16T20:31:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.725+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51c801d930 con 0x7f51d8144780 2020-07-16T20:31:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.725+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d80b7c60 con 0x7f51d8144780 2020-07-16T20:31:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.725+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d8157710 con 0x7f51d8144780 2020-07-16T20:31:11.740 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.726+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 62075+0+0 (secure 0 0 0) 0x7f51c8025030 con 0x7f51d8144780 2020-07-16T20:31:11.741 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.726+0000 7f51d4ff9700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 0x7f51b40524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-07-16T20:31:11.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.726+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f51c8069460 con 0x7f51d8144780 2020-07-16T20:31:11.742 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.726+0000 7f51dcc21700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 0x7f51b40524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-07-16T20:31:11.744 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.727+0000 7f51dcc21700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 0x7f51b40524d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f51c000d000 tx=0x7f51c0000b80).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-07-16T20:31:11.745 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.730+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+132361 (secure 0 0 0) 0x7f51c8041bf0 con 0x7f51d8144780 2020-07-16T20:31:11.885 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.883+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 --> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51d805f320 con 0x7f51b4050010 2020-07-16T20:31:11.889 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.887+0000 7f51d4ff9700 1 -- 172.21.15.22:0/1681777664 <== mgr.4107 v2:172.21.15.116:6800/23155 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82304 (secure 0 0 0) 0x7f51d805f320 con 0x7f51b4050010 2020-07-16T20:31:11.890 INFO:teuthology.orchestra.run.smithi022.stdout: 2020-07-16T20:31:11.891 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 msgr2=0x7f51b40524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 0x7f51b40524d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f51c000d000 tx=0x7f51c0000b80).stop 2020-07-16T20:31:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d8144780 msgr2=0x7f51d8066c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-07-16T20:31:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d8144780 0x7f51d8066c40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f51c8002f30 tx=0x7f51c8015000).stop 2020-07-16T20:31:11.892 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 shutdown_connections 2020-07-16T20:31:11.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.116:6800/23155,v1:172.21.15.116:6801/23155] conn(0x7f51b4050010 0x7f51b40524d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 --2- 172.21.15.22:0/1681777664 >> v2:172.21.15.116:3300/0 conn(0x7f51d809dc70 0x7f51d8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 --2- 172.21.15.22:0/1681777664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51d8144780 0x7f51d8066c40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-07-16T20:31:11.893 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 >> 172.21.15.22:0/1681777664 conn(0x7f51d80b9530 msgr2=0x7f51d8149700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-07-16T20:31:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 shutdown_connections 2020-07-16T20:31:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:2020-07-16T20:31:11.888+0000 7f51dee85700 1 -- 172.21.15.22:0/1681777664 wait complete. 2020-07-16T20:31:11.894 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2020-07-16T20:31:11.900 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2020-07-16T20:31:11.337462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5912,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746583904,"statfs":{"total":773094113280,"available":764501917696,"internally_reserved":8589934592,"allocated":2195456,"data_stored":889008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002892"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:03.095713+0000","last_change":"2020-07-16T20:31:03.095795+0000","last_active":"2020-07-16T20:31:03.095713+0000","last_peered":"2020-07-16T20:31:03.095713+0000","last_clean":"2020-07-16T20:31:03.095713+0000","last_became_active":"2020-07-16T20:30:29.590030+0000","last_became_peered":"2020-07-16T20:30:29.590030+0000","last_unstale":"2020-07-16T20:31:03.095713+0000","last_undegraded":"2020-07-16T20:31:03.095713+0000","last_fullsized":"2020-07-16T20:31:03.095713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:03.095708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:03.095708+0000","last_clean_scrub_stamp":"2020-07-16T20:31:03.095708+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:50.807347+0000","last_change":"2020-07-16T20:30:50.807433+0000","last_active":"2020-07-16T20:30:50.807347+0000","last_peered":"2020-07-16T20:30:50.807347+0000","last_clean":"2020-07-16T20:30:50.807347+0000","last_became_active":"2020-07-16T20:30:23.563591+0000","last_became_peered":"2020-07-16T20:30:23.563591+0000","last_unstale":"2020-07-16T20:30:50.807347+0000","last_undegraded":"2020-07-16T20:30:50.807347+0000","last_fullsized":"2020-07-16T20:30:50.807347+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:50.807335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:50.807335+0000","last_clean_scrub_stamp":"2020-07-16T20:30:50.807335+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"22","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:55.002777+0000","last_change":"2020-07-16T20:30:55.002851+0000","last_active":"2020-07-16T20:30:55.002777+0000","last_peered":"2020-07-16T20:30:55.002777+0000","last_clean":"2020-07-16T20:30:55.002777+0000","last_became_active":"2020-07-16T20:30:26.577264+0000","last_became_peered":"2020-07-16T20:30:26.577264+0000","last_unstale":"2020-07-16T20:30:55.002777+0000","last_undegraded":"2020-07-16T20:30:55.002777+0000","last_fullsized":"2020-07-16T20:30:55.002777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2020-07-16T20:30:55.002772+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2020-07-16T20:30:55.002772+0000","last_clean_scrub_stamp":"2020-07-16T20:30:55.002772+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:07.042105+0000","last_change":"2020-07-16T20:31:07.042186+0000","last_active":"2020-07-16T20:31:07.042105+0000","last_peered":"2020-07-16T20:31:07.042105+0000","last_clean":"2020-07-16T20:31:07.042105+0000","last_became_active":"2020-07-16T20:30:29.819079+0000","last_became_peered":"2020-07-16T20:30:29.819079+0000","last_unstale":"2020-07-16T20:31:07.042105+0000","last_undegraded":"2020-07-16T20:31:07.042105+0000","last_fullsized":"2020-07-16T20:31:07.042105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:07.042100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:07.042100+0000","last_clean_scrub_stamp":"2020-07-16T20:31:07.042100+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:51.552036+0000","last_change":"2020-07-16T20:30:51.552095+0000","last_active":"2020-07-16T20:30:51.552036+0000","last_peered":"2020-07-16T20:30:51.552036+0000","last_clean":"2020-07-16T20:30:51.552036+0000","last_became_active":"2020-07-16T20:30:23.564708+0000","last_became_peered":"2020-07-16T20:30:23.564708+0000","last_unstale":"2020-07-16T20:30:51.552036+0000","last_undegraded":"2020-07-16T20:30:51.552036+0000","last_fullsized":"2020-07-16T20:30:51.552036+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:51.552031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:51.552031+0000","last_clean_scrub_stamp":"2020-07-16T20:30:51.552031+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"21","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:49.649417+0000","last_change":"2020-07-16T20:30:49.649522+0000","last_active":"2020-07-16T20:30:49.649417+0000","last_peered":"2020-07-16T20:30:49.649417+0000","last_clean":"2020-07-16T20:30:49.649417+0000","last_became_active":"2020-07-16T20:30:26.576206+0000","last_became_peered":"2020-07-16T20:30:26.576206+0000","last_unstale":"2020-07-16T20:30:49.649417+0000","last_undegraded":"2020-07-16T20:30:49.649417+0000","last_fullsized":"2020-07-16T20:30:49.649417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2020-07-16T20:30:49.649407+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2020-07-16T20:30:49.649407+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.649407+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"12","reported_epoch":"24","state":"active+clean","last_fresh":"2020-07-16T20:30:29.964620+0000","last_change":"2020-07-16T20:30:29.963501+0000","last_active":"2020-07-16T20:30:29.964620+0000","last_peered":"2020-07-16T20:30:29.964620+0000","last_clean":"2020-07-16T20:30:29.964620+0000","last_became_active":"2020-07-16T20:30:29.962701+0000","last_became_peered":"2020-07-16T20:30:29.962701+0000","last_unstale":"2020-07-16T20:30:29.964620+0000","last_undegraded":"2020-07-16T20:30:29.964620+0000","last_fullsized":"2020-07-16T20:30:29.964620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:28.576985+0000","last_clean_scrub_stamp":"2020-07-16T20:30:28.576985+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:51.701097+0000","last_change":"2020-07-16T20:30:51.701177+0000","last_active":"2020-07-16T20:30:51.701097+0000","last_peered":"2020-07-16T20:30:51.701097+0000","last_clean":"2020-07-16T20:30:51.701097+0000","last_became_active":"2020-07-16T20:30:23.562833+0000","last_became_peered":"2020-07-16T20:30:23.562833+0000","last_unstale":"2020-07-16T20:30:51.701097+0000","last_undegraded":"2020-07-16T20:30:51.701097+0000","last_fullsized":"2020-07-16T20:30:51.701097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:51.701091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:51.701091+0000","last_clean_scrub_stamp":"2020-07-16T20:30:51.701091+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"24","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:53.804464+0000","last_change":"2020-07-16T20:30:53.804564+0000","last_active":"2020-07-16T20:30:53.804464+0000","last_peered":"2020-07-16T20:30:53.804464+0000","last_clean":"2020-07-16T20:30:53.804464+0000","last_became_active":"2020-07-16T20:30:26.727822+0000","last_became_peered":"2020-07-16T20:30:26.727822+0000","last_unstale":"2020-07-16T20:30:53.804464+0000","last_undegraded":"2020-07-16T20:30:53.804464+0000","last_fullsized":"2020-07-16T20:30:53.804464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2020-07-16T20:30:53.804455+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2020-07-16T20:30:53.804455+0000","last_clean_scrub_stamp":"2020-07-16T20:30:53.804455+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:03.477890+0000","last_change":"2020-07-16T20:31:03.477965+0000","last_active":"2020-07-16T20:31:03.477890+0000","last_peered":"2020-07-16T20:31:03.477890+0000","last_clean":"2020-07-16T20:31:03.477890+0000","last_became_active":"2020-07-16T20:30:29.962463+0000","last_became_peered":"2020-07-16T20:30:29.962463+0000","last_unstale":"2020-07-16T20:31:03.477890+0000","last_undegraded":"2020-07-16T20:31:03.477890+0000","last_fullsized":"2020-07-16T20:31:03.477890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:03.477886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:03.477886+0000","last_clean_scrub_stamp":"2020-07-16T20:31:03.477886+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:52.540376+0000","last_change":"2020-07-16T20:30:52.540463+0000","last_active":"2020-07-16T20:30:52.540376+0000","last_peered":"2020-07-16T20:30:52.540376+0000","last_clean":"2020-07-16T20:30:52.540376+0000","last_became_active":"2020-07-16T20:30:23.563870+0000","last_became_peered":"2020-07-16T20:30:23.563870+0000","last_unstale":"2020-07-16T20:30:52.540376+0000","last_undegraded":"2020-07-16T20:30:52.540376+0000","last_fullsized":"2020-07-16T20:30:52.540376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:52.540372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:52.540372+0000","last_clean_scrub_stamp":"2020-07-16T20:30:52.540372+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"25'4","reported_seq":"26","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:49.404147+0000","last_change":"2020-07-16T20:30:49.404200+0000","last_active":"2020-07-16T20:30:49.404147+0000","last_peered":"2020-07-16T20:30:49.404147+0000","last_clean":"2020-07-16T20:30:49.404147+0000","last_became_active":"2020-07-16T20:30:18.798374+0000","last_became_peered":"2020-07-16T20:30:18.798374+0000","last_unstale":"2020-07-16T20:30:49.404147+0000","last_undegraded":"2020-07-16T20:30:49.404147+0000","last_fullsized":"2020-07-16T20:30:49.404147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":4,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2020-07-16T20:30:49.404142+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2020-07-16T20:30:49.404142+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.404142+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1202,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"17","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:51.006911+0000","last_change":"2020-07-16T20:30:51.007017+0000","last_active":"2020-07-16T20:30:51.006911+0000","last_peered":"2020-07-16T20:30:51.006911+0000","last_clean":"2020-07-16T20:30:51.006911+0000","last_became_active":"2020-07-16T20:30:26.575008+0000","last_became_peered":"2020-07-16T20:30:26.575008+0000","last_unstale":"2020-07-16T20:30:51.006911+0000","last_undegraded":"2020-07-16T20:30:51.006911+0000","last_fullsized":"2020-07-16T20:30:51.006911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2020-07-16T20:30:51.006906+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2020-07-16T20:30:51.006906+0000","last_clean_scrub_stamp":"2020-07-16T20:30:51.006906+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:54.842557+0000","last_change":"2020-07-16T20:30:54.842643+0000","last_active":"2020-07-16T20:30:54.842557+0000","last_peered":"2020-07-16T20:30:54.842557+0000","last_clean":"2020-07-16T20:30:54.842557+0000","last_became_active":"2020-07-16T20:30:29.962094+0000","last_became_peered":"2020-07-16T20:30:29.962094+0000","last_unstale":"2020-07-16T20:30:54.842557+0000","last_undegraded":"2020-07-16T20:30:54.842557+0000","last_fullsized":"2020-07-16T20:30:54.842557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:54.842551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:54.842551+0000","last_clean_scrub_stamp":"2020-07-16T20:30:54.842551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:49.583287+0000","last_change":"2020-07-16T20:30:49.583345+0000","last_active":"2020-07-16T20:30:49.583287+0000","last_peered":"2020-07-16T20:30:49.583287+0000","last_clean":"2020-07-16T20:30:49.583287+0000","last_became_active":"2020-07-16T20:30:23.565340+0000","last_became_peered":"2020-07-16T20:30:23.565340+0000","last_unstale":"2020-07-16T20:30:49.583287+0000","last_undegraded":"2020-07-16T20:30:49.583287+0000","last_fullsized":"2020-07-16T20:30:49.583287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:49.583283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:49.583283+0000","last_clean_scrub_stamp":"2020-07-16T20:30:49.583283+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:54.162168+0000","last_change":"2020-07-16T20:30:54.162251+0000","last_active":"2020-07-16T20:30:54.162168+0000","last_peered":"2020-07-16T20:30:54.162168+0000","last_clean":"2020-07-16T20:30:54.162168+0000","last_became_active":"2020-07-16T20:30:26.576529+0000","last_became_peered":"2020-07-16T20:30:26.576529+0000","last_unstale":"2020-07-16T20:30:54.162168+0000","last_undegraded":"2020-07-16T20:30:54.162168+0000","last_fullsized":"2020-07-16T20:30:54.162168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:54.162162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:54.162162+0000","last_clean_scrub_stamp":"2020-07-16T20:30:54.162162+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:05.121849+0000","last_change":"2020-07-16T20:31:05.121941+0000","last_active":"2020-07-16T20:31:05.121849+0000","last_peered":"2020-07-16T20:31:05.121849+0000","last_clean":"2020-07-16T20:31:05.121849+0000","last_became_active":"2020-07-16T20:30:29.819257+0000","last_became_peered":"2020-07-16T20:30:29.819257+0000","last_unstale":"2020-07-16T20:31:05.121849+0000","last_undegraded":"2020-07-16T20:31:05.121849+0000","last_fullsized":"2020-07-16T20:31:05.121849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:05.121843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:05.121843+0000","last_clean_scrub_stamp":"2020-07-16T20:31:05.121843+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:00.498112+0000","last_change":"2020-07-16T20:31:00.498221+0000","last_active":"2020-07-16T20:31:00.498112+0000","last_peered":"2020-07-16T20:31:00.498112+0000","last_clean":"2020-07-16T20:31:00.498112+0000","last_became_active":"2020-07-16T20:30:23.563690+0000","last_became_peered":"2020-07-16T20:30:23.563690+0000","last_unstale":"2020-07-16T20:31:00.498112+0000","last_undegraded":"2020-07-16T20:31:00.498112+0000","last_fullsized":"2020-07-16T20:31:00.498112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:00.498104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:00.498104+0000","last_clean_scrub_stamp":"2020-07-16T20:31:00.498104+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"24","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:56.105245+0000","last_change":"2020-07-16T20:30:56.105320+0000","last_active":"2020-07-16T20:30:56.105245+0000","last_peered":"2020-07-16T20:30:56.105245+0000","last_clean":"2020-07-16T20:30:56.105245+0000","last_became_active":"2020-07-16T20:30:26.579193+0000","last_became_peered":"2020-07-16T20:30:26.579193+0000","last_unstale":"2020-07-16T20:30:56.105245+0000","last_undegraded":"2020-07-16T20:30:56.105245+0000","last_fullsized":"2020-07-16T20:30:56.105245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'8","last_scrub_stamp":"2020-07-16T20:30:56.105239+0000","last_deep_scrub":"25'8","last_deep_scrub_stamp":"2020-07-16T20:30:56.105239+0000","last_clean_scrub_stamp":"2020-07-16T20:30:56.105239+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:59.005514+0000","last_change":"2020-07-16T20:30:59.005599+0000","last_active":"2020-07-16T20:30:59.005514+0000","last_peered":"2020-07-16T20:30:59.005514+0000","last_clean":"2020-07-16T20:30:59.005514+0000","last_became_active":"2020-07-16T20:30:29.962240+0000","last_became_peered":"2020-07-16T20:30:29.962240+0000","last_unstale":"2020-07-16T20:30:59.005514+0000","last_undegraded":"2020-07-16T20:30:59.005514+0000","last_fullsized":"2020-07-16T20:30:59.005514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:59.005508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:59.005508+0000","last_clean_scrub_stamp":"2020-07-16T20:30:59.005508+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'7","reported_seq":"23","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:57.077867+0000","last_change":"2020-07-16T20:30:57.077939+0000","last_active":"2020-07-16T20:30:57.077867+0000","last_peered":"2020-07-16T20:30:57.077867+0000","last_clean":"2020-07-16T20:30:57.077867+0000","last_became_active":"2020-07-16T20:30:26.577510+0000","last_became_peered":"2020-07-16T20:30:26.577510+0000","last_unstale":"2020-07-16T20:30:57.077867+0000","last_undegraded":"2020-07-16T20:30:57.077867+0000","last_fullsized":"2020-07-16T20:30:57.077867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2020-07-16T20:30:57.077861+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2020-07-16T20:30:57.077861+0000","last_clean_scrub_stamp":"2020-07-16T20:30:57.077861+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:50.049449+0000","last_change":"2020-07-16T20:30:50.049532+0000","last_active":"2020-07-16T20:30:50.049449+0000","last_peered":"2020-07-16T20:30:50.049449+0000","last_clean":"2020-07-16T20:30:50.049449+0000","last_became_active":"2020-07-16T20:30:23.565031+0000","last_became_peered":"2020-07-16T20:30:23.565031+0000","last_unstale":"2020-07-16T20:30:50.049449+0000","last_undegraded":"2020-07-16T20:30:50.049449+0000","last_fullsized":"2020-07-16T20:30:50.049449+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:50.049443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:50.049443+0000","last_clean_scrub_stamp":"2020-07-16T20:30:50.049443+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:56.022364+0000","last_change":"2020-07-16T20:30:56.022495+0000","last_active":"2020-07-16T20:30:56.022364+0000","last_peered":"2020-07-16T20:30:56.022364+0000","last_clean":"2020-07-16T20:30:56.022364+0000","last_became_active":"2020-07-16T20:30:29.962274+0000","last_became_peered":"2020-07-16T20:30:29.962274+0000","last_unstale":"2020-07-16T20:30:56.022364+0000","last_undegraded":"2020-07-16T20:30:56.022364+0000","last_fullsized":"2020-07-16T20:30:56.022364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:30:56.022355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:30:56.022355+0000","last_clean_scrub_stamp":"2020-07-16T20:30:56.022355+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:31:01.522305+0000","last_change":"2020-07-16T20:31:01.522412+0000","last_active":"2020-07-16T20:31:01.522305+0000","last_peered":"2020-07-16T20:31:01.522305+0000","last_clean":"2020-07-16T20:31:01.522305+0000","last_became_active":"2020-07-16T20:30:23.564073+0000","last_became_peered":"2020-07-16T20:30:23.564073+0000","last_unstale":"2020-07-16T20:31:01.522305+0000","last_undegraded":"2020-07-16T20:31:01.522305+0000","last_fullsized":"2020-07-16T20:31:01.522305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-16T20:31:01.522299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-16T20:31:01.522299+0000","last_clean_scrub_stamp":"2020-07-16T20:31:01.522299+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4","reported_seq":"20","reported_epoch":"25","state":"active+clean","last_fresh":"2020-07-16T20:30:56.096212+0000","last_change":"2020-07-16T20:30:56.096290+0000","last_active":"2020-07-16T20:30:56.096212+0000","last_peered":"2020-07-16T20:30:56.096212+0000","last_clean":"2020-07-16T20:30:56.096212+0000","last_became_active":"2020-07-16T20:30:26.727617+0000","last_became_peered":"2020-07-16T20:30:26.727617+0000","last_unstale":"2020-07-16T20:30:56.096212+0000","last_undegraded":"2020-07-16T20:30:56.096212+0000","last_fullsized":"2020-07-16T20:30:56.096212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2020-07-16T20:30:56.096206+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2020-07-16T20:30:56.096206+0000","last_clean_scrub_stamp":"2020-07-16T20:30:56.096206+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1202,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048872,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322968,"statfs":{"total":96636764160,"available":95562719232,"internally_reserved":1073741824,"allocated":294912,"data_stored":112820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048848,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322992,"statfs":{"total":96636764160,"available":95562743808,"internally_reserved":1073741824,"allocated":270336,"data_stored":110584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":110744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":110550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":111125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048856,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322984,"statfs":{"total":96636764160,"available":95562735616,"internally_reserved":1073741824,"allocated":278528,"data_stored":112085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.506}]}]}]}} 2020-07-16T20:31:11.906 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-07-16T20:30:28.576985+0000 time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=28, tm_wday=3, tm_yday=198, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=7, tm_mday=16, tm_hour=20, tm_min=30, tm_sec=46, tm_wday=3, tm_yday=198, tm_isdst=0) 2020-07-16T20:31:11.906 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-07-16T20:31:23.806 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-07-16T20:31:23.807 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2020-07-16T20:31:23.808 DEBUG:teuthology.task.console_log:Killing console logger for smithi116 2020-07-16T20:31:23.808 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2020-07-16T20:31:23.809 DEBUG:teuthology.task.console_log:Killing console logger for smithi116 2020-07-16T20:31:23.809 DEBUG:teuthology.exit:Finished running handlers